Wondering if anyone can help me with this issue:
Running HPC Pack 2016 (Update 3) on Windows Server 2016, 8 nodes, Infiniband FDR (56gb/sec) on application network. Running MPI PingPong throughput test and only getting 5480 MB/sec max between nodes. Last I checked I should be getting around 6800 MB/sec
for FDR.
Tried multiple FDR network cards, problem persists. Switch and Cables are fully FDR capable. Scheduler says all nodes have 56gb/sec connection and Network Direct is showing True. Drivers and firmware are all correct.
Oddly when i change the HPC network to run on Gigabit only, i am seeing a similar speed bottleneck- MPI PingPong only returns 70 MB/sec max, which is very short of the 125 MB/sec maximum.
Perhaps i am interpreting something incorrectly? Has anyone else discovered a similar issue?
