none
Has anybody tested MSMPI with RoCE network ? RRS feed

  • Question

  • Hi any body tested MS MPI on RoCE network, we have developed RoCE solution and its working fine with SMB-Direct, i want to add more tests using MPI. Need to know directions .

    I have downloaded HPCPack2012R2-Full.zip but need some headsup , whether soembody already using this for RoCE solution ?

    Thanks in advance

    Vishal

    Tuesday, September 8, 2015 6:51 PM

All replies

  • Hi Vishal,

    It is possible to run MS-MPI over RoCE networks, though you need to configure the traffic classes so that all NetworkDirect traffic gets assigned to a lossless traffic class.  MS-MPI currently uses ephemeral ports for it's NetworkDirect connections.  I believe the simplest way to do this is to define a default loss-less PFC class, and then explicitly specify TCP/UDP PFC settings to a lossy traffic class.  Your network vendor may have instructions for how to do this, too, as it's really a network configuration issue and not directly MPI related.

    Cheers,
    -Fab

    Wednesday, September 9, 2015 1:03 AM