Home Switchboard Unix Administration Red Hat TCP/IP Networks Neoliberalism Toxic Managers
May the source be with you, but remember the KISS principle ;-)
Skepticism and critical thinking is not panacea, but can help to understand the world better

Specifying Ethernet Interface Instead of Infiniband


High Performance Computing (HPC)

Recommended Links

mpirun command

Running MPI jobs

Testing openMPI environment on SGE FAQ Running jobs under SGE
InfiniBand Tuning the run-time characteristics of Infiniband communications MCA Parameters Specifying ethernet interface instead of infiniband Installing Mellanox InfiniBand Driver on RHEL 6.5 SGE Parallel Environment VASP Performance optimization
Troubleshooting ulimit - locked memory limit   HPC cluster Architecture  Admin Horror Stories Humor Etc

FAQ Tuning the run-time characteristics of MPI sm communications

2. How do I specify use of sm for MPI messages? 

Typically, it is unnecessary to do so; OMPI will use the best BTL available for each communication.

Nevertheless, you may use the MCA parameter btl. You should also specify the self BTL for communications between a process and itself. Further, if not all processes in your job will run on the same, single node, then you also need to specify a BTL for internode communications. For example:

shell$ mpirun --mca btl self,sm,tcp -np 16 ./a.out