Qlogic MPI
Overview
Qlogic MPI is a customized version of the standard
MPICH MPI library that runs over the Pathscale/Qlogic Infinipath high-speed
Infiniband network.
Setup
If this MPI is available on a system, it is the default MPI and therefore
no setup is needed to use it.
Usage
There are two things to take into account in using
Qlogic MPI. The first is how to compile an MPI
program against it. The second is how to run the resulting
executable.
To compile against Qlogic MPI you should use
one of the compilation wrappers included with it. These wrappers
automatically add any necessary compilation arguments to your
compiler command to include the required Qlogic MPI
headers and libraries. Their syntax is as follows:
mpif77 -fc=f77_compiler -config=f77_compiler ...
mpif90 -f90=f90_compiler -config=f90_compiler ...
mpicc -cc=C_compiler -config=C_compiler ...
where f77_compiler,
f90_compiler, and C_compiler
are the names of any of the installed Fortran77, Fortran90, and C compilers
respectively. The "..." is the rest of the normal compilation line,
such as in:
mpif77 -fc=ifort -config=ifort foo.f -o foo
|
A list of available compilers can be found in the 'Compilers and
Programming Tools' section of the HPC software pages. Examples of
the above commands can be found in the Examples section of this
page.
To run code that was compiled against the Qlogic MPI you
need to use
the command /usr/global/bin/mpirun in your PBS job
submission script. Its syntax is:
/usr/global/bin/mpirun executable_name
where executable_name is the name of your
Qlogic MPI executable.
An example PBS script can be found in the Examples
section of this page. Information on PBS scripts can be found in the
Users Guide for the system intended to be used.
Examples
For a Fortran77 MPI file foo.f that is intended to
be compiled with the Portland Group Fortran77 compiler to an executable
called foo, the following command would be used:
mpif77 -fc=pgf77 -config=pgf77 foo.f -o foo
|
For a C MPI file foo.c that is intended to be
compiled with the Intel C Compiler to an executable called
foo, the following command would be used:
mpicc -cc=icc -config=icc foo.c -o foo
|
An example PBS job submission script to run one of the above
foo executables over 4 nodes that have the Myrinet
interconnect using 2 processors per node for a maximum of 2 hours
would look like this:
#PBS -l nodes=4:ppn=2
#PBS -l walltime=2:00:00
#PBS -j oe
# change the current working directory to the directory where
# the executable file 'foo' can be found
cd /home/user/mpi
# run the executable file 'foo' using the qmpirun script
/usr/global/bin/mpirun ./foo
|
Further information on PBS scripts and submitting jobs can be found in
Users Guide for the system that the job is intended to be run on.
Documentation
N/A
Please send questions or suggestions about this web page to beatnic@aset.psu.edu
ASET | ITS | Penn State
|
