In order to use gm-mpich, every MPICH user must have a gm configuration file. The default file is $HOME/.gmpi/conf.
The configuration file must contain the following information:
number_of_mpi_process node port [board] node port [board] ... |
The fields are as follows:
number_of_mpi_processes is the number of MPI process. For example, for a 2-node cluster, if you want to run an 8 PE MPI jo, then it should be set to 8 and there should be 8 node/port combinations specified, using different ports
node is the name of the node.
port is the port number used on the node. Port 2 is for users, port 3 is for Ethernet. You can specify ports 4 through 7.
board is the board number. This field is assumed to be 0. If you have multiple boards, you must change this number.
Comments (those lines that begin with #) and blank lines are ignored.
The following example, in the case with multiple boards on node node02:
# The first non-commented line must contain the number of # nodes in the cluster: 3 # The following should contain the hostname and port for # each interface: red.sgi.com 2 node02.sgi.com 2 node02.sgi.com 2 1 |
When installing the gm-mpich package, the installace utility creates a file named /etc/ace/gmpi.conf on every node. The installace utility assumes that every node is using port 2. Users can copy this file to $HOME/.gmpi/conf on every node; this is done automatically for the root user. To use a different file location, a user can set the GMPICONF environment variable to the file as follows:
# export GMPICONF=/etc/ace/gmpi.conf |
This file must be accessible on all nodes. When using PBS, this environment variable must be set in the PBS request's environment.