Querying And Managing Jobs - IBM Power Systems 775 Manual

Job Command File for Hybrid (MPI + OpenMP) job
Figure 2-22 shows a sample job command file for a Hybrid (MPI + OpenMP) job. This job is
requesting two nodes, eight tasks per node and four threads per task. The total requested
cores are 64.
#!/bin/ksh
# @ job_name = myjob.hybrid
# @ job_type = parallel
# @ class = X_Class
# @ output = $(job_name).out
# @ error = $(job_name).err
# @ env_copy = all
# @ bulkxfer = yes
# @ network.MPI = sn_all,shared,US
# @ rset = RSET_MCM_AFFINITY
# @ mcm_affinity_options = mcm_mem_req mcm_distribute mcm_sni_none
# @ task_affinity = core(4)
# @ cpus_per_core = 1
# @ parallel_threads = 4
# @ node = 2
# @ tasks_per_node = 8
# @ collective_groups = 64
# @ queue
export MP_LABELIO=yes
export LANG=en_US
export MP_SHARED_MEMORY=yes
export MP_SINGLE_THREAD=yes
export MP_DEVTYPE=hfi
export MP_USE_BULK_XFER=yes
export MP_RDMA_ROUTE_MODE="hw_indirect"
export MP_FIFO_ROUTE_MODE="hw_indirect"
poe ./hybrid.exe
Figure 2-22 Job Command File for Hybrid (MPI + OpenMP) job
If the job command file is composed correctly and as you intended, you submit the job by
using the llsubmit command. Example 2-15 shows the usage of the llsubmit command and
the message that is received after the command is issued.
Example 2-15 llsubmit command
$ llsubmit ll_mpi.cmd
llsubmit: The job "c250f10c12ap02-hf0.ppd.pok.ibm.com.49" has been submitted.

2.6.2 Querying and managing jobs

Querying and managing jobs is described in this section.
Querying job status
After a job is submitted by using the llsubmit command, you use the llq command to query
and display the LoadLeveler job queue. Example 2-16 on page 147 shows the usage of the
llq command and the message that is received after the command is issued.
146
IBM Power Systems 775 for AIX and Linux HPC Solution