Page History

...

The qnodes_status script gives a summary of the output of the qnodes command (as written, it considers only nodes with the property "group0"). Remove the ":group" argument to qnodes to use this on Quantum2.

We have found that submitting many 1 cpu jobs to the clusters can often create efficiency problems when these jobs compete for resources with jobs that are requesting whole or multiples of nodes. That is, the 1 cpu jobs  will dominate the resources making jobs requesting multiples of nodes wait longer than they should with respect to the fair share policy.  To overcome this difficulty we suggest that your 1 cpu jobs should be submitted in batches according to the size of the node.  To achieve this we have installed a parallel job manager using the perl programming language. To utilize this functionality you will have to write a perl script to manage your 1 cpu jobs.  Below we give an example of what your scripts might look. Example 1 is a normal 1 cpu PBS script executing your program without any perl parallelization. Examples 2a and 2b show the pbs script and perl script that you would need to write in order to parallelize example 1.

...

use Parallel::ForkManager;  ### this is the parallel perl package

Wiki Markup$start=$ARGV\[0\]; #### an increment variable starting pointunmigrated-wiki-markup

$ncpus=$ARGV\[1\];  #### the number of cpus  #### the number of cpus 

my $pm = new Parallel::ForkManager($ncpus);  ### start a parallel session with ncpus

...

When uploading scripts, please remember that comments are essential to helping others understand your work. All uploaded files should include author information, a date or version number, a description of the file's purpose and methodology, a description of the expected input (if applicable), and a description of the output format.

Wiki MarkupTo upload: Choose "Attachment" under the "Add" menu at right. Then, link to the attached file in this page using the following wiki syntax: \ [^filename.sh\], followed by a description of the file.

To use: download the file. Note that some browsers will append unwanted extensions to downloaded files. Remember that all every user is responsible for understanding at a detailed level all the tools that he/she uses!