Skip to content

runningRAVEN

Joshua J. Cogliati edited this page Dec 18, 2024 · 15 revisions

Compiling and Testing

See Installation for first-time installs.

See Updating RAVEN for updating and testing RAVEN.

Running

HPC Cluster

  • If you want to run qsub test on HPC cluster, first you need to make sure RAVEN is installed correctly on the cluster, then you need to specify values for parameter <NodeParameter> and <RemoteRunCommand> inside <RunInfo> block. Take INL Sawtooth (which uses PBS) for example, the <RunInfo> of your RAVEN XML input file will include the following specific information:
  <RunInfo>
    <NodeParameter>--hostfile</NodeParameter>
    <clusterParameters>-P neams</clusterParameters>
    <RemoteRunCommand>raven_ec_qsub_command.sh</RemoteRunCommand>
    <mode>
      pbs
      <runQSUB/>
    </mode>
  </RunInfo>

For INL Bitterroot (which uses slurm) an example of what should be added to the <RunInfo> of your RAVEN XML input file is:

  <RunInfo>
    <NodeParameter> --hostfile</NodeParameter>
    <clusterParameters>--wckey=neams</clusterParameters>
    <RemoteRunCommand>raven_ec_slurm_command.sh</RemoteRunCommand>
    <mode>
      slurm
      <runSbatch />
    </mode>
  </RunInfo>

Note that RAVEN will combine RunInfo sections in multiple input files provided at the command line, so a Sawtooth and a Bitterroot runinfo could be created and then run like raven_framework main.xml bitterroot.xml and raven_framework main.xml sawtooth.xml to be able to switch which cluster paramaters are used.

Also, please try to update the <clusterParameters> to your related PBS project name (http://hpcweb.inl.gov/home/pbs). The following is the example for raven_ec_qsub_command.sh that RAVEN is used for SAWTOOTH cluster

#!/bin/bash


if test -n "$PBS_O_WORKDIR"; then
    echo Moving to working dir: ${PBS_O_WORKDIR}
    cd $PBS_O_WORKDIR
fi

source /etc/profile.d/modules.sh
echo RAVEN_FRAMEWORK_DIR $RAVEN_FRAMEWORK_DIR
source $RAVEN_FRAMEWORK_DIR/../scripts/establish_conda_env.sh --load
module load openmpi

which python
which mpiexec
echo ''
echo $COMMAND
$COMMAND
  • If you have different libraries required by your applications, you can either update raven_ec_qsub_command.sh to load your libraries or create your own qsub command shell script and include it in the <RunInfo> block.

Any unix-based systems (e.g. Macintosh, MSYS, Linux)

Use:

[~/projects/raven]> ./raven_framework inputfile.xml

replacing inputfile.xml with the RAVEN input file you want to run.

Windows systems

  • From PowerShell or CMD, Use:
[~/projects/raven]> bash.exe raven_framework inputfile.xml

replacing inputfile.xml with the RAVEN input file you want to run;

or

  • BATCH file, Use:

    • Click on the file named raven_framework.bat in the raven directory:
    • This will open up a window requesting to type the input file path/name:
    • Type the input file name and press ENTER:
    • The code will execute

For the users that are using RAVEN at INL on the HPC please refer to this page