Maechlin at 08:43, 3 August 2018

2018-08-03T08:43:44Z

Maechlin: Created page with "Large numbers of Broadband Platform jobs can be submitted to a computing cluster using the following techniques and scripts: == Run Notes == Below is a script that we've used..."

2018-08-01T18:10:23Z

Created page with "Large numbers of Broadband Platform jobs can be submitted to a computing cluster using the following techniques and scripts: == Run Notes == Below is a script that we've used..."

New page

Large numbers of Broadband Platform jobs can be submitted to a computing cluster using the following techniques and scripts:
== Run Notes ==

Below is a script that we've used for running the validation events. Few things to note:
#you will need to set up your e-mail address at the top;
#the Part-A events it is set to run may need to be customized to match whatever you have installed in your system (probably no Parkfield and rename the other events if you don't have the packages using site response).
#you can also customize what methods you want to run.

If you run events that don't need the site response module (all Part-A events using Christine's corrections instead of the ones I'm using right now), you will want to remove the "-s" option from the line invoking bbp_hpcc_validation.py as well. Please do let us know if you have questions and we can help.

== Job Submit Script ==
posted in file: run_full_validation.sh
<pre>
#!/bin/bash

# Set e-mail address here!
email=

bbp_hpcc=bbp_hpcc_validation.py
methods=( "gp" "sdsu" "exsim" "ucsb" "irikura" "song" )
a_events=( "parkfield" "ar" "lomap" "ch" "nr" "whittier" "nps" "landers" "tottori" "niigata" "mineral" "rdl" "saguenay" )
a_labels=( "parkfield" "Alum Rock SiteResponse" "LOMAP-SiteResponse" "Chino Hills SiteResponse" "NR-SiteResponse" "Whittier-SiteResponse" "North Palm Springs-SiteResponse" "Landers-SiteResponse" "Tottori-SiteResponse" "Niigata-SiteResponse" "Mineral Site Response" "Riviere du Loup 1k Site Response" "Saguenay 1k Site Response" )
b_regions=( "no" "so" )
b_regions_labels=( "NoCal" "SoCal" )
b_dist=( "20" "50" )
b_events=( "55rv" "62ss" "66rv" "66ss" )
b_labels=( "5.5rv" "6.2ss" "6.6rv" "6.6ss" )

# Loop over methods
for method in ${methods[@]}; do
# Part-A events
for ((i=0;i<${#a_events[@]};++i)); do
$bbp_hpcc -n 50 -s --email $email -c $method -d $method-${a_events[i]}-50r --new-nodes --no-hypo-rand -e "${a_labels[i]}"
sbatch $method-${a_events[i]}-50r/*.slurm
done;

# Part-B events
for ((i=0;i<${#b_events[@]};++i)); do
for ((j=0;j<${#b_regions[@]};++j)); do
for dist in ${b_dist[@]}; do
$bbp_hpcc -w 1 -n 50 --email $email -c $method -d $method-gmpe${b_events[i]}$dist${b_regions[j]} --new-nodes --hypo-rand -e "GMPE ${b_labels[i]} ${b_regions_labels[j]} ${dist}km"
sbatch $method-gmpe${b_events[i]}$dist${b_regions[j]}/*.slurm
done;
done;
done;
done;
</pre>
== Related Entries ==
*[[BBP]

@@ Line 47: / Line 47: @@
 </pre>
 == Related Entries ==
-*[[BBP]
+*[[BBP]]

BBP Batch Jobs - Revision history

Maechlin at 08:43, 3 August 2018

Maechlin: Created page with "Large numbers of Broadband Platform jobs can be submitted to a computing cluster using the following techniques and scripts: == Run Notes == Below is a script that we've used..."