Difference between revisions of "Broadband Platform on HPCC"

From SCECpedia
Jump to navigationJump to search
Line 5: Line 5:
 
In order to run the Broadband Platform on HPCC, users need to follow these steps:
 
In order to run the Broadband Platform on HPCC, users need to follow these steps:
  
#Install and Build Broadband on HPCC
+
#Installing and Building Broadband on HPCC
#Install desired Green's Functions and validation packages
+
#Installing Desired Green's Functions and Validation Packages
#Configure needed environment variables
+
#Configuring Required Environment Variables
#Create validation runs
+
#Creating Validation Runs
#Run the simulations
+
#Running Simulations
  
 
== Broadband File System Issues ==
 
== Broadband File System Issues ==
Line 17: Line 17:
 
Because the /tmp filesystem on each node is automatically cleaned at the end of each simulation, it is necessary to copy all wanted files to a permanent location. The HPCC validation scripts do that automatically after the simulations are finished (but before the PBS job ends).
 
Because the /tmp filesystem on each node is automatically cleaned at the end of each simulation, it is necessary to copy all wanted files to a permanent location. The HPCC validation scripts do that automatically after the simulations are finished (but before the PBS job ends).
  
== Installing BBP on HPCC ==
+
== Installing and Building BBP on HPCC ==
 +
 
 +
== Installing Desired Green's Functions and Validation Packages ==
 +
 
 +
== Configuring Required Environment Variables ==
 +
 
 +
== Creating Validation Runs ==
 +
 
 +
== Running Simulations ==

Revision as of 22:24, 25 September 2012

Current broadband studies may exceed 200K seismograms. To produce this number of seismograms, we need to use high performance computing.

Overview

In order to run the Broadband Platform on HPCC, users need to follow these steps:

  1. Installing and Building Broadband on HPCC
  2. Installing Desired Green's Functions and Validation Packages
  3. Configuring Required Environment Variables
  4. Creating Validation Runs
  5. Running Simulations

Broadband File System Issues

When running on HPCC, the validation scripts set up Broadband's BBP_DATA_DIR to use a directory in the /tmp filesystem. Because Broadband simulations are very I/O intensive, reading and writing thousands of small/medium files on an average simulation, we use a local filesystem on each compute node to minimize remote reads and writes and thus improve execution time. This approach also avoids creating a bottleneck a file server and eliminates unnecessary network traffic. It is therefore possible for multiple users to run their simulations on HPCC without significant interference.

Because the /tmp filesystem on each node is automatically cleaned at the end of each simulation, it is necessary to copy all wanted files to a permanent location. The HPCC validation scripts do that automatically after the simulations are finished (but before the PBS job ends).

Installing and Building BBP on HPCC

Installing Desired Green's Functions and Validation Packages

Configuring Required Environment Variables

Creating Validation Runs

Running Simulations