CVM-H Acceptance Test Framework Validation

An acceptance test framework to test and compare the performance of various Community Velocity Models (CVM) was designed by Patrick Small. This framework uses CruiseControl, a continuous integration tool and an extensible framework for creating a custom continuous build and test process for the CVMs. CruiseControl is setup on one of the SCEC development servers and can be configured to use a specific user's TeraGrid credentials. Once setup with appropriate Grid Proxy certificates, CruiseControl can remotely deploy required source code and test data on the TeraGrid resource and perform an end to end test.

Fig 1: Chino Hills CVM-H AWP Surface.

To validate this test framework,

• CruiseControl was setup on a community account on AfterShock - a SCEC development server.
• A specific user's TeraGrid credential was linked to this account.
• CruiseControl was configured to run a build and test job on Kraken - a TeraGrid resource.
• At the specified time CruiseControl,

- Transferred all the required build scripts and source data to Kraken.
- Necessary source code was checked out from SVN by the build scripts.
- The CVM code was built and required mesh was extracted.
- The wave propagation code was built and run by script.
- The generated synthetic waveforms (seismogram) data was collected and plotted.
- The synthetic waveform data was compared to the observed waveform data and goodness-of-fit (GOF) curves were plotted.
- A HTML page was generated by an automated script to summarize the test results.

A set test results generated by Patrick can be found here: http://earth.usc.edu/~patrices/cvm-t/

An example test result page can be found here: Simulation of Chino Hills (Filtered) event at 1Hz with material properties provided by CVM-H