Production Run Review Process

Prior to production research simulations, we conduct scientific and computational readiness reviews. Outlines of the material we cover during each review is shown below

Each production run should be defined as Study meaning that we have sufficient detail to identify total output files. When we think we are ready to start study, we conduct two reviews:

Scientific Readiness Review

1. Goal of study: • Expected outcome. Statement of why this is a priority

2. Problem statements Inputs: • ERF • CVM • Rupture variations (rupture generator) • Frequencies of simulation • SGT codes • Sites to be calculated

3. Outputs: • Identification of expect outputs • Types of outputs files and results • Number of each • Size of expected • Existing partial results

4. Verification/Validation Work: • Evidence the computational system produces correct answer

5. Reproducibly of results: • What we have done to implement reproducibility of results • What is required to re-run this study 1 year from now?

6. Expected analysis: • What analysis will be conducted with results. • Who will help with scientific analysis

7. Metrics Review • What metrics will be calculated?

8. Open Issues/Risks Analysis