UCERF3 JetStream Benchmark
Introduction
JetStream is accessed through the Atmosphere web portal. Read the user documentation to launch a virtual machine on the JetStream system using Atmosphere.
To connect via SSH, configure an SSH key and upload this in the ‘advanced’ section of the JetStream user settings. In addition, scripts can be uploaded to set up an instance that will configure the environment of the instance.
Benchmark Results
| SIMULATION | HORIZON | NUM SIMULATIONS | THREADS | SIM / THREAD | RUNTIME (s) | MEMORY USAGE (GB) | TIME / SIMULATION | TIME / THREAD | SUs | MACHINE |
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 1 | 10 | 5 | 2 | 477.2749898 | 25 | 47.72749898 | 95.45499797 | m1.large | |
| 2 | 1 | 25 | 5 | 5 | 1015.450814 | 25 | 40.61803255 | 203.0901628 | m1.large | |
| 3 | 1 | 50 | 10 | 5 | 1879.826009 | 50 | 37.59652019 | 187.9826009 | m1.xxlarge | |
| 4 | 1 | 100 | 10 | 10 | 3535.324325 | 50 | 35.35324325 | 353.5324325 | m1.xxlarge | |
| 5 | 1 | 200 | 10 | 20 | 9787.439788 | 50 | 48.93719894 | 978.7439788 | m1.xxlarge | |
| 6 | 1 | 200 | 20 | 10 | 12505.12893 | 100 | 62.52564464 | 625.2564464 | m1.xxlarge | |
| 7 | 0.08333333 | 500 | 20 | 25 | 27366.20519 | 100 | 54.73241037 | 1368.310259 | m1.xxlarge | |
| 8 | 1 | 500 | 20 | 25 | 30934.89149 | 100 | 61.86978297 | 1546.744574 | m1.xxlarge | |
| 9 | 1 | 20 | 20 | 1 | 1175.592247 | 100 | 58.77961237 | 58.77961237 | m1.xxlarge | |
| 10 | 1 | 10 | 10 | 1 | 470.5639017 | 50 | 47.05639017 | 47.05639017 | m1.xxlarge | |
| 11 | 1 | 5 | 5 | 1 | 240.4323306 | 25 | 48.08646612 | 48.08646612 | m1.xxlarge | |
| 12 | 1 | 1 | 1 | 1 | 117.9551687 | 5 | 117.9551687 | 117.9551687 | m1.xxlarge |
Computing Proposal for JetStream
The Collaboratory for the Study of Earthquake Predictability (CSEP) provides a computational infrastructure to conduct numerical experiments that evaluate earthquake forecasts against authoritative data sources. Experiments can be either retrospective or prospective with each having different computational requirements. Prospective experiments involve calculations that trigger automatically from recent seismicity or on regular intervals (e.g., daily, weekly, monthly, etc). Retrospective experiments are initiated on-demand by scientists to evaluate earthquake forecasts over periods with recorded earthquake data. We are developing a software infrastructure that will support both type of experiments and provide thoughtful data access to the CSEP community. Additionally, we plan to explore the possibility of developing the CSEP infrastructure into a SaaS that gives researchers the ability to conduct bespoke experiments in a controlled and secure environment.
Our initial CSEP experiment will focus on the Uniform California Earthquake Rupture Forecast Version 3 (UCERF3-ETAS) [Field et al., 2017]. The standard unit-of-work for this UCERF3-ETAS experiment is a one-year stochastic event sets consisting of 10,000 synthetic catalogs. We have benchmarked the unit-of-work to use about 8000 SUs on JetStream and about 2.5 Gb of generated data. We will address our understanding of the added benefits that finite-faults provide in earthquake forecasts over hypocenter based models. In addition, we will evaluate how UCERF3-ETAS performs relative to more simple forecasts for all earthquakes with Mw > 6.2 that have occured since 1985. To accomplish these goals we estimate the runs will require about 25 units-of-work or 200,000 SUs. We require ten (m1.xxlarge) instances to perform these calculations with a shared mounted 100 Gb volume. We will also need 1 Tb of persistent storage to store metadata and archived experiment data. We would also like to request API access to OpenStack so we can automatically provision and free resources as necessary.
References
Field, Edward H., et al. "A spatiotemporal clustering model for the Third Uniform California Earthquake Rupture Forecast (UCERF3‐ETAS): Toward an operational earthquake forecast." Bulletin of the Seismological Society of America 107.3 (2017): 1049-1081.
