UCERF3 JetStream Benchmark - Revision history

Wsavran: /* Computing Proposal */

2018-10-26T19:50:06Z

Computing Proposal

Wsavran at 21:57, 15 October 2018

2018-10-15T21:57:30Z

Wsavran: /* Benchmark Results */

2018-10-15T21:49:21Z

Benchmark Results

Wsavran at 21:48, 15 October 2018

2018-10-15T21:48:11Z

Wsavran: Created page with " == Computing Proposal == The Collaboratory for the Study of Earthquake Predictability (CSEP) provides a computational infrastructure to conduct numerical experiments that ev..."

2018-10-15T20:55:32Z

Created page with " == Computing Proposal == The Collaboratory for the Study of Earthquake Predictability (CSEP) provides a computational infrastructure to conduct numerical experiments that ev..."

New page

== Computing Proposal ==

The Collaboratory for the Study of Earthquake Predictability (CSEP) provides a computational infrastructure to conduct numerical experiments that evaluate earthquake forecasts against authoritative data sources. Experiments can be either retrospective or prospective with each having different computational requirements. Prospective experiments involve calculations that trigger automatically from recent seismicity or on regular intervals (e.g., daily, weekly, monthly, etc). Retrospective experiments are initiated on-demand by scientists to evaluate earthquake forecasts over periods with recorded earthquake data. We are developing a software infrastructure that will support both type of experiments and provide thoughtful data access to the CSEP community. Additionally, we plan to explore the possibility of developing the CSEP infrastructure into a SaaS that gives researchers the ability to conduct bespoke experiments in a controlled and secure environment.

Our initial CSEP experiment will focus on the Uniform California Earthquake Rupture Forecast Version 3 (UCERF3-ETAS) [Field et al., 2017]. The standard unit-of-work for this UCERF3-ETAS experiment is a one-year stochastic event sets consisting of 10,000 synthetic catalogs. We have benchmarked the unit-of-work to use about 8000 SUs on JetStream and about 2.5 Gb of generated data. We will address our understanding of the added benefits that finite-faults provide in earthquake forecasts over hypocenter based models. In addition, we will evaluate how UCERF3-ETAS performs relative to more simple forecasts for all earthquakes with Mw > 6.2 that have occured since 1985. To accomplish these goals we estimate the runs will require about 25 units-of-work or 200,000 SUs. We require ten (m1.xxlarge) instances to perform these calculations with a shared mounted 100 Gb volume. We will also need 1 Tb of persistent storage to store metadata and archived experiment data. We would also like to request API access to OpenStack so we can automatically provision and free resources as necessary.

== References ==

Field, Edward H., et al. "A spatiotemporal clustering model for the Third Uniform California Earthquake Rupture Forecast (UCERF3‐ETAS): Toward an operational earthquake forecast." Bulletin of the Seismological Society of America 107.3 (2017): 1049-1081.

← Older revision		Revision as of 21:57, 15 October 2018
Line 1:		Line 1:
		+	== Introduction ==
		+	JetStream is accessed through the [https://use.jetstream-cloud.org/application/dashboard Atmosphere] web portal. Read the [https://portal.xsede.org/jetstream#qsguide:launch user documentation] to launch a virtual machine on the JetStream system using Atmosphere.
		+
		+	To connect via SSH, configure an SSH key and upload this in the ‘advanced’ section of the JetStream user settings. In addition, scripts can be uploaded to set up an instance that will configure the environment of the instance.
		+
		+
	== Benchmark Results ==		== Benchmark Results ==
	{\| class = 'wikitable'		{\| class = 'wikitable'

@@ Line 11: / Line 11: @@
 ! TIME / SIMULATION
 ! TIME / THREAD
 ! SUs
 ! MACHINE
@@ Line 24: / Line 23: @@
 | 47.72749898
 | 95.45499797
+|
 | m1.large
@@ Line 37: / Line 35: @@
 | 40.61803255
 | 203.0901628
+|
 | m1.large
@@ Line 50: / Line 47: @@
 | 37.59652019
 | 187.9826009
+|
 | m1.xxlarge
@@ Line 63: / Line 59: @@
 | 35.35324325
 | 353.5324325
+|
 | m1.xxlarge
@@ Line 76: / Line 71: @@
 | 48.93719894
 | 978.7439788
+|
 | m1.xxlarge
@@ Line 89: / Line 83: @@
 | 62.52564464
 | 625.2564464
+|
 | m1.xxlarge
@@ Line 102: / Line 95: @@
 | 54.73241037
 | 1368.310259
+|
 | m1.xxlarge
@@ Line 115: / Line 107: @@
 | 61.86978297
 | 1546.744574
+|
 | m1.xxlarge
@@ Line 128: / Line 119: @@
 | 58.77961237
 | 58.77961237
+|
 | m1.xxlarge
@@ Line 141: / Line 131: @@
 | 47.05639017
 | 47.05639017
+|
 | m1.xxlarge
@@ Line 154: / Line 143: @@
 | 48.08646612
 | 48.08646612
+|
 | m1.xxlarge
@@ Line 167: / Line 155: @@
 | 117.9551687
 | 117.9551687
+|
 | m1.xxlarge
 |}
 == Computing Proposal ==

← Older revision		Revision as of 21:48, 15 October 2018
Line 1:		Line 1:
		+	== Benchmark Results ==
		+	{\| class = 'wikitable'
		+	\|-
		+	! SIMULATION
		+	! HORIZON
		+	! NUM SIMULATIONS
		+	! THREADS
		+	! SIM / THREAD
		+	! RUNTIME (s)
		+	! MEMORY USAGE (GB)
		+	! TIME / SIMULATION
		+	! TIME / THREAD
		+	! STORAGE (GB)
		+	! SUs
		+	! MACHINE
		+	\|-
		+	\| 1
		+	\| 1
		+	\| 10
		+	\| 5
		+	\| 2
		+	\| 477.2749898
		+	\| 25
		+	\| 47.72749898
		+	\| 95.45499797
		+	\|
		+	\|
		+	\| m1.large
		+	\|-
		+	\| 2
		+	\| 1
		+	\| 25
		+	\| 5
		+	\| 5
		+	\| 1015.450814
		+	\| 25
		+	\| 40.61803255
		+	\| 203.0901628
		+	\|
		+	\|
		+	\| m1.large
		+	\|-
		+	\| 3
		+	\| 1
		+	\| 50
		+	\| 10
		+	\| 5
		+	\| 1879.826009
		+	\| 50
		+	\| 37.59652019
		+	\| 187.9826009
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|-
		+	\| 4
		+	\| 1
		+	\| 100
		+	\| 10
		+	\| 10
		+	\| 3535.324325
		+	\| 50
		+	\| 35.35324325
		+	\| 353.5324325
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|-
		+	\| 5
		+	\| 1
		+	\| 200
		+	\| 10
		+	\| 20
		+	\| 9787.439788
		+	\| 50
		+	\| 48.93719894
		+	\| 978.7439788
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|-
		+	\| 6
		+	\| 1
		+	\| 200
		+	\| 20
		+	\| 10
		+	\| 12505.12893
		+	\| 100
		+	\| 62.52564464
		+	\| 625.2564464
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|-
		+	\| 7
		+	\| 0.08333333
		+	\| 500
		+	\| 20
		+	\| 25
		+	\| 27366.20519
		+	\| 100
		+	\| 54.73241037
		+	\| 1368.310259
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|-
		+	\| 8
		+	\| 1
		+	\| 500
		+	\| 20
		+	\| 25
		+	\| 30934.89149
		+	\| 100
		+	\| 61.86978297
		+	\| 1546.744574
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|-
		+	\| 9
		+	\| 1
		+	\| 20
		+	\| 20
		+	\| 1
		+	\| 1175.592247
		+	\| 100
		+	\| 58.77961237
		+	\| 58.77961237
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|-
		+	\| 10
		+	\| 1
		+	\| 10
		+	\| 10
		+	\| 1
		+	\| 470.5639017
		+	\| 50
		+	\| 47.05639017
		+	\| 47.05639017
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|-
		+	\| 11
		+	\| 1
		+	\| 5
		+	\| 5
		+	\| 1
		+	\| 240.4323306
		+	\| 25
		+	\| 48.08646612
		+	\| 48.08646612
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|-
		+	\| 12
		+	\| 1
		+	\| 1
		+	\| 1
		+	\| 1
		+	\| 117.9551687
		+	\| 5
		+	\| 117.9551687
		+	\| 117.9551687
		+	\|
		+	\|
		+	\| m1.xxlarge
		+	\|}
		+

	== Computing Proposal ==		== Computing Proposal ==

@@ Line 165: / Line 165: @@
 |}
-== Computing Proposal ==
+== Computing Proposal for JetStream ==
 The Collaboratory for the Study of Earthquake Predictability (CSEP) provides a computational infrastructure to conduct numerical experiments that evaluate earthquake forecasts against authoritative data sources. Experiments can be either retrospective or prospective with each having different computational requirements. Prospective experiments involve calculations that trigger automatically from recent seismicity or on regular intervals (e.g., daily, weekly, monthly, etc). Retrospective experiments are initiated on-demand by scientists to evaluate earthquake forecasts over periods with recorded earthquake data. We are developing a software infrastructure that will support both type of experiments and provide thoughtful data access to the CSEP community. Additionally, we plan to explore the possibility of developing the CSEP infrastructure into a SaaS that gives researchers the ability to conduct bespoke experiments in a controlled and secure environment.
 Our initial CSEP experiment will focus on the Uniform California Earthquake Rupture Forecast Version 3 (UCERF3-ETAS) [Field et al., 2017]. The standard unit-of-work for this UCERF3-ETAS experiment is a one-year stochastic event sets consisting of 10,000 synthetic catalogs. We have benchmarked the unit-of-work to use about 8000 SUs on JetStream and about 2.5 Gb of generated data. We will address our understanding of the added benefits that finite-faults provide in earthquake forecasts over hypocenter based models. In addition, we will evaluate how UCERF3-ETAS performs relative to more simple forecasts for all earthquakes with Mw > 6.2 that have occured since 1985. To accomplish these goals we estimate the runs will require about 25 units-of-work or 200,000 SUs. We require ten (m1.xxlarge) instances to perform these calculations with a shared mounted 100 Gb volume. We will also need 1 Tb of persistent storage to store metadata and archived experiment data. We would also like to request API access to OpenStack so we can automatically provision and free resources as necessary.
 == References ==
 Field, Edward H., et al. "A spatiotemporal clustering model for the Third Uniform California Earthquake Rupture Forecast (UCERF3‐ETAS): Toward an operational earthquake forecast." Bulletin of the Seismological Society of America 107.3 (2017): 1049-1081.