Comparison of CyberShake Studies

Study Name	Date	Science Goals	Frequency	Rupture Variations	Velocity Model(s)	Makespan (hrs)	Number of sites	Machine	Core Hours	Max Processors	Tasks	Jobs	Output files produced	Seismogram Pairs	Output Data (time series, IMs)	Comments
CyberShake Study 22.12	December 17, 2022 - April 4, 2023	Broadband Southern California CyberShake study	1 Hz deterministic, 25 Hz stochastic	G&P 2022	CVM-S4.26.M01 + merged taper	1829.2	335	OLCF Summit	32.4M	3364 nodes (141288 cores), 73% of Summit	?	?	9.4M	420M	76 TB	Broadband, included merged taper, variability in rupture speed, change to hypocentral spacing
CyberShake Study 21.12	December 15, 2021 - January 13, 2022	RSQSim Southern California CyberShake study	1 Hz	RSQSim	CVM-S4.26.M01	688.4	335	OLCF Summit	2.75M	89376 (46% of Summit)			102.9M	25.7M	1.9 TB	First RSQSim-based hazard map.
CyberShake Study 18.8	August 17, 2018 - March 28, 2019	Northern California CyberShake study	1 Hz	G&P 2014	CCA-06/USGS Bay Area/CVM-S4.26.M01	3079.3	869	NCSA Blue Waters, OLCF Titan	120M	262,704	18225	18065	6.3M	202.8M	14.4 TB	First Northern California study, increased smoothing zone to 20 km.
CyberShake Study 17.3	March 6, 2017 - April 6, 2017	Central California CyberShake study with 1D and 3D velocity models	1 Hz	G&P 2014	CCA 1D, CCA-06	738	876	NCSA Blue Waters, OLCF Titan	21.6M	101,472	15,581	15,581	15.2M	284.8M	10.7 TB	First Central California study, used CCA-06. Used minimum Vs of 900 m/s.
CyberShake Study 15.12	December 3, 2015 - April 28, 2016	Adding stochastic (to 10 Hz) to Study 15.4 and calculating duration values	10 Hz stoch	G&P 2014	CVM-S4.26.M01	3527	336	NCSA Blue Waters					11.8M	159.8M	30.5 TB	Applied site amplification to both deterministic and stochastic seismograms, using a modified approach to calculate Vref.
CyberShake Study 15.4	April 16 - May 24, 2015	1 Hz CyberShake map, with AWP-ODC-GPU, G&P 2014, CVM-S4.26, and new sites. Calculated RotD also.	1 Hz	G&P 2014	CVM-S4.26.M01	914	336	NCSA Blue Waters, OLCF Titan (pilot jobs)	37.6M	237,984	5505	4372	7.1M	159.8M	7.7 TB	Used DirectSynth to reduce the number of post-processing tasks and cut I/O by 99.9%.
CyberShake Study 14.2	February 18 - March 4, 2014	4 hazard models: CVM-S4.26 with CPU, CVM-S4.26 with GPU, 1D model with CPU, and CVM-H, no GTL with GPU.	0.5 Hz	G&P 2010	CVM-S4.26, BBP 1D, CVM-H no GTL	342	1144	NCSA Blue Waters	15.8M	295,040	99.9M	100707 (Condor), 29796 (submitted to Blue Waters)	16M	480.1M	57 TB	Workflow job to generate AWP workflow to support dynamic number of cores, GPU and CPU executables, batched SeisPSA jobs
CyberShake Study 13.4	April 17 - June 17, 2013	4 hazard models: CVM-S and CVM-H with the RWG V3.0.3 SGT code and AWP-ODC-SGT.	0.5 Hz	G&P 2010	CVM-S, CVM-H	716	1132	NCSA Blue Waters (custom solution), TACC Stampede (Pegasus/Condor/Globus)	10.8M (Blue Waters); 1.4M (Stampede)	128,000 (Blue Waters); 17,600 (Stampede)	470M (Stampede)	21912 submitted to Stampede	2264 (Blue Waters); 16M (Stampede)	480.1M	43 TB (Blue Waters), 12.3 TB (Stampede)	Hierarchical DAXes with 8 sub-DAXes, PMC, pipe forwarding, Handoff jobs from Blue Waters to Stampede, merged SeisPSA jobs, in-memory rupture variation generation
CyberShake Study 2.2 (post-processing only)	October 8, 2012 - March 6, 2013 (with a break from October 16 - November 8)	Redid post-processing of CyberShake 1.0 with G&P 2010.	0.5 Hz	G&P 2010	CVM-S	2976	217	NICS Kraken								PMC, pipe forwarding
CyberShake 1.4	August 25, 2011 - March 14, 2012	Deterministic to 0.5 Hz + stochastic to 10 Hz, CVM-S4 and CVM-H 11.2 for PBR, SCSN, and near-SCSN sites, using G&P 2010	10 Hz stoch	G&P 2010	CVM-S, CVM-H	4824	90	USC HPCC, TACC Ranger			112M		112M	40.0M	4 TB	Broadband
CyberShake 1.0	April 16 - June 10, 2009	0.5 Hz hazard map in Southern California, CVM-S	0.5 Hz	G&P 2007	CVM-S	1314	223	TACC Ranger	6,900,000	14,544	192M	3.9M (Condor), 3952 (submitted to Ranger)	190M	98.9M	10.6 TB	PDAX with 80 sub-DAXes, clustering, Condor glideins with Corral, zip files, Run Manager
CyberShake 0.5 (post-processing only)	June 26 - July 18, 2008	Initial calculation of hazard curves	0.5 Hz	G&P 2007	CVM-S	528	9	NCSA Mercury	442,400	800	7.5M		22 (glideins)	7.5M	90 GB	PDAX with 80 sub-DAXes, clustering, Condor glideins, zip files

Systems CyberShake has run on

1. USC cluster (early testing, Study 1.4, database codes)
2. NCSA Mercury (Study 0.5)
3. NCSA Abe (testing)
4. TACC Ranger (Study 1.0. 1.4)
5. NICS Kraken (Study 2.2)
6. NCSA Blue Waters (Study 13.4, Study 14.2, Study 15.4, Study 15.12, Study 17.3, Study 18.8)
7. TACC Stampede (Study 13.4)
8. OLCF Titan (Study 15.4, Study 17.3, Study 18.8)
9. NERSC Edison (testing)
10. NERSC Cori (testing)
11. BSC MareNostrum 4 (Iceland)
12. OLCF Summit (Study 21.12, Study 22.12)
13. TACC Frontera (testing)
14. OLCF Frontier (testing)