Difference between revisions of "Comparison of CyberShake Studies"

From SCECpedia
Jump to navigationJump to search
 
(39 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
{| border=1
 
{| border=1
−
! Study Name !! Date !! Science Goals !! Makespan (hrs) !! Number of sites !! Machine !! Core Hours !! Max Processors !! Tasks !! Jobs !! Files produced !! Data !! Comments
+
! Study Name !! Date !! Science Goals !! Frequency !! Rupture Variations !! Velocity Model(s) !! Makespan (hrs) !! Number of sites !! Machine !! Core Hours !! Max Processors !! Tasks !! Jobs !! Output files produced !! Seismogram Pairs !! Output Data (time series, IMs) !! Comments
 
|-
 
|-
−
| CyberShake 0.5 (post-processing only) || June 26 - July 18, 2008 || || 528 || 9 || NCSA Mercury || 442,400 || 800 || 7.5 million || 22 (glideins) || 7.5 million || 90 GB || PDAX with 80 sub-DAXes, clustering, Condor glideins, zip files
+
| [[CyberShake Study 22.12]] || December 17, 2022 - April 4, 2023 || Broadband Southern California CyberShake study || 1 Hz deterministic, 25 Hz stochastic || G&P 2022 || CVM-S4.26.M01 + merged taper || 1829.2 || 335 || OLCF Summit || 32.4M || 3364 nodes (141288 cores), 73% of Summit || ? || ? || 9.4M || 420M || 76 TB || Broadband, included merged taper, variability in rupture speed, change to hypocentral spacing
 +
|-
 +
| [[CyberShake Study 21.12]] || December 15, 2021 - January 13, 2022 || RSQSim Southern California CyberShake study || 1 Hz || RSQSim || CVM-S4.26.M01 || 688.4 || 335 || OLCF Summit || 2.75M || 89376 (46% of Summit) || || || 102.9M || 25.7M || 1.9 TB || First RSQSim-based hazard map.
 +
|-
 +
| [[CyberShake Study 18.8]] || August 17, 2018 - March 28, 2019 || Northern California CyberShake study || 1 Hz || G&P 2014 || CCA-06/USGS Bay Area/CVM-S4.26.M01 || 3079.3 || 869 || NCSA Blue Waters, OLCF Titan || 120M || 262,704 || 18225 || 18065 || 6.3M || 202.8M || 14.4 TB || First Northern California study, increased smoothing zone to 20 km.
 +
|-
 +
| [[CyberShake Study 17.3]] || March 6, 2017 - April 6, 2017 || Central California CyberShake study with 1D and 3D velocity models || 1 Hz || G&P 2014 || CCA 1D, CCA-06 || 738 || 876 || NCSA Blue Waters, OLCF Titan || 21.6M || 101,472 || 15,581 || 15,581 || 15.2M || 284.8M || 10.7 TB || First Central California study, used CCA-06.  Used minimum Vs of 900 m/s.
 +
|-
 +
| [[CyberShake Study 15.12]] || December 3, 2015 - April 28, 2016 || Adding stochastic (to 10 Hz) to Study 15.4 and calculating duration values || 10 Hz stoch || G&P 2014 || CVM-S4.26.M01 || 3527 || 336 || NCSA Blue Waters ||  ||  ||  ||  || 11.8M || 159.8M || 30.5 TB || Applied site amplification to both deterministic and stochastic seismograms, using a modified approach to calculate Vref.
 +
|-
 +
| [[CyberShake Study 15.4]] || April 16 - May 24, 2015 || 1 Hz CyberShake map, with AWP-ODC-GPU, G&P 2014, CVM-S4.26, and new sites. Calculated RotD also. || 1 Hz || G&P 2014 || CVM-S4.26.M01 || 914 || 336 || NCSA Blue Waters, OLCF Titan (pilot jobs) || 37.6M || 237,984 || 5505 || 4372 || 7.1M || 159.8M || 7.7 TB || Used [[DirectSynth]] to reduce the number of post-processing tasks and cut I/O by 99.9%.
 
|-  
 
|-  
−
| CyberShake 1.0 || April 16 - June 10, 2009 || || 1314 || 223 || TACC Ranger || 6,900,000 || 14,544 || 192 million || 3.9 million (Condor), 3952 (submitted to Ranger) || 190 million || 10.6 TB || PDAX with 80 sub-DAXes, clustering, Condor glideins with Corral, zip files, Run Manager
+
| [[CyberShake Study 14.2]] || February 18 - March 4, 2014 || 4 hazard models: CVM-S4.26 with CPU, CVM-S4.26 with GPU, 1D model with CPU, and CVM-H, no GTL with GPU.|| 0.5 Hz || G&P 2010 || CVM-S4.26, BBP 1D, CVM-H no GTL || 342 || 1144 || NCSA Blue Waters || 15.8M || 295,040 || 99.9M || 100707 (Condor), 29796 (submitted to Blue Waters) || 16M || 480.1M || 57 TB || Workflow job to generate AWP workflow to support dynamic number of cores, GPU and CPU executables, batched SeisPSA jobs
−
|-
 
−
| CyberShake 1.4 || August 25, 2011 - March 14, 2012 || || 4824 || 90 || USC HPCC, TACC Ranger || || || 112 million || || 112 million || 4 TB || Broadband
 
 
|-
 
|-
−
| CyberShake 2.2 (post-processing only) || October 8, 2012 - March 6, 2013 (with a break from October 16 - November 8) || || 2976 || 217 || NICS Kraken || || || || || || || PMC, pipe forwarding
+
| [[CyberShake Study 13.4]] || April 17 - June 17, 2013 || 4 hazard models: CVM-S and CVM-H with the RWG V3.0.3 SGT code and AWP-ODC-SGT.|| 0.5 Hz || G&P 2010 || CVM-S, CVM-H || 716 || 1132 || NCSA Blue Waters (custom solution), TACC Stampede (Pegasus/Condor/Globus) || 10.8M (Blue Waters); 1.4M (Stampede) || 128,000 (Blue Waters); 17,600 (Stampede) || 470M (Stampede) || 21912 submitted to Stampede || 2264 (Blue Waters); 16M (Stampede) || 480.1M || 43 TB (Blue Waters), 12.3 TB (Stampede) || Hierarchical DAXes with 8 sub-DAXes, PMC, pipe forwarding, Handoff jobs from Blue Waters to Stampede, merged SeisPSA jobs, in-memory rupture variation generation
 
|-
 
|-
−
| CyberShake 13.4 || April 17 - June 17, 2013 || || 716 || 1132 || NCSA Blue Waters (custom solution), TACC Stampede (Pegasus/Condor/Globus) || 10.8 million (Blue Waters); 1.4 million (Stampede) || 128,000 (Blue Waters); 17,600 (Stampede) || 470 million (Stampede) || 21912 submitted to Stampede || 2264 (Blue Waters); 16 million (Stampede) || 43 TB (Blue Waters), 12.3 TB (Stampede) || Hierarchical DAXes with 8 sub-DAXes, PMC, pipe forwarding, Handoff jobs from Blue Waters to Stampede, merged SeisPSA jobs, in-memory rupture variation generation
+
| [[CyberShake Study 2.2]] (post-processing only) || October 8, 2012 - March 6, 2013 (with a break from October 16 - November 8) || Redid post-processing of CyberShake 1.0 with G&P 2010. || 0.5 Hz || G&P 2010 || CVM-S || 2976 || 217 || NICS Kraken || || || || || || || || PMC, pipe forwarding
 
|-
 
|-
−
| CyberShake 14.2 || February 18 - March 4, 2014 || 4 hazard models: CVM-S4.26 with CPU, CVM-S4.26 with GPU, 1D model with CPU, and CVM-H, no GTL with GPU. G&P 2010. || 342 || 1144 || NCSA Blue Waters || 15.8 million || 295,040 || 99.9 million || 100707 (Condor), 29796 (submitted to Blue Waters) || 16 million || 57 TB || Workflow job to generate AWP workflow to support dynamic number of cores, GPU and CPU executables, batched SeisPSA jobs
+
| [[CyberShake 1.4]] || August 25, 2011 - March 14, 2012 || Deterministic to 0.5 Hz + stochastic to 10 Hz, CVM-S4 and CVM-H 11.2 for PBR, SCSN, and near-SCSN sites, using G&P 2010 || 10 Hz stoch || G&P 2010 || CVM-S, CVM-H || 4824 || 90 || USC HPCC, TACC Ranger || || || 112M || || 112M || 40.0M || 4 TB || Broadband
 
|-
 
|-
−
| CyberShake 15.4 || April 16 - May 24, 2015 || 1 Hz CyberShake map, with AWP-ODC-GPU, G&P 2014, CVM-S4.26, and new sites. Calculated RotD also. || 194 || 336 || NCSA Blue Waters, OLCF Titan || 37.6 million || 237,984 || 5505 || 4372 || 7.1 million || 7.7 TB || Used [[DirectSynth]] to reduce the number of post-processing tasks and cut I/O by 99.9%.
+
| [[CyberShake 1.0]] || April 16 - June 10, 2009 || 0.5 Hz hazard map in Southern California, CVM-S || 0.5 Hz || G&P 2007 || CVM-S || 1314 || 223 || TACC Ranger || 6,900,000 || 14,544 || 192M || 3.9M (Condor), 3952 (submitted to Ranger) || 190M || 98.9M || 10.6 TB || PDAX with 80 sub-DAXes, clustering, Condor glideins with Corral, zip files, Run Manager
 
|-
 
|-
−
| CyberShake 15.12 || December 3, 2015 - ???
+
| CyberShake 0.5 (post-processing only) || June 26 - July 18, 2008 || Initial calculation of hazard curves || 0.5 Hz || G&P 2007 || CVM-S || 528 || 9 || NCSA Mercury || 442,400 || 800 || 7.5M || || 22 (glideins) || 7.5M || 90 GB || PDAX with 80 sub-DAXes, clustering, Condor glideins, zip files
 
|}
 
|}
 +
 +
=== Systems CyberShake has run on ===
 +
 +
# USC cluster (early testing, Study 1.4, database codes)
 +
# NCSA Mercury (Study 0.5)
 +
# NCSA Abe (testing)
 +
# TACC Ranger (Study 1.0. 1.4)
 +
# NICS Kraken (Study 2.2)
 +
# NCSA Blue Waters (Study 13.4, Study 14.2, Study 15.4, Study 15.12, Study 17.3, Study 18.8)
 +
# TACC Stampede (Study 13.4)
 +
# OLCF Titan (Study 15.4, Study 17.3, Study 18.8)
 +
# NERSC Edison (testing)
 +
# NERSC Cori (testing)
 +
# BSC MareNostrum 4 (Iceland)
 +
# OLCF Summit (Study 21.12, Study 22.12)
 +
# TACC Frontera (testing)
 +
# OLCF Frontier (testing)

Latest revision as of 21:33, 2 May 2024

Study Name Date Science Goals Frequency Rupture Variations Velocity Model(s) Makespan (hrs) Number of sites Machine Core Hours Max Processors Tasks Jobs Output files produced Seismogram Pairs Output Data (time series, IMs) Comments
CyberShake Study 22.12 December 17, 2022 - April 4, 2023 Broadband Southern California CyberShake study 1 Hz deterministic, 25 Hz stochastic G&P 2022 CVM-S4.26.M01 + merged taper 1829.2 335 OLCF Summit 32.4M 3364 nodes (141288 cores), 73% of Summit ? ? 9.4M 420M 76 TB Broadband, included merged taper, variability in rupture speed, change to hypocentral spacing
CyberShake Study 21.12 December 15, 2021 - January 13, 2022 RSQSim Southern California CyberShake study 1 Hz RSQSim CVM-S4.26.M01 688.4 335 OLCF Summit 2.75M 89376 (46% of Summit) 102.9M 25.7M 1.9 TB First RSQSim-based hazard map.
CyberShake Study 18.8 August 17, 2018 - March 28, 2019 Northern California CyberShake study 1 Hz G&P 2014 CCA-06/USGS Bay Area/CVM-S4.26.M01 3079.3 869 NCSA Blue Waters, OLCF Titan 120M 262,704 18225 18065 6.3M 202.8M 14.4 TB First Northern California study, increased smoothing zone to 20 km.
CyberShake Study 17.3 March 6, 2017 - April 6, 2017 Central California CyberShake study with 1D and 3D velocity models 1 Hz G&P 2014 CCA 1D, CCA-06 738 876 NCSA Blue Waters, OLCF Titan 21.6M 101,472 15,581 15,581 15.2M 284.8M 10.7 TB First Central California study, used CCA-06. Used minimum Vs of 900 m/s.
CyberShake Study 15.12 December 3, 2015 - April 28, 2016 Adding stochastic (to 10 Hz) to Study 15.4 and calculating duration values 10 Hz stoch G&P 2014 CVM-S4.26.M01 3527 336 NCSA Blue Waters 11.8M 159.8M 30.5 TB Applied site amplification to both deterministic and stochastic seismograms, using a modified approach to calculate Vref.
CyberShake Study 15.4 April 16 - May 24, 2015 1 Hz CyberShake map, with AWP-ODC-GPU, G&P 2014, CVM-S4.26, and new sites. Calculated RotD also. 1 Hz G&P 2014 CVM-S4.26.M01 914 336 NCSA Blue Waters, OLCF Titan (pilot jobs) 37.6M 237,984 5505 4372 7.1M 159.8M 7.7 TB Used DirectSynth to reduce the number of post-processing tasks and cut I/O by 99.9%.
CyberShake Study 14.2 February 18 - March 4, 2014 4 hazard models: CVM-S4.26 with CPU, CVM-S4.26 with GPU, 1D model with CPU, and CVM-H, no GTL with GPU. 0.5 Hz G&P 2010 CVM-S4.26, BBP 1D, CVM-H no GTL 342 1144 NCSA Blue Waters 15.8M 295,040 99.9M 100707 (Condor), 29796 (submitted to Blue Waters) 16M 480.1M 57 TB Workflow job to generate AWP workflow to support dynamic number of cores, GPU and CPU executables, batched SeisPSA jobs
CyberShake Study 13.4 April 17 - June 17, 2013 4 hazard models: CVM-S and CVM-H with the RWG V3.0.3 SGT code and AWP-ODC-SGT. 0.5 Hz G&P 2010 CVM-S, CVM-H 716 1132 NCSA Blue Waters (custom solution), TACC Stampede (Pegasus/Condor/Globus) 10.8M (Blue Waters); 1.4M (Stampede) 128,000 (Blue Waters); 17,600 (Stampede) 470M (Stampede) 21912 submitted to Stampede 2264 (Blue Waters); 16M (Stampede) 480.1M 43 TB (Blue Waters), 12.3 TB (Stampede) Hierarchical DAXes with 8 sub-DAXes, PMC, pipe forwarding, Handoff jobs from Blue Waters to Stampede, merged SeisPSA jobs, in-memory rupture variation generation
CyberShake Study 2.2 (post-processing only) October 8, 2012 - March 6, 2013 (with a break from October 16 - November 8) Redid post-processing of CyberShake 1.0 with G&P 2010. 0.5 Hz G&P 2010 CVM-S 2976 217 NICS Kraken PMC, pipe forwarding
CyberShake 1.4 August 25, 2011 - March 14, 2012 Deterministic to 0.5 Hz + stochastic to 10 Hz, CVM-S4 and CVM-H 11.2 for PBR, SCSN, and near-SCSN sites, using G&P 2010 10 Hz stoch G&P 2010 CVM-S, CVM-H 4824 90 USC HPCC, TACC Ranger 112M 112M 40.0M 4 TB Broadband
CyberShake 1.0 April 16 - June 10, 2009 0.5 Hz hazard map in Southern California, CVM-S 0.5 Hz G&P 2007 CVM-S 1314 223 TACC Ranger 6,900,000 14,544 192M 3.9M (Condor), 3952 (submitted to Ranger) 190M 98.9M 10.6 TB PDAX with 80 sub-DAXes, clustering, Condor glideins with Corral, zip files, Run Manager
CyberShake 0.5 (post-processing only) June 26 - July 18, 2008 Initial calculation of hazard curves 0.5 Hz G&P 2007 CVM-S 528 9 NCSA Mercury 442,400 800 7.5M 22 (glideins) 7.5M 90 GB PDAX with 80 sub-DAXes, clustering, Condor glideins, zip files

Systems CyberShake has run on

  1. USC cluster (early testing, Study 1.4, database codes)
  2. NCSA Mercury (Study 0.5)
  3. NCSA Abe (testing)
  4. TACC Ranger (Study 1.0. 1.4)
  5. NICS Kraken (Study 2.2)
  6. NCSA Blue Waters (Study 13.4, Study 14.2, Study 15.4, Study 15.12, Study 17.3, Study 18.8)
  7. TACC Stampede (Study 13.4)
  8. OLCF Titan (Study 15.4, Study 17.3, Study 18.8)
  9. NERSC Edison (testing)
  10. NERSC Cori (testing)
  11. BSC MareNostrum 4 (Iceland)
  12. OLCF Summit (Study 21.12, Study 22.12)
  13. TACC Frontera (testing)
  14. OLCF Frontier (testing)
Retrieved from "https://strike.scec.org/scecwiki/index.php?title=Comparison_of_CyberShake_Studies&oldid=28591"