Difference between revisions of "Comparison of CyberShake Studies"
From SCECpedia
Jump to navigationJump to search| (19 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
{| border=1 | {| border=1 | ||
| − | ! Study Name !! Date !! Science Goals !! Frequency !! Rupture Variations !! Velocity Model(s) !! Makespan (hrs) !! Number of sites !! Machine !! Core Hours !! Max Processors !! Tasks !! Jobs !! Output files produced !! Output Data !! Comments | + | ! Study Name !! Date !! Science Goals !! Frequency !! Rupture Variations !! Velocity Model(s) !! Makespan (hrs) !! Number of sites !! Machine !! Core Hours !! Max Processors !! Tasks !! Jobs !! Output files produced !! Seismogram Pairs !! Output Data (time series, IMs) !! Comments |
|- | |- | ||
| − | | [[CyberShake Study | + | | [[CyberShake Study 22.12]] || December 17, 2022 - April 4, 2023 || Broadband Southern California CyberShake study || 1 Hz deterministic, 25 Hz stochastic || G&P 2022 || CVM-S4.26.M01 + merged taper || 1829.2 || 335 || OLCF Summit || 32.4M || 3364 nodes (141288 cores), 73% of Summit || ? || ? || 9.4M || 420M || 76 TB || Broadband, included merged taper, variability in rupture speed, change to hypocentral spacing |
|- | |- | ||
| − | | [[CyberShake Study | + | | [[CyberShake Study 21.12]] || December 15, 2021 - January 13, 2022 || RSQSim Southern California CyberShake study || 1 Hz || RSQSim || CVM-S4.26.M01 || 688.4 || 335 || OLCF Summit || 2.75M || 89376 (46% of Summit) || || || 102.9M || 25.7M || 1.9 TB || First RSQSim-based hazard map. |
|- | |- | ||
| − | | [[CyberShake Study | + | | [[CyberShake Study 18.8]] || August 17, 2018 - March 28, 2019 || Northern California CyberShake study || 1 Hz || G&P 2014 || CCA-06/USGS Bay Area/CVM-S4.26.M01 || 3079.3 || 869 || NCSA Blue Waters, OLCF Titan || 120M || 262,704 || 18225 || 18065 || 6.3M || 202.8M || 14.4 TB || First Northern California study, increased smoothing zone to 20 km. |
|- | |- | ||
| − | | [[CyberShake Study | + | | [[CyberShake Study 17.3]] || March 6, 2017 - April 6, 2017 || Central California CyberShake study with 1D and 3D velocity models || 1 Hz || G&P 2014 || CCA 1D, CCA-06 || 738 || 876 || NCSA Blue Waters, OLCF Titan || 21.6M || 101,472 || 15,581 || 15,581 || 15.2M || 284.8M || 10.7 TB || First Central California study, used CCA-06. Used minimum Vs of 900 m/s. |
|- | |- | ||
| − | | [[CyberShake Study 15.4]] || April 16 - May 24, 2015 || 1 Hz CyberShake map, with AWP-ODC-GPU, G&P 2014, CVM-S4.26, and new sites. Calculated RotD also. || 1 Hz || G&P 2014 || CVM-S4.26.M01 || 914 || 336 || NCSA Blue Waters, OLCF Titan (pilot jobs) || 37. | + | | [[CyberShake Study 15.12]] || December 3, 2015 - April 28, 2016 || Adding stochastic (to 10 Hz) to Study 15.4 and calculating duration values || 10 Hz stoch || G&P 2014 || CVM-S4.26.M01 || 3527 || 336 || NCSA Blue Waters || || || || || 11.8M || 159.8M || 30.5 TB || Applied site amplification to both deterministic and stochastic seismograms, using a modified approach to calculate Vref. |
| + | |- | ||
| + | | [[CyberShake Study 15.4]] || April 16 - May 24, 2015 || 1 Hz CyberShake map, with AWP-ODC-GPU, G&P 2014, CVM-S4.26, and new sites. Calculated RotD also. || 1 Hz || G&P 2014 || CVM-S4.26.M01 || 914 || 336 || NCSA Blue Waters, OLCF Titan (pilot jobs) || 37.6M || 237,984 || 5505 || 4372 || 7.1M || 159.8M || 7.7 TB || Used [[DirectSynth]] to reduce the number of post-processing tasks and cut I/O by 99.9%. | ||
|- | |- | ||
| − | | [[CyberShake Study 14.2]] || February 18 - March 4, 2014 || 4 hazard models: CVM-S4.26 with CPU, CVM-S4.26 with GPU, 1D model with CPU, and CVM-H, no GTL with GPU.|| 0.5 Hz || G&P 2010 || CVM-S4.26, BBP 1D, CVM-H no GTL || 342 || 1144 || NCSA Blue Waters || 15. | + | | [[CyberShake Study 14.2]] || February 18 - March 4, 2014 || 4 hazard models: CVM-S4.26 with CPU, CVM-S4.26 with GPU, 1D model with CPU, and CVM-H, no GTL with GPU.|| 0.5 Hz || G&P 2010 || CVM-S4.26, BBP 1D, CVM-H no GTL || 342 || 1144 || NCSA Blue Waters || 15.8M || 295,040 || 99.9M || 100707 (Condor), 29796 (submitted to Blue Waters) || 16M || 480.1M || 57 TB || Workflow job to generate AWP workflow to support dynamic number of cores, GPU and CPU executables, batched SeisPSA jobs |
|- | |- | ||
| − | | [[CyberShake Study 13.4]] || April 17 - June 17, 2013 || 4 hazard models: CVM-S and CVM-H with the RWG V3.0.3 SGT code and AWP-ODC-SGT.|| 0.5 Hz || G&P 2010 || CVM-S, CVM-H || 716 || 1132 || NCSA Blue Waters (custom solution), TACC Stampede (Pegasus/Condor/Globus) || 10. | + | | [[CyberShake Study 13.4]] || April 17 - June 17, 2013 || 4 hazard models: CVM-S and CVM-H with the RWG V3.0.3 SGT code and AWP-ODC-SGT.|| 0.5 Hz || G&P 2010 || CVM-S, CVM-H || 716 || 1132 || NCSA Blue Waters (custom solution), TACC Stampede (Pegasus/Condor/Globus) || 10.8M (Blue Waters); 1.4M (Stampede) || 128,000 (Blue Waters); 17,600 (Stampede) || 470M (Stampede) || 21912 submitted to Stampede || 2264 (Blue Waters); 16M (Stampede) || 480.1M || 43 TB (Blue Waters), 12.3 TB (Stampede) || Hierarchical DAXes with 8 sub-DAXes, PMC, pipe forwarding, Handoff jobs from Blue Waters to Stampede, merged SeisPSA jobs, in-memory rupture variation generation |
|- | |- | ||
| − | | [[CyberShake Study 2.2]] (post-processing only) || October 8, 2012 - March 6, 2013 (with a break from October 16 - November 8) || Redid post-processing of CyberShake 1.0 with G&P 2010. || 0.5 Hz || G&P 2010 || CVM-S || 2976 || 217 || NICS Kraken || || || || || || || PMC, pipe forwarding | + | | [[CyberShake Study 2.2]] (post-processing only) || October 8, 2012 - March 6, 2013 (with a break from October 16 - November 8) || Redid post-processing of CyberShake 1.0 with G&P 2010. || 0.5 Hz || G&P 2010 || CVM-S || 2976 || 217 || NICS Kraken || || || || || || || || PMC, pipe forwarding |
|- | |- | ||
| − | | [[CyberShake 1.4]] || August 25, 2011 - March 14, 2012 || Deterministic to 0.5 Hz + stochastic to 10 Hz, CVM-S4 and CVM-H 11.2 for PBR, SCSN, and near-SCSN sites, using G&P 2010 || 10 Hz stoch || G&P 2010 || CVM-S, CVM-H || 4824 || 90 || USC HPCC, TACC Ranger || || || | + | | [[CyberShake 1.4]] || August 25, 2011 - March 14, 2012 || Deterministic to 0.5 Hz + stochastic to 10 Hz, CVM-S4 and CVM-H 11.2 for PBR, SCSN, and near-SCSN sites, using G&P 2010 || 10 Hz stoch || G&P 2010 || CVM-S, CVM-H || 4824 || 90 || USC HPCC, TACC Ranger || || || 112M || || 112M || 40.0M || 4 TB || Broadband |
|- | |- | ||
| − | | [[CyberShake 1.0]] || April 16 - June 10, 2009 || 0.5 Hz hazard map in Southern California, CVM-S || 0.5 Hz || G&P 2007 || CVM-S || 1314 || 223 || TACC Ranger || 6,900,000 || 14,544 || | + | | [[CyberShake 1.0]] || April 16 - June 10, 2009 || 0.5 Hz hazard map in Southern California, CVM-S || 0.5 Hz || G&P 2007 || CVM-S || 1314 || 223 || TACC Ranger || 6,900,000 || 14,544 || 192M || 3.9M (Condor), 3952 (submitted to Ranger) || 190M || 98.9M || 10.6 TB || PDAX with 80 sub-DAXes, clustering, Condor glideins with Corral, zip files, Run Manager |
|- | |- | ||
| − | | CyberShake 0.5 (post-processing only) || June 26 - July 18, 2008 || Initial calculation of hazard curves || 0.5 Hz || G&P 2007 || CVM-S || 528 || 9 || NCSA Mercury || 442,400 || 800 || 7. | + | | CyberShake 0.5 (post-processing only) || June 26 - July 18, 2008 || Initial calculation of hazard curves || 0.5 Hz || G&P 2007 || CVM-S || 528 || 9 || NCSA Mercury || 442,400 || 800 || 7.5M || || 22 (glideins) || 7.5M || 90 GB || PDAX with 80 sub-DAXes, clustering, Condor glideins, zip files |
|} | |} | ||
| + | |||
| + | === Systems CyberShake has run on === | ||
| + | |||
| + | # USC cluster (early testing, Study 1.4, database codes) | ||
| + | # NCSA Mercury (Study 0.5) | ||
| + | # NCSA Abe (testing) | ||
| + | # TACC Ranger (Study 1.0. 1.4) | ||
| + | # NICS Kraken (Study 2.2) | ||
| + | # NCSA Blue Waters (Study 13.4, Study 14.2, Study 15.4, Study 15.12, Study 17.3, Study 18.8) | ||
| + | # TACC Stampede (Study 13.4) | ||
| + | # OLCF Titan (Study 15.4, Study 17.3, Study 18.8) | ||
| + | # NERSC Edison (testing) | ||
| + | # NERSC Cori (testing) | ||
| + | # BSC MareNostrum 4 (Iceland) | ||
| + | # OLCF Summit (Study 21.12, Study 22.12) | ||
| + | # TACC Frontera (testing) | ||
| + | # OLCF Frontier (testing) | ||
Latest revision as of 21:33, 2 May 2024
| Study Name | Date | Science Goals | Frequency | Rupture Variations | Velocity Model(s) | Makespan (hrs) | Number of sites | Machine | Core Hours | Max Processors | Tasks | Jobs | Output files produced | Seismogram Pairs | Output Data (time series, IMs) | Comments |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CyberShake Study 22.12 | December 17, 2022 - April 4, 2023 | Broadband Southern California CyberShake study | 1 Hz deterministic, 25 Hz stochastic | G&P 2022 | CVM-S4.26.M01 + merged taper | 1829.2 | 335 | OLCF Summit | 32.4M | 3364 nodes (141288 cores), 73% of Summit | ? | ? | 9.4M | 420M | 76 TB | Broadband, included merged taper, variability in rupture speed, change to hypocentral spacing |
| CyberShake Study 21.12 | December 15, 2021 - January 13, 2022 | RSQSim Southern California CyberShake study | 1 Hz | RSQSim | CVM-S4.26.M01 | 688.4 | 335 | OLCF Summit | 2.75M | 89376 (46% of Summit) | 102.9M | 25.7M | 1.9 TB | First RSQSim-based hazard map. | ||
| CyberShake Study 18.8 | August 17, 2018 - March 28, 2019 | Northern California CyberShake study | 1 Hz | G&P 2014 | CCA-06/USGS Bay Area/CVM-S4.26.M01 | 3079.3 | 869 | NCSA Blue Waters, OLCF Titan | 120M | 262,704 | 18225 | 18065 | 6.3M | 202.8M | 14.4 TB | First Northern California study, increased smoothing zone to 20 km. |
| CyberShake Study 17.3 | March 6, 2017 - April 6, 2017 | Central California CyberShake study with 1D and 3D velocity models | 1 Hz | G&P 2014 | CCA 1D, CCA-06 | 738 | 876 | NCSA Blue Waters, OLCF Titan | 21.6M | 101,472 | 15,581 | 15,581 | 15.2M | 284.8M | 10.7 TB | First Central California study, used CCA-06. Used minimum Vs of 900 m/s. |
| CyberShake Study 15.12 | December 3, 2015 - April 28, 2016 | Adding stochastic (to 10 Hz) to Study 15.4 and calculating duration values | 10 Hz stoch | G&P 2014 | CVM-S4.26.M01 | 3527 | 336 | NCSA Blue Waters | 11.8M | 159.8M | 30.5 TB | Applied site amplification to both deterministic and stochastic seismograms, using a modified approach to calculate Vref. | ||||
| CyberShake Study 15.4 | April 16 - May 24, 2015 | 1 Hz CyberShake map, with AWP-ODC-GPU, G&P 2014, CVM-S4.26, and new sites. Calculated RotD also. | 1 Hz | G&P 2014 | CVM-S4.26.M01 | 914 | 336 | NCSA Blue Waters, OLCF Titan (pilot jobs) | 37.6M | 237,984 | 5505 | 4372 | 7.1M | 159.8M | 7.7 TB | Used DirectSynth to reduce the number of post-processing tasks and cut I/O by 99.9%. |
| CyberShake Study 14.2 | February 18 - March 4, 2014 | 4 hazard models: CVM-S4.26 with CPU, CVM-S4.26 with GPU, 1D model with CPU, and CVM-H, no GTL with GPU. | 0.5 Hz | G&P 2010 | CVM-S4.26, BBP 1D, CVM-H no GTL | 342 | 1144 | NCSA Blue Waters | 15.8M | 295,040 | 99.9M | 100707 (Condor), 29796 (submitted to Blue Waters) | 16M | 480.1M | 57 TB | Workflow job to generate AWP workflow to support dynamic number of cores, GPU and CPU executables, batched SeisPSA jobs |
| CyberShake Study 13.4 | April 17 - June 17, 2013 | 4 hazard models: CVM-S and CVM-H with the RWG V3.0.3 SGT code and AWP-ODC-SGT. | 0.5 Hz | G&P 2010 | CVM-S, CVM-H | 716 | 1132 | NCSA Blue Waters (custom solution), TACC Stampede (Pegasus/Condor/Globus) | 10.8M (Blue Waters); 1.4M (Stampede) | 128,000 (Blue Waters); 17,600 (Stampede) | 470M (Stampede) | 21912 submitted to Stampede | 2264 (Blue Waters); 16M (Stampede) | 480.1M | 43 TB (Blue Waters), 12.3 TB (Stampede) | Hierarchical DAXes with 8 sub-DAXes, PMC, pipe forwarding, Handoff jobs from Blue Waters to Stampede, merged SeisPSA jobs, in-memory rupture variation generation |
| CyberShake Study 2.2 (post-processing only) | October 8, 2012 - March 6, 2013 (with a break from October 16 - November 8) | Redid post-processing of CyberShake 1.0 with G&P 2010. | 0.5 Hz | G&P 2010 | CVM-S | 2976 | 217 | NICS Kraken | PMC, pipe forwarding | |||||||
| CyberShake 1.4 | August 25, 2011 - March 14, 2012 | Deterministic to 0.5 Hz + stochastic to 10 Hz, CVM-S4 and CVM-H 11.2 for PBR, SCSN, and near-SCSN sites, using G&P 2010 | 10 Hz stoch | G&P 2010 | CVM-S, CVM-H | 4824 | 90 | USC HPCC, TACC Ranger | 112M | 112M | 40.0M | 4 TB | Broadband | |||
| CyberShake 1.0 | April 16 - June 10, 2009 | 0.5 Hz hazard map in Southern California, CVM-S | 0.5 Hz | G&P 2007 | CVM-S | 1314 | 223 | TACC Ranger | 6,900,000 | 14,544 | 192M | 3.9M (Condor), 3952 (submitted to Ranger) | 190M | 98.9M | 10.6 TB | PDAX with 80 sub-DAXes, clustering, Condor glideins with Corral, zip files, Run Manager |
| CyberShake 0.5 (post-processing only) | June 26 - July 18, 2008 | Initial calculation of hazard curves | 0.5 Hz | G&P 2007 | CVM-S | 528 | 9 | NCSA Mercury | 442,400 | 800 | 7.5M | 22 (glideins) | 7.5M | 90 GB | PDAX with 80 sub-DAXes, clustering, Condor glideins, zip files |
Systems CyberShake has run on
- USC cluster (early testing, Study 1.4, database codes)
- NCSA Mercury (Study 0.5)
- NCSA Abe (testing)
- TACC Ranger (Study 1.0. 1.4)
- NICS Kraken (Study 2.2)
- NCSA Blue Waters (Study 13.4, Study 14.2, Study 15.4, Study 15.12, Study 17.3, Study 18.8)
- TACC Stampede (Study 13.4)
- OLCF Titan (Study 15.4, Study 17.3, Study 18.8)
- NERSC Edison (testing)
- NERSC Cori (testing)
- BSC MareNostrum 4 (Iceland)
- OLCF Summit (Study 21.12, Study 22.12)
- TACC Frontera (testing)
- OLCF Frontier (testing)
