CyberShake Study 17.3 - Revision history

Scottcal: /* Rupture Variation Generator v5.2.3 (Graves & Pitarka 2015) */

2023-12-05T19:36:27Z

Rupture Variation Generator v5.2.3 (Graves & Pitarka 2015)

Scottcal: /* Application-level Metrics */

2022-02-02T18:21:50Z

Application-level Metrics

Scottcal: /* Application-level Metrics */

2018-05-12T04:17:01Z

Application-level Metrics

Scottcal: /* Performance Metrics */

2018-04-02T17:26:50Z

Performance Metrics

Scottcal: /* Lessons Learned */

2017-10-04T20:44:45Z

Lessons Learned

Scottcal: /* Performance Metrics */

2017-10-04T20:42:34Z

Performance Metrics

Scottcal: /* Study 17.3b */

2017-10-04T19:41:46Z

Study 17.3b

Scottcal: /* Study 17.3b */

2017-10-04T19:38:30Z

Study 17.3b

Scottcal: /* Study 17.3b */

2017-10-04T19:37:15Z

Study 17.3b

Scottcal at 19:26, 4 October 2017

2017-10-04T19:26:37Z

@@ Line 278: / Line 278: @@
 === Rupture Variation Generator v5.2.3 (Graves & Pitarka 2015) ===
-Plots related to verifying the rupture variation generator used in this study are available here:  [[Rupture Variation Generator v5.2.3 Verification]]
+Plots related to verifying the rupture variation generator intended for use in this study are available here:  [[Rupture Variation Generator v5.2.3 Verification]] .
 == Performance Enhancements (over Study 15.4) ==

@@ Line 489: / Line 489: @@
 ** 370 TB SGTs generated (216 GB per single SGT)
 ** 777 TB intermediate data generated (44 GB per velocity file, duplicate SGTs)
-** 10.7 TB output data
+** 10.7 TB output data (15,202,088 files)
 Delay per job (using a 7-day, no-restarts cutoff: 1618 workflows, 19143 jobs) was mean: 1836 sec, median: 467, min: 0, max: 91350, sd: 38209

@@ Line 484: / Line 484: @@
 * 1026 node-hrs per site (24,620 core-hrs)
 * On average, 12.1 jobs running, with a max of 41
-* Average of 1295 nodes used, with a maximum of 5374.
+* Average of 1295 nodes used, with a maximum of 5374 (101,472 cores).
 * Total data generated: ?

@@ Line 418: / Line 418: @@
 == Performance Metrics ==
-=== Starting Usage ===
+=== Usage ===
 Just before starting, we grabbed the current project usage for Blue Waters and Titan to get accurate measures of the SUs burned.
-==== Titan ====
+==== Starting usage, Titan ====
 Project usage = 4,313,662 SUs in 2017 (153,289 in March)
@@ Line 428: / Line 428: @@
 User callag used 1,089,050 SUs in 2017 (98,606 in March)
-==== Blue Waters ====
+==== Starting usage, Blue Waters ====
 'usage' command reports project PRAC_bahm used 11,571.4 node-hrs and ran 321 jobs.
@@ Line 434: / Line 434: @@
 'usage' command reports scottcal used 11,320.49 node-hrs on PRAC_bahm.
-=== Ending Usage ===
+==== Ending usage, Titan ====
 Project usage =  22,178,513 SUs in 2017 (12,586,176 in March, 5,431,964 in April)
@@ Line 442: / Line 440: @@
 User callag used 14,579,559 SUs in 2017 (10,128,109 in March, 3,461,006 in April)
-==== Blue Waters ====
+==== Ending usage, Blue Waters ====
 usage command reports 366773.73 node-hrs used by PRAC_bahm.
@@ Line 448: / Line 446: @@
 usage command reports 366504.84 node-hrs used by scottcal.
-=== Reservations ===
+==== Reservations ====
 reservations on Blue Waters (3 for 128 nodes, 1 for 124) began on 3/9/17 on 11:00:00 CST.  These reservations expired after a week.
@@ Line 456: / Line 454: @@
 Another set of reservations started at 2:27 CDT on 3/29/17, but were revoked around 16:30 CDT on 3/30/17.
-=== Events during Study ===
+==== Events during Study ====
 We requested and received a 5-day priority boost, 5 jobs running in bin 5, and 8 jobs eligible to run on Titan starting sometime in the morning of Sunday, March 12.  This greatly increased our throughput.

@@ Line 320: / Line 320: @@
 * Many jobs were not picked up by the reservation, and as a result reservation nodes were idle.  Work harder to make sure reservation is kept busy.
 * Forgot to turn on monitord during workflow, so had to deal with statistics after the workflow was done.  Since we're running far fewer jobs, it's fine to run monitord population during the workflow.
 == Codes ==

@@ Line 751: / Line 751: @@
                  Runtime: mean 1244.735645, median: 1061.000000, min: 210.000000, max: 34206.000000, sd: 1652.158490
                  Attempts: mean 1.085844, median: 1.000000, min: 1.000000, max: 22.000000, sd: 0.758517
 == Production Checklist ==

@@ Line 19: / Line 19: @@
 After the conclusion of Study 17.3, we had additional resources on Blue Waters, so we selected 58 additional sites to perform 1D and 3D calculations on.  A KML file with these sites is available [[:File:study_17_3b_sites.kml | with names]] or [[:File:study_17_3b_sites_no_names.kml | without names]].  The site locations are shown in green on the image below, along with the 438 Study 17.3 sites.
-[[File:Study_17_3b_sites.png|thumb|600px]]
+[[File:Study_17_3b_sites.png|thumb|600px|Additional 58 sites in Study 17.3b, shown with the original Study 17.3 sites]]
 == Science Goals ==

@@ Line 17: / Line 17: @@
 == Study 17.3b ==
-After the conclusion of Study 17.3, we had additional resources on Blue Waters, so we selected 58 additional sites to perform 1D and 3D calculations on.  A KML file with these sites is available [[File:study_17_3b_sites.kml | with names]] or [[File:study_17_3b_sites_no_names.kml | without names]].  The site locations are shown in green on the image below, along with the 438 Study 17.3 sites.
+After the conclusion of Study 17.3, we had additional resources on Blue Waters, so we selected 58 additional sites to perform 1D and 3D calculations on.  A KML file with these sites is available [[:File:study_17_3b_sites.kml | with names]] or [[:File:study_17_3b_sites_no_names.kml | without names]].  The site locations are shown in green on the image below, along with the 438 Study 17.3 sites.
-[[File:Study_17_3b_sites.png]]
+[[File:Study_17_3b_sites.png|thumb|600px]]
 == Science Goals ==

← Older revision		Revision as of 19:26, 4 October 2017
Line 14:		Line 14:

	Individual runs can be identified in the CyberShake database by searching for runs with Study_ID=8.		Individual runs can be identified in the CyberShake database by searching for runs with Study_ID=8.
		+
		+	== Study 17.3b ==
		+
		+	After the conclusion of Study 17.3, we had additional resources on Blue Waters, so we selected 58 additional sites to perform 1D and 3D calculations on. A KML file with these sites is available [[:File:study_17_3b_sites.kml \| with names]] or [[File:study_17_3b_sites_no_names.kml \| without names]]. The site locations are shown in green on the image below, along with the 438 Study 17.3 sites.
		+
		+	[[File:Study_17_3b_sites.png]]

	== Science Goals ==		== Science Goals ==