CyberShake Study 18.8 - Revision history

Scottcal: /* Performance Metrics */

2022-01-26T06:48:01Z

Performance Metrics

Scottcal: /* Performance Metrics */

2022-01-26T06:32:51Z

Performance Metrics

@@ Line 614: / Line 614: @@
 | || 20 || || 6 || || 68 || || 164 || || 201 || || 677 || || 253 || || 170 || || 69 || || 142 || || 204 || || 166 || || 49 || || 0 || || 0 || || 0
 |}
 == Production Checklist ==

Scottcal: /* Performance Metrics */

2022-01-26T06:13:32Z

Performance Metrics

← Older revision		Revision as of 06:13, 26 January 2022
Line 548:		Line 548:
	* 21,220 local jobs submitted		* 21,220 local jobs submitted
	* 6212844.1 node-hrs used (119,630,290 core-hrs)		* 6212844.1 node-hrs used (119,630,290 core-hrs)
	* ? node-hrs per site (? core-hrs)		* 7149 node-hrs per site (137,664 core-hrs)
	* On average, 5 jobs running, with a max of 48		* On average, 5 jobs running, with a max of 48
	* Average of 1879 nodes used, with a maximum of 16,219 [1480 BW, 14,739 Titan (79%)] (279,984 cores).		* Average of 1879 nodes used, with a maximum of 16,219 [1480 BW, 14,739 Titan (79%)] (279,984 cores).
Line 557:		Line 557:
	** 14.98 TB output data (8,684,106 files)		** 14.98 TB output data (8,684,106 files)

	Delay per job (using a ?-day, no-restarts cutoff: ? workflows, ? jobs) was mean: ? sec, median: ?, min: ?, max: ?, sd: ?		Delay per job (using a 14-day, no-restarts cutoff: 999 workflows, 9697 jobs) was mean: 10776 sec, median: 271, min: 0, max: 744494, sd: 37410

	{\| border=1		{\| border=1
Line 564:		Line 564:
	\|-		\|-
	! Jobs per bin		! Jobs per bin
	\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ? \|\| \|\| ?		\| \|\| 2400 \|\| \|\| 875 \|\| \|\| 595 \|\| \|\| 610 \|\| \|\| 677 \|\| \|\| 1833 \|\| \|\| 294 \|\| \|\| 188 \|\| \|\| 180 \|\| \|\| 288 \|\| \|\| 326 \|\| \|\| 667 \|\| \|\| 445 \|\| \|\| 234 \|\| \|\| 43 \|\| \|\| 36
	\|}		\|}

	* Application parallel node speedup (node-hours divided by makespan) was ?x. (Divided by uptime: ?x)		* Application parallel node speedup (node-hours divided by makespan) was 2018x. (Divided by uptime: ?x)
	* Application parallel workflow speedup (number of workflows times average workflow makespan divided by application makespan) was ?x. (Divided by uptime: ?x)		* Application parallel workflow speedup (number of workflows times average workflow makespan divided by application makespan) was ?x. (Divided by uptime: ?x)

Scottcal: /* Application-level Metrics */

2020-12-02T17:06:39Z

Application-level Metrics

← Older revision		Revision as of 17:06, 2 December 2020
Line 555:		Line 555:
	** ? TB SGTs generated (? GB per single SGT)		** ? TB SGTs generated (? GB per single SGT)
	** ? TB intermediate data generated (? GB per velocity file, duplicate SGTs)		** ? TB intermediate data generated (? GB per velocity file, duplicate SGTs)
	** ? TB output data		** 14.98 TB output data (8,684,106 files)

	Delay per job (using a ?-day, no-restarts cutoff: ? workflows, ? jobs) was mean: ? sec, median: ?, min: ?, max: ?, sd: ?		Delay per job (using a ?-day, no-restarts cutoff: ? workflows, ? jobs) was mean: ? sec, median: ?, min: ?, max: ?, sd: ?

Scottcal: /* Data Products */

2020-09-01T17:11:05Z

Data Products

← Older revision		Revision as of 17:11, 1 September 2020
Line 13:		Line 13:
	== Data Products ==		== Data Products ==

	Hazard maps from this study are available [~~https~~://~~github~~.~~com~~/~~kevinmilner~~/cybershake-analysis~~/tree/master~~/study_18_8/hazard_maps here].		Hazard maps from this study are available [http://opensha.usc.edu/ftp/kmilner/markdown/cybershake-analysis/study_18_8/hazard_maps here].

	Statewide maps are available [http://opensha.usc.edu/ftp/kmilner/cybershake/study_18.8/statewide_maps/ here].		Statewide maps are available [http://opensha.usc.edu/ftp/kmilner/cybershake/study_18.8/statewide_maps/ here].

Scottcal: /* Application-level Metrics */

2020-03-10T20:54:54Z

Application-level Metrics

@@ Line 534: / Line 534: @@
 * 202,820,113 seismogram pairs generated
 * 30,423,016,950 intensity measures generated (150 per seismogram pair)
 * 18,065 remote jobs submitted (7757 on Titan, 10,308 on Blue Waters)

Scottcal: /* Velocity Models */

2020-01-17T20:12:44Z

Velocity Models

← Older revision		Revision as of 20:12, 17 January 2020
Line 64:		Line 64:
	== Velocity Models ==		== Velocity Models ==

	For Study 18.5, we ~~have~~ decided to construct the velocity mesh by querying models in the following order:		For Study 18.5, we initially decided to construct the velocity mesh by querying models in the following order (but changed the order later, for production):

	# USGS Bay Area model		# USGS Bay Area model

Scottcal: /* SGT time length */

2019-11-17T18:07:49Z

SGT time length

← Older revision		Revision as of 18:07, 17 November 2019
Line 260:		Line 260:
	Below are SGT plots for s945. These SGTs are from the southwest and southeast bottom corner of the region, so as far as you can get from this site. It looks like 200 sec isn't long enough for these distant points.		Below are SGT plots for s945. These SGTs are from the southwest and southeast bottom corner of the region, so as far as you can get from this site. It looks like 200 sec isn't long enough for these distant points.

	Based on this, we will increase the SGT simulation time to 300 sec ~~for all~~ , and the seismogram duration from 400 to 500 sec.		Based on this, we will increase the SGT simulation time to 300 sec if any hypocenters are more than 450 km away from the site, and increase the seismogram duration from 400 to 500 sec.

	{\|		{\|

Scottcal: /* Application-level Metrics */

2019-10-31T19:06:02Z

Application-level Metrics

← Older revision		Revision as of 19:06, 31 October 2019
Line 535:		Line 535:
	* 30,423,016,950 intensity measures generated (150 per seismogram pair)		* 30,423,016,950 intensity measures generated (150 per seismogram pair)

	* ? jobs submitted		* 18,065 remote jobs submitted (7757 on Titan, 10,308 on Blue Waters)
			* 21,220 local jobs submitted
	* 6212844.1 node-hrs used (119,630,290 core-hrs)		* 6212844.1 node-hrs used (119,630,290 core-hrs)
	* ? node-hrs per site (? core-hrs)		* ? node-hrs per site (? core-hrs)
	* On average, ? jobs running, with a max of ?		* On average, 5 jobs running, with a max of 48
	* Average of ? nodes used, with a maximum of ? (? cores).		* Average of 1879 nodes used, with a maximum of 16,219 [1480 BW, 14,739 Titan (79%)] (279,984 cores).

	* Total data generated: ?		* Total data generated: ?

Scottcal: /* Application-level Metrics */

2019-08-15T03:17:48Z

Application-level Metrics

← Older revision		Revision as of 03:17, 15 August 2019
Line 530:		Line 530:
	\|}		\|}

			* 8,091 UCERF2 ruptures considered
			* 523,490 rupture variations considered
	* 202,820,113 seismogram pairs generated		* 202,820,113 seismogram pairs generated
	* 30,423,016,950 intensity measures generated (150 per seismogram pair)		* 30,423,016,950 intensity measures generated (150 per seismogram pair)