CyberShake Computational Estimates - Revision history

Scottcal at 15:52, 20 June 2014

2014-06-20T15:52:38Z

← Older revision		Revision as of 15:52, 20 June 2014
Line 4:		Line 4:

	The 0.5 Hz numbers are taken from Study 14.2.		The 0.5 Hz numbers are taken from Study 14.2.

			The node-hours are estimates based on the XE6 and XK7 nodes on Blue Waters.

	== 1.0 Hz, 3 component ==		== 1.0 Hz, 3 component ==

Scottcal at 20:56, 18 June 2014

2014-06-18T20:56:59Z

← Older revision		Revision as of 20:56, 18 June 2014
Line 10:		Line 10:
	(38 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) x (20% more efficient due to more work per GPU) = 1460 node-hrs per site.		(38 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) x (20% more efficient due to more work per GPU) = 1460 node-hrs per site.

	23% of node hours to SGTs.		23% of node hours to calculate SGTs.

	PP: At 0.5 Hz, it requires 41 CPU node-hrs per component.		PP: At 0.5 Hz, it requires 41 CPU node-hrs per component.
	(41 CPU node-hrs per components) x (3 components) x (25 times the rupture points) x (2 times the timesteps) x (20% more efficient due to rupture generator improvements) = 4920 node-hrs per site.		(41 CPU node-hrs per components) x (3 components) x (25 times the rupture points) x (2 times the timesteps) x (20% more efficient due to rupture generator improvements) = 4920 node-hrs per site.

	77% of node hours to PP.		77% of node hours to calculate PP.

			Each site requires about 550,000 rupture variations (410,000 x 4/3 for rupture variations v3.3)

	'''6380''' node-hours per 3-component site (181k core-hours)		'''6380''' node-hours per 3-component site (181k core-hours)

Scottcal at 19:54, 13 May 2014

2014-05-13T19:54:09Z

← Older revision		Revision as of 19:54, 13 May 2014
Line 3:		Line 3:
	The UCERF 3 estimates assume that the number of ruptures increases from 15,000 to 350,000, but the number of rupture variations per rupture on average remains the same.		The UCERF 3 estimates assume that the number of ruptures increases from 15,000 to 350,000, but the number of rupture variations per rupture on average remains the same.

	~~== 1~~.0 Hz ==		The 0.5 Hz numbers are taken from Study 14.2.

	~~SGTs: At~~ 0.5 Hz, ~~it requires 35 GPU node-hrs per~~ component.		== 1.0 Hz, 3 component ==
	~~(35 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) x (20% more efficient due to more work per GPU)~~ = ~~1350 node-hrs per site.~~

	PP: At 0.5 Hz, it requires ~~30 CPU~~ node-hrs per component.		SGTs: At 0.5 Hz, it requires 38 GPU node-hrs per component.
	(~~30 CPU~~ node-hrs per ~~components~~) x (3 components) x (25 times the ~~rupture points~~) x (2 times the timesteps) = ~~4500~~ node-hrs per site.		(38 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) x (20% more efficient due to more work per GPU) = 1460 node-hrs per site.

	~~'''5850'''~~ node-hours ~~per 3-component site (187k core-hours)~~		23% of node hours to SGTs.

	~~'''1~~.~~67M'''~~ node-~~hours for standard~~ 3-~~component So Cal 286-~~site ~~map (53~~.~~5M core-hours)~~		PP: At 0.5 Hz, it requires 41 CPU node-hrs per component.
			(41 CPU node-hrs per components) x (3 components) x (25 times the rupture points) x (2 times the timesteps) x (20% more efficient due to rupture generator improvements) = 4920 node-hrs per site.

	~~'''5.25M'''~~ node-hours ~~for increased density 3-component So Cal 898-site map (168M core-hours)~~		77% of node hours to PP.

	'''8.~~18M~~''' node-hours for statewide adaptive 3-component California 1400-site map (~~262M~~ core-hours)		'''6380''' node-hours per 3-component site (181k core-hours)

			'''1.82M''' node-hours for standard 3-component So Cal 286-site map (51.7M core-hours)

			'''5.73M''' node-hours for increased density 3-component So Cal 898-site map (162M core-hours)

			'''8.93M''' node-hours for statewide adaptive 3-component California 1400-site map (253M core-hours)

	== 2.0 Hz ==		== 2.0 Hz ==

	SGTs: At 1.0 Hz, it requires ~~450~~ GPU node-hrs per component.		SGTs: At 1.0 Hz, it requires 485 GPU node-hrs per component.
	(~~450~~ GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) = ~~22k~~ node-hrs per site.		(485 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) = 23.3k node-hrs per site.

	PP: At 1.0 Hz, it requires ~~1500~~ CPU node-hrs per component.		PP: At 1.0 Hz, it requires 1640 CPU node-hrs per component.
	(~~1500~~ CPU node-hrs per components) x (3 components) x (2 times the timesteps) = 9k node-hrs per site.		(1640 CPU node-hrs per components) x (3 components) x (2 times the timesteps) = 9.8k node-hrs per site.

	'''~~31k~~''' node-hours per 3-component site (~~976k~~ core-hours)		'''33.1k''' node-hours per 3-component site (686k core-hours)

	'''8.~~72M~~''' node-hours for standard 3-component So Cal 286-site map (~~279M~~ core-hours)		'''9.47M''' node-hours for standard 3-component So Cal 286-site map (196M core-hours)

	'''~~108M~~''' node-hours for increased density 3-component So Cal 3545-site map (3.5B core-hours)		'''117M''' node-hours for increased density 3-component So Cal 3545-site map (2.4B core-hours)

	'''~~35M~~''' node-hours for statewide adaptive 3-component California 1400-site map (~~1.1B~~ core-hours)		'''46.3M''' node-hours for statewide adaptive 3-component California 1400-site map (960M core-hours)

Scottcal at 21:48, 5 March 2014

2014-03-05T21:48:57Z

Scottcal: /* 1.0 Hz */

2014-03-05T21:46:19Z

1.0 Hz

← Older revision		Revision as of 21:46, 5 March 2014
Line 6:		Line 6:

	SGTs: At 0.5 Hz, it requires 35 GPU node-hrs per component.		SGTs: At 0.5 Hz, it requires 35 GPU node-hrs per component.
	(35 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) = ~~1680~~ node-hrs per site.		(35 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) x (20% more efficient due to more work per GPU) = 1340 node-hrs per site.

	PP: At 0.5 Hz, it requires 30 CPU node-hrs per component.		PP: At 0.5 Hz, it requires 30 CPU node-hrs per component.
	(30 CPU node-hrs per components) x (3 components) x (25 times the rupture points) x (2 times the timesteps) = 4500 node-hrs per site.		(30 CPU node-hrs per components) x (3 components) x (25 times the rupture points) x (2 times the timesteps) = 4500 node-hrs per site.

	'''~~6180~~''' node-hours per 3-component site (~~200k~~ core-hours)		'''5840''' node-hours per 3-component site (187k core-hours)

	'''1.~~77M~~''' node-hours for standard 3-component So Cal 286-site map (56.6M core-hours)		'''1.67M''' node-hours for standard 3-component So Cal 286-site map (53.5M core-hours)

	'''5.~~55M~~''' node-hours for increased density 3-component So Cal 898-site map (~~178M~~ core-hours)		'''5.25M''' node-hours for increased density 3-component So Cal 898-site map (168M core-hours)

	'''8.~~65M~~''' node-hours for statewide adaptive 3-component California 1400-site map (~~277M~~ core-hours)		'''8.18M''' node-hours for statewide adaptive 3-component California 1400-site map (262M core-hours)

	== 2.0 Hz ==		== 2.0 Hz ==

Scottcal at 20:26, 5 March 2014

2014-03-05T20:26:30Z

@@ Line 3: / Line 3: @@
 The UCERF 3 estimates assume that the number of ruptures increases from 15,000 to 350,000, but the number of rupture variations per rupture on average remains the same.
-== Future SCEC data needs ==
+== 1.0 Hz ==
-These are estimates of CyberShake storage required on SCEC computers for upcoming runs.
+SGTs: At 0.5 Hz, it requires 35 GPU node-hrs per component.
-July-August 2013:  6.1 TB to archive (0.5 Hz, CVM-SI, 2 SGT versions, 286 sites, UCERF 2)
+PP: At 0.5 Hz, it requires 30 CPU node-hrs per component.
-Fall 2013:  12 TB (1 Hz, 286 sites, 2 combinations, UCERF 2)
+  (30 CPU node-hrs per components) x (3 components) x (25 times the rupture points) x (2 times the timesteps) = 4500 node-hrs per site.
-== UCERF 2 ==
+'''6180''' node-hours per 3-component site (200k core-hours)
-For UCERF 2 we have about 15,000 ruptures statewide, or 7000 ruptures / 415000 rupture variations per site.
+'''1.77M''' node-hours for standard 3-component So Cal 286-site map (56.6M core-hours)
-=== 0.5 Hz (per site), 2 component ===
+'''5.55M''' node-hours for increased density 3-component So Cal 898-site map (178M core-hours)
-SGT data size:  40 GB
+'''8.65M''' node-hours for statewide adaptive 3-component California 1400-site map (277M core-hours)
-SGT SUs (CPU): 8k
+== 2.0 Hz ==
-PP number of tasks: 415k
+SGTs: At 1.0 Hz, it requires 560 GPU node-hrs per component.
-PP SUs: 1k
+PP: At 1.0 Hz, it requires 1500 CPU node-hrs per component.
-Seismogram data size: 11 GB
+'''36k''' node-hours per 3-component site (1.1M core-hours)
-Total SUs: 9k
+'''10.3M''' node-hours for standard 3-component So Cal 286-site map (328M core-hours)
-Total data: 51 GB
+'''127M''' node-hours for increased density 3-component So Cal 3545-site map (4.1B core-hours)
-=== 1 Hz (per site), 3 component ===
+'''50.2M''' node-hours for statewide adaptive 3-component California 1400-site map (1.6B core-hours)

Scottcal: /* UCERF 3 */

2013-06-28T14:48:05Z

UCERF 3

← Older revision		Revision as of 14:48, 28 June 2013
Line 69:		Line 69:
	== UCERF 3 ==		== UCERF 3 ==

	For UCERF 3 we are expecting about 350000 ruptures statewide, or 163000 ruptures / 9.7 million rupture variations		For UCERF 3 we are expecting about 350000 ruptures statewide, or 163000 ruptures / 9.7 million rupture variations.

	=== 0.5 Hz (per site), 2 component ===		=== 0.5 Hz (per site), 2 component ===

Scottcal at 14:47, 28 June 2013

2013-06-28T14:47:50Z

Show changes

Scottcal at 20:48, 14 June 2013

2013-06-14T20:48:17Z

← Older revision		Revision as of 20:48, 14 June 2013
Line 1:		Line 1:
	We will describe or current best estimates for the CyberShake computational and data requirements as we progress in our simulation planning and testing. These estimates will help us identify which aspects of the CyberShake computational system needs to be optimized to work within our time and resource constraints.		We will describe or current best estimates for the CyberShake computational and data requirements as we progress in our simulation planning and testing. These estimates will help us identify which aspects of the CyberShake computational system needs to be optimized to work within our time and resource constraints.

	~~All these estimates are for~~ UCERF 3~~, estimating~~ that the number of ruptures increases from 15000 to 200,000, but the number of rupture variations per rupture remains the same.		The UCERF 3 estimates assume that the number of ruptures increases from 15000 to 200,000, but the number of rupture variations per rupture remains the same.

	== 0.5 Hz (per site) ==		== Future SCEC data needs ==

			These are estimates of CyberShake storage required on SCEC computers for upcoming runs.

			July-August 2013: 6.1 TB to archive (0.5 Hz, CVM-SI, 2 SGT versions, 286 sites, UCERF 2)
			Fall 2013: 12 TB (1 Hz, 286 sites, 2 combinations, UCERF 2)
			Spring 2014: 45 TB (0.5 Hz, 286 sites, 1 combination, UCERF 3)

			== 0.5 Hz, UCERF 3 (per site) ==

	Number of rupture variations: 5.5 million		Number of rupture variations: 5.5 million
Line 24:		Line 32:


	== 1 Hz (per site) ==		== 1 Hz, UCERF 3 (per site) ==

	Number of rupture variations: 5.5 million		Number of rupture variations: 5.5 million

Scottcal at 23:10, 3 April 2012

2012-04-03T23:10:35Z

Show changes

← Older revision		Revision as of 21:48, 5 March 2014
Line 6:		Line 6:

	SGTs: At 0.5 Hz, it requires 35 GPU node-hrs per component.		SGTs: At 0.5 Hz, it requires 35 GPU node-hrs per component.
	(35 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) x (20% more efficient due to more work per GPU) = ~~1340~~ node-hrs per site.		(35 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) x (20% more efficient due to more work per GPU) = 1350 node-hrs per site.

	PP: At 0.5 Hz, it requires 30 CPU node-hrs per component.		PP: At 0.5 Hz, it requires 30 CPU node-hrs per component.
	(30 CPU node-hrs per components) x (3 components) x (25 times the rupture points) x (2 times the timesteps) = 4500 node-hrs per site.		(30 CPU node-hrs per components) x (3 components) x (25 times the rupture points) x (2 times the timesteps) = 4500 node-hrs per site.

	'''~~5840~~''' node-hours per 3-component site (187k core-hours)		'''5850''' node-hours per 3-component site (187k core-hours)

	'''1.67M''' node-hours for standard 3-component So Cal 286-site map (53.5M core-hours)		'''1.67M''' node-hours for standard 3-component So Cal 286-site map (53.5M core-hours)
Line 21:		Line 21:
	== 2.0 Hz ==		== 2.0 Hz ==

	SGTs: At 1.0 Hz, it requires ~~560~~ GPU node-hrs per component.		SGTs: At 1.0 Hz, it requires 450 GPU node-hrs per component.
	(~~560~~ GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) = ~~27k~~ node-hrs per site.		(450 GPU node-hrs per component) x (3 components) x (8 times the gridpoints) x (2 times the timesteps) = 22k node-hrs per site.

	PP: At 1.0 Hz, it requires 1500 CPU node-hrs per component.		PP: At 1.0 Hz, it requires 1500 CPU node-hrs per component.
	(1500 CPU node-hrs per components) x (3 components) x (2 times the timesteps) = 9k node-hrs per site.		(1500 CPU node-hrs per components) x (3 components) x (2 times the timesteps) = 9k node-hrs per site.

	'''~~36k~~''' node-hours per 3-component site (~~1.1M~~ core-hours)		'''31k''' node-hours per 3-component site (976k core-hours)

	'''10.3M''' node-hours for standard 3-component So Cal 286-site map (~~328M~~ core-hours)		'''8.72M''' node-hours for standard 3-component So Cal 286-site map (279M core-hours)

	'''~~127M~~''' node-hours for increased density 3-component So Cal 3545-site map (4.1B core-hours)		'''108M''' node-hours for increased density 3-component So Cal 3545-site map (3.5B core-hours)

	'''~~50.2M~~''' node-hours for statewide adaptive 3-component California 1400-site map (1.6B core-hours)		'''35M''' node-hours for statewide adaptive 3-component California 1400-site map (1.1B core-hours)