Difference between revisions of "CI3144585"

From SCECpedia
Jump to navigationJump to search
 
(12 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
Details about the Scenario Event used for ShakeOut 2024 testing:
+
== ShakeOut U3-ETAS Results for Northridge EQ ==
 +
 
 +
{| class="wikitable"
 +
! Submit time
 +
! Operator
 +
! Complete Time
 +
! Makespan (H:M)
 +
! System
 +
! RunType
 +
! Queue
 +
! DataSize (GB)
 +
! Result
 +
! Config
 +
|-
 +
| 10:20
 +
| Akash
 +
| 10:27
 +
| 0:07
 +
| Expanse
 +
| QW
 +
| compute
 +
| 0.082
 +
| null-pointer exception
 +
| default
 +
|-
 +
| 10:23
 +
| Phil
 +
| 10:26
 +
| 0:03
 +
| Expanse
 +
| commandline
 +
| compute
 +
| 0.084
 +
| error writing configuration file to temp storage
 +
| default
 +
|-
 +
| 10:50
 +
| Akash
 +
| 11:22
 +
| 0:32
 +
| Expanse
 +
| QW
 +
| compute
 +
| 0.091
 +
| null-pointer exception
 +
| default
 +
|-
 +
| 11:20
 +
| Phil
 +
| 11:55
 +
| 0:35
 +
| Expanse
 +
| commandline
 +
| compute
 +
| 2.300
 +
| partial results - no slurm logs
 +
| default
 +
|-
 +
| 12:16
 +
| Phil
 +
| 14:07
 +
| 1:51
 +
| Expanse
 +
| QW
 +
| compute
 +
| 0.089
 +
| log files only in zip file download
 +
| default
 +
|-
 +
| 12:25
 +
| Akash
 +
| 16:40
 +
| 4:15
 +
| Frontera
 +
| commandline
 +
| priority
 +
| 15.829
 +
| full result with index.html
 +
| default
 +
|-
 +
| 13:23
 +
| Akash
 +
| 13:24
 +
| 0:01
 +
| Expanse
 +
| commandline
 +
| compute
 +
| 0.000
 +
| remote directory error
 +
| default
 +
|-
 +
| 13:35
 +
| Phil
 +
| 16:30
 +
| 2:55
 +
| Expanse
 +
| commandline
 +
| compute
 +
| 9.700
 +
| full result with index.html on Expanse
 +
| default
 +
|-
 +
| 14:56
 +
| Phil
 +
| 16:22
 +
| 1:26
 +
| Expanse
 +
| QW
 +
| compute
 +
| 10.570
 +
| full result with index.html as zip file download
 +
| Modified radius to 40km
 +
|-
 +
| 15:41
 +
| Akash
 +
| 19:30
 +
| 3:49
 +
| Frontera
 +
| commandline
 +
| priority
 +
| 15.729
 +
| full result with index.html on Frontera
 +
| Modify Input params per KM
 +
|-
 +
| 15:57
 +
| Akash
 +
| 15:57
 +
| 0:00
 +
| Expanse
 +
| QW
 +
| compute
 +
| 0.084
 +
| null-pointer exception
 +
| Modify Input params per KM
 +
|-
 +
| 21:02
 +
| Phil
 +
| 23:38
 +
| 2:36
 +
| Expanse
 +
| commandline
 +
| compute
 +
| 12.000
 +
| full results with index.html on Expanse
 +
| Modified source types and increased radius to 40km
 +
|}
 +
 
 +
== Successful Runs ==
 +
 
 +
{| class="wikitable"
 +
! Submit time
 +
! Operator
 +
! Complete Time
 +
! Makespan (H:M)
 +
! System
 +
! RunType
 +
! Queue
 +
! DataSize (GB)
 +
! Result
 +
! Config
 +
|-
 +
| 12:25
 +
| Akash
 +
| 16:40
 +
| 4:15
 +
| Frontera
 +
| commandline
 +
| priority
 +
| 15.829
 +
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-n14-s100000/index.html index.html]
 +
| default
 +
|-
 +
| 13:35
 +
| Phil
 +
| 16:30
 +
| 2:55
 +
| Expanse
 +
| commandline
 +
| compute
 +
| 9.700
 +
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T133515-34540008/index.html index.html]
 +
| default
 +
|-
 +
| 14:56
 +
| Phil
 +
| 16:22
 +
| 1:26
 +
| Expanse
 +
| QW
 +
| compute
 +
| 10.570
 +
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/Northridge_u3_etas_40k/outputs/index.html index.html]
 +
| Modified radius to 40km
 +
|-
 +
| 15:41
 +
| Akash
 +
| 19:30
 +
| 3:49
 +
| Frontera
 +
| commandline
 +
| priority
 +
| 15.729
 +
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/index.html index.html]
 +
| Modify Input params per KM
 +
|-
 +
| 21:02
 +
| Phil
 +
| 23:38
 +
| 2:36
 +
| Expanse
 +
| commandline
 +
| compute
 +
| 12.000
 +
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T210255-34546712/index.html index.html]
 +
| Modified source types and increased radius to 40km
 +
|}
 +
 
 +
=== Frontera Command line priority Queue ===
 +
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-n14-s100000/index.html index.html]
 +
**[/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-n14-s100000/results]
 +
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/index.html index.html]
 +
**[/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/result]
 +
 
 +
=== Expanse Command line compute Queue ===
 +
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T210255-34546712/index.html index.html]
 +
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T133515-34540008/index.html index.html]
 +
 
 +
=== Quakeworx Expanse ===
 +
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/Northridge_u3_etas_40k/outputs/index.html index.html]
  
 
== Northridge Event Info ==
 
== Northridge Event Info ==
 +
Details about the Scenario Event used for ShakeOut 2024 testing:
 
*CI3144585
 
*CI3144585
 
*M6.7
 
*M6.7
Line 15: Line 244:
 
* App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 --radius 20 --random-seed 123456789 --binary-output
 
* App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 --radius 20 --random-seed 123456789 --binary-output
  
−
This job is visible on Expanse as:
+
This QW job is visible on Expanse as:
 
<pre>
 
<pre>
 +
(base) squeue -u qwxdev
 
             JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
 
             JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
 +
          34541195  compute tapisjob  qwxdev PD      0:00    14 (Priority)
 +
(base)
 +
</pre>
 +
 +
A ucerf3-etas job submitted as individual researcher is visible on Expanse as:
 +
<pre>
 
(base) squeue -u ux454496
 
(base) squeue -u ux454496
 
             JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
 
             JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
 
           34540008  compute  run.sh ux454496 PD      0:00    14 (Priority)
 
           34540008  compute  run.sh ux454496 PD      0:00    14 (Priority)
−
(base) squeue -u qwxdev
 
−
            JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
 
−
          34541195  compute tapisjob  qwxdev PD      0:00    14 (Priority)
 
−
(base)
 
 
</pre>
 
</pre>
 +
== Results from QW Run ==
 +
Three runs on 10/17 failed (Amit app and Fabio app) due to Expanse filesystem outage.
 +
 +
== Second QW u3-etas command string ==
 +
* App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 6 --max-point-src-mag 5 --radius 40 --random-seed 123456789 --binary-output
  
 
== Proposed ETAS post-earthquake configuration for Northridge EQ ==
 
== Proposed ETAS post-earthquake configuration for Northridge EQ ==
Line 34: Line 271:
 
* NUM_SIM=100000
 
* NUM_SIM=100000
 
* cd $ETAS_SIM_DIR
 
* cd $ETAS_SIM_DIR
−
* u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations $NUM_SIM --days-before 7 --max-point-src-mag 6 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --hpc-site TACC_FRONTERA --nodes $NUM_NODE --hours 24 --queue normal --output-dir $ETAS_SIM_DIR/frontera-comcat-northridge-m6.7-n${NUM_NODE}-s$NUM_SIM
+
* u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations $NUM_SIM --days-before 7 --max-point-src-mag 6 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --reset-sects 1409,1410,1411,1412,1413 --hpc-site TACC_FRONTERA --nodes $NUM_NODE --hours 24 --queue normal --output-dir $ETAS_SIM_DIR/frontera-comcat-northridge-m6.7-n${NUM_NODE}-s$NUM_SIM
 +
 
 +
== Results from Frontera Run ==
 +
* First run without settings elastic rebound parameter (reset-sects): 4:14:43
 +
* Second run with parameter set: 3:47:59
  
 
== UCERF3-ETAS Config string ==
 
== UCERF3-ETAS Config string ==

Latest revision as of 06:11, 4 November 2024

ShakeOut U3-ETAS Results for Northridge EQ

Submit time Operator Complete Time Makespan (H:M) System RunType Queue DataSize (GB) Result Config
10:20 Akash 10:27 0:07 Expanse QW compute 0.082 null-pointer exception default
10:23 Phil 10:26 0:03 Expanse commandline compute 0.084 error writing configuration file to temp storage default
10:50 Akash 11:22 0:32 Expanse QW compute 0.091 null-pointer exception default
11:20 Phil 11:55 0:35 Expanse commandline compute 2.300 partial results - no slurm logs default
12:16 Phil 14:07 1:51 Expanse QW compute 0.089 log files only in zip file download default
12:25 Akash 16:40 4:15 Frontera commandline priority 15.829 full result with index.html default
13:23 Akash 13:24 0:01 Expanse commandline compute 0.000 remote directory error default
13:35 Phil 16:30 2:55 Expanse commandline compute 9.700 full result with index.html on Expanse default
14:56 Phil 16:22 1:26 Expanse QW compute 10.570 full result with index.html as zip file download Modified radius to 40km
15:41 Akash 19:30 3:49 Frontera commandline priority 15.729 full result with index.html on Frontera Modify Input params per KM
15:57 Akash 15:57 0:00 Expanse QW compute 0.084 null-pointer exception Modify Input params per KM
21:02 Phil 23:38 2:36 Expanse commandline compute 12.000 full results with index.html on Expanse Modified source types and increased radius to 40km

Successful Runs

Submit time Operator Complete Time Makespan (H:M) System RunType Queue DataSize (GB) Result Config
12:25 Akash 16:40 4:15 Frontera commandline priority 15.829 index.html default
13:35 Phil 16:30 2:55 Expanse commandline compute 9.700 index.html default
14:56 Phil 16:22 1:26 Expanse QW compute 10.570 index.html Modified radius to 40km
15:41 Akash 19:30 3:49 Frontera commandline priority 15.729 index.html Modify Input params per KM
21:02 Phil 23:38 2:36 Expanse commandline compute 12.000 index.html Modified source types and increased radius to 40km

Frontera Command line priority Queue

  • index.html
    • [/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-n14-s100000/results]
  • index.html
    • [/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/result]

Expanse Command line compute Queue

Quakeworx Expanse

Northridge Event Info

Details about the Scenario Event used for ShakeOut 2024 testing:

  • CI3144585
  • M6.7
  • Northridge, California, earthquake
  • 1994-01-17
  • 12:30:55 (UTC)
  • 34.213°N
  • 118.537°W
  • 18.2 km depth

QW U3-ETAS using Northridge ID and default on App Page

Using the input page, specified a value in all input fields, typing in the default values in all boxes, and changed queue to compute, and submitted the job Last message: Setting job status to queued. Remote job ID: 34541195 Remote job submitted: 2024-10-17T19:16:37. Screen output from QW is below:

  • App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 --radius 20 --random-seed 123456789 --binary-output

This QW job is visible on Expanse as: 

(base) squeue -u qwxdev
             JOBID PARTITION     NAME     USER ST       TIME  NODES NODELIST(REASON)
          34541195   compute tapisjob   qwxdev PD       0:00     14 (Priority)
(base)

A ucerf3-etas job submitted as individual researcher is visible on Expanse as: 

(base) squeue -u ux454496
             JOBID PARTITION     NAME     USER ST       TIME  NODES NODELIST(REASON)
          34540008   compute   run.sh ux454496 PD       0:00     14 (Priority)

Results from QW Run

Three runs on 10/17 failed (Amit app and Fabio app) due to Expanse filesystem outage.

Second QW u3-etas command string

  • App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 6 --max-point-src-mag 5 --radius 40 --random-seed 123456789 --binary-output

Proposed ETAS post-earthquake configuration for Northridge EQ

  • u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6

Proposed Frontera Commands

  • NUM_NODE=14
  • NUM_SIM=100000
  • cd $ETAS_SIM_DIR
  • u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations $NUM_SIM --days-before 7 --max-point-src-mag 6 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --reset-sects 1409,1410,1411,1412,1413 --hpc-site TACC_FRONTERA --nodes $NUM_NODE --hours 24 --queue normal --output-dir $ETAS_SIM_DIR/frontera-comcat-northridge-m6.7-n${NUM_NODE}-s$NUM_SIM

Results from Frontera Run

  • First run without settings elastic rebound parameter (reset-sects): 4:14:43
  • Second run with parameter set: 3:47:59

UCERF3-ETAS Config string

Example ucerf3 run points source for in 2022.

  • u3etas_comcat_event_config_builder.sh --event-id nc73799091 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --hpc-site USC_CARC --nodes 36 --hours 24 --queue scec_hiprio

Example from Aug 2024

  • u3etas_comcat_event_config_builder.sh --event-id ew1723003800 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --hpc-site USC_CARC --nodes 36 --hours 24 --queue scec --etas-k-cov 1.5

Example using a Random Number input

  • u3etas_comcat_event_config_builder.sh --event-id ci38457511 --num-simulations 10 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --output-dir target/test_case_1 --random-seed 12345678

Comcat Info

Related Entries

Retrieved from "https://strike.scec.org/scecwiki/index.php?title=CI3144585&oldid=29996"