CI3144585: Difference between revisions

From SCECpedia
Jump to navigationJump to search
← Older edit
Maechlin (talk | contribs)
11,776 edits
Maechlin (talk | contribs)
11,776 edits
 
(12 intermediate revisions by 2 users not shown)
Line 1: Line 1:
Details about the Scenario Event used for ShakeOut 2024 testing:
== ShakeOut U3-ETAS Results for Northridge EQ ==
 
{| class="wikitable"
! Submit time
! Operator
! Complete Time
! Makespan (H:M)
! System
! RunType
! Queue
! DataSize (GB)
! Result
! Config
|-
| 10:20
| Akash
| 10:27
| 0:07
| Expanse
| QW
| compute
| 0.082
| null-pointer exception
| default
|-
| 10:23
| Phil
| 10:26
| 0:03
| Expanse
| commandline
| compute
| 0.084
| error writing configuration file to temp storage
| default
|-
| 10:50
| Akash
| 11:22
| 0:32
| Expanse
| QW
| compute
| 0.091
| null-pointer exception
| default
|-
| 11:20
| Phil
| 11:55
| 0:35
| Expanse
| commandline
| compute
| 2.300
| partial results - no slurm logs
| default
|-
| 12:16
| Phil
| 14:07
| 1:51
| Expanse
| QW
| compute
| 0.089
| log files only in zip file download
| default
|-
| 12:25
| Akash
| 16:40
| 4:15
| Frontera
| commandline
| priority
| 15.829
| full result with index.html
| default
|-
| 13:23
| Akash
| 13:24
| 0:01
| Expanse
| commandline
| compute
| 0.000
| remote directory error
| default
|-
| 13:35
| Phil
| 16:30
| 2:55
| Expanse
| commandline
| compute
| 9.700
| full result with index.html on Expanse
| default
|-
| 14:56
| Phil
| 16:22
| 1:26
| Expanse
| QW
| compute
| 10.570
| full result with index.html as zip file download
| Modified radius to 40km
|-
| 15:41
| Akash
| 19:30
| 3:49
| Frontera
| commandline
| priority
| 15.729
| full result with index.html on Frontera
| Modify Input params per KM
|-
| 15:57
| Akash
| 15:57
| 0:00
| Expanse
| QW
| compute
| 0.084
| null-pointer exception
| Modify Input params per KM
|-
| 21:02
| Phil
| 23:38
| 2:36
| Expanse
| commandline
| compute
| 12.000
| full results with index.html on Expanse
| Modified source types and increased radius to 40km
|}
 
== Successful Runs ==
 
{| class="wikitable"
! Submit time
! Operator
! Complete Time
! Makespan (H:M)
! System
! RunType
! Queue
! DataSize (GB)
! Result
! Config
|-
| 12:25
| Akash
| 16:40
| 4:15
| Frontera
| commandline
| priority
| 15.829
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-n14-s100000/index.html index.html]
| default
|-
| 13:35
| Phil
| 16:30
| 2:55
| Expanse
| commandline
| compute
| 9.700
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T133515-34540008/index.html index.html]
| default
|-
| 14:56
| Phil
| 16:22
| 1:26
| Expanse
| QW
| compute
| 10.570
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/Northridge_u3_etas_40k/outputs/index.html index.html]
| Modified radius to 40km
|-
| 15:41
| Akash
| 19:30
| 3:49
| Frontera
| commandline
| priority
| 15.729
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/index.html index.html]
| Modify Input params per KM
|-
| 21:02
| Phil
| 23:38
| 2:36
| Expanse
| commandline
| compute
| 12.000
| [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T210255-34546712/index.html index.html]
| Modified source types and increased radius to 40km
|}
 
=== Frontera Command line priority Queue ===
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-n14-s100000/index.html index.html]
**[/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-n14-s100000/results]
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/index.html index.html]
**[/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/result]
 
=== Expanse Command line compute Queue ===
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T210255-34546712/index.html index.html]
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T133515-34540008/index.html index.html]
 
=== Quakeworx Expanse ===
*[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/Northridge_u3_etas_40k/outputs/index.html index.html]


== Northridge Event Info ==
== Northridge Event Info ==
Details about the Scenario Event used for ShakeOut 2024 testing:
*CI3144585
*CI3144585
*M6.7
*M6.7
Line 15: Line 244:
* App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 --radius 20 --random-seed 123456789 --binary-output
* App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 --radius 20 --random-seed 123456789 --binary-output


This job is visible on Expanse as:
This QW job is visible on Expanse as:
<pre>
<pre>
(base) squeue -u qwxdev
             JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
             JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
          34541195  compute tapisjob  qwxdev PD      0:00    14 (Priority)
(base)
</pre>
A ucerf3-etas job submitted as individual researcher is visible on Expanse as:
<pre>
(base) squeue -u ux454496
(base) squeue -u ux454496
             JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
             JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
           34540008  compute  run.sh ux454496 PD      0:00    14 (Priority)
           34540008  compute  run.sh ux454496 PD      0:00    14 (Priority)
(base) squeue -u qwxdev
            JOBID PARTITION    NAME    USER ST      TIME  NODES NODELIST(REASON)
          34541195  compute tapisjob  qwxdev PD      0:00    14 (Priority)
(base)
</pre>
</pre>
== Results from QW Run ==
Three runs on 10/17 failed (Amit app and Fabio app) due to Expanse filesystem outage.
== Second QW u3-etas command string ==
* App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 6 --max-point-src-mag 5 --radius 40 --random-seed 123456789 --binary-output


== Proposed ETAS post-earthquake configuration for Northridge EQ ==
== Proposed ETAS post-earthquake configuration for Northridge EQ ==
Line 34: Line 271:
* NUM_SIM=100000
* NUM_SIM=100000
* cd $ETAS_SIM_DIR
* cd $ETAS_SIM_DIR
* u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations $NUM_SIM --days-before 7 --max-point-src-mag 6 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --hpc-site TACC_FRONTERA --nodes $NUM_NODE --hours 24 --queue normal --output-dir $ETAS_SIM_DIR/frontera-comcat-northridge-m6.7-n${NUM_NODE}-s$NUM_SIM
* u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations $NUM_SIM --days-before 7 --max-point-src-mag 6 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --reset-sects 1409,1410,1411,1412,1413 --hpc-site TACC_FRONTERA --nodes $NUM_NODE --hours 24 --queue normal --output-dir $ETAS_SIM_DIR/frontera-comcat-northridge-m6.7-n${NUM_NODE}-s$NUM_SIM
 
== Results from Frontera Run ==
* First run without settings elastic rebound parameter (reset-sects): 4:14:43
* Second run with parameter set: 3:47:59


== UCERF3-ETAS Config string ==
== UCERF3-ETAS Config string ==

Latest revision as of 06:11, 4 November 2024

ShakeOut U3-ETAS Results for Northridge EQ

Submit time Operator Complete Time Makespan (H:M) System RunType Queue DataSize (GB) Result Config
10:20 Akash 10:27 0:07 Expanse QW compute 0.082 null-pointer exception default
10:23 Phil 10:26 0:03 Expanse commandline compute 0.084 error writing configuration file to temp storage default
10:50 Akash 11:22 0:32 Expanse QW compute 0.091 null-pointer exception default
11:20 Phil 11:55 0:35 Expanse commandline compute 2.300 partial results - no slurm logs default
12:16 Phil 14:07 1:51 Expanse QW compute 0.089 log files only in zip file download default
12:25 Akash 16:40 4:15 Frontera commandline priority 15.829 full result with index.html default
13:23 Akash 13:24 0:01 Expanse commandline compute 0.000 remote directory error default
13:35 Phil 16:30 2:55 Expanse commandline compute 9.700 full result with index.html on Expanse default
14:56 Phil 16:22 1:26 Expanse QW compute 10.570 full result with index.html as zip file download Modified radius to 40km
15:41 Akash 19:30 3:49 Frontera commandline priority 15.729 full result with index.html on Frontera Modify Input params per KM
15:57 Akash 15:57 0:00 Expanse QW compute 0.084 null-pointer exception Modify Input params per KM
21:02 Phil 23:38 2:36 Expanse commandline compute 12.000 full results with index.html on Expanse Modified source types and increased radius to 40km

Successful Runs

Submit time Operator Complete Time Makespan (H:M) System RunType Queue DataSize (GB) Result Config
12:25 Akash 16:40 4:15 Frontera commandline priority 15.829 index.html default
13:35 Phil 16:30 2:55 Expanse commandline compute 9.700 index.html default
14:56 Phil 16:22 1:26 Expanse QW compute 10.570 index.html Modified radius to 40km
15:41 Akash 19:30 3:49 Frontera commandline priority 15.729 index.html Modify Input params per KM
21:02 Phil 23:38 2:36 Expanse commandline compute 12.000 index.html Modified source types and increased radius to 40km

Frontera Command line priority Queue

  • index.html
    • [/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-n14-s100000/results]
  • index.html
    • [/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/result]

Expanse Command line compute Queue

Quakeworx Expanse

Northridge Event Info

Details about the Scenario Event used for ShakeOut 2024 testing:

  • CI3144585
  • M6.7
  • Northridge, California, earthquake
  • 1994-01-17
  • 12:30:55 (UTC)
  • 34.213°N
  • 118.537°W
  • 18.2 km depth

QW U3-ETAS using Northridge ID and default on App Page

Using the input page, specified a value in all input fields, typing in the default values in all boxes, and changed queue to compute, and submitted the job Last message: Setting job status to queued. Remote job ID: 34541195 Remote job submitted: 2024-10-17T19:16:37. Screen output from QW is below:

  • App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 --radius 20 --random-seed 123456789 --binary-output

This QW job is visible on Expanse as: 

(base) squeue -u qwxdev
             JOBID PARTITION     NAME     USER ST       TIME  NODES NODELIST(REASON)
          34541195   compute tapisjob   qwxdev PD       0:00     14 (Priority)
(base)

A ucerf3-etas job submitted as individual researcher is visible on Expanse as: 

(base) squeue -u ux454496
             JOBID PARTITION     NAME     USER ST       TIME  NODES NODELIST(REASON)
          34540008   compute   run.sh ux454496 PD       0:00     14 (Priority)

Results from QW Run

Three runs on 10/17 failed (Amit app and Fabio app) due to Expanse filesystem outage.

Second QW u3-etas command string

  • App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 6 --max-point-src-mag 5 --radius 40 --random-seed 123456789 --binary-output

Proposed ETAS post-earthquake configuration for Northridge EQ

  • u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6

Proposed Frontera Commands

  • NUM_NODE=14
  • NUM_SIM=100000
  • cd $ETAS_SIM_DIR
  • u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations $NUM_SIM --days-before 7 --max-point-src-mag 6 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --reset-sects 1409,1410,1411,1412,1413 --hpc-site TACC_FRONTERA --nodes $NUM_NODE --hours 24 --queue normal --output-dir $ETAS_SIM_DIR/frontera-comcat-northridge-m6.7-n${NUM_NODE}-s$NUM_SIM

Results from Frontera Run

  • First run without settings elastic rebound parameter (reset-sects): 4:14:43
  • Second run with parameter set: 3:47:59

UCERF3-ETAS Config string

Example ucerf3 run points source for in 2022.

  • u3etas_comcat_event_config_builder.sh --event-id nc73799091 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --hpc-site USC_CARC --nodes 36 --hours 24 --queue scec_hiprio

Example from Aug 2024

  • u3etas_comcat_event_config_builder.sh --event-id ew1723003800 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --hpc-site USC_CARC --nodes 36 --hours 24 --queue scec --etas-k-cov 1.5

Example using a Random Number input

  • u3etas_comcat_event_config_builder.sh --event-id ci38457511 --num-simulations 10 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --output-dir target/test_case_1 --random-seed 12345678

Comcat Info

Related Entries

Retrieved from "https://strike.scec.org/index.php?title=CI3144585&oldid=29996"