Difference between revisions of "CI3144585"
From SCECpedia
Jump to navigationJump to search(18 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
− | + | == ShakeOut U3-ETAS Results for Northridge EQ == | |
+ | |||
+ | {| class="wikitable" | ||
+ | ! Submit time | ||
+ | ! Operator | ||
+ | ! Complete Time | ||
+ | ! Makespan (H:M) | ||
+ | ! System | ||
+ | ! RunType | ||
+ | ! Queue | ||
+ | ! DataSize (GB) | ||
+ | ! Result | ||
+ | ! Config | ||
+ | |- | ||
+ | | 10:20 | ||
+ | | Akash | ||
+ | | 10:27 | ||
+ | | 0:07 | ||
+ | | Expanse | ||
+ | | QW | ||
+ | | compute | ||
+ | | 0.082 | ||
+ | | null-pointer exception | ||
+ | | default | ||
+ | |- | ||
+ | | 10:23 | ||
+ | | Phil | ||
+ | | 10:26 | ||
+ | | 0:03 | ||
+ | | Expanse | ||
+ | | commandline | ||
+ | | compute | ||
+ | | 0.084 | ||
+ | | error writing configuration file to temp storage | ||
+ | | default | ||
+ | |- | ||
+ | | 10:50 | ||
+ | | Akash | ||
+ | | 11:22 | ||
+ | | 0:32 | ||
+ | | Expanse | ||
+ | | QW | ||
+ | | compute | ||
+ | | 0.091 | ||
+ | | null-pointer exception | ||
+ | | default | ||
+ | |- | ||
+ | | 11:20 | ||
+ | | Phil | ||
+ | | 11:55 | ||
+ | | 0:35 | ||
+ | | Expanse | ||
+ | | commandline | ||
+ | | compute | ||
+ | | 2.300 | ||
+ | | partial results - no slurm logs | ||
+ | | default | ||
+ | |- | ||
+ | | 12:16 | ||
+ | | Phil | ||
+ | | 14:07 | ||
+ | | 1:51 | ||
+ | | Expanse | ||
+ | | QW | ||
+ | | compute | ||
+ | | 0.089 | ||
+ | | log files only in zip file download | ||
+ | | default | ||
+ | |- | ||
+ | | 12:25 | ||
+ | | Akash | ||
+ | | 16:40 | ||
+ | | 4:15 | ||
+ | | Frontera | ||
+ | | commandline | ||
+ | | priority | ||
+ | | 15.829 | ||
+ | | full result with index.html | ||
+ | | default | ||
+ | |- | ||
+ | | 13:23 | ||
+ | | Akash | ||
+ | | 13:24 | ||
+ | | 0:01 | ||
+ | | Expanse | ||
+ | | commandline | ||
+ | | compute | ||
+ | | 0.000 | ||
+ | | remote directory error | ||
+ | | default | ||
+ | |- | ||
+ | | 13:35 | ||
+ | | Phil | ||
+ | | 16:30 | ||
+ | | 2:55 | ||
+ | | Expanse | ||
+ | | commandline | ||
+ | | compute | ||
+ | | 9.700 | ||
+ | | full result with index.html on Expanse | ||
+ | | default | ||
+ | |- | ||
+ | | 14:56 | ||
+ | | Phil | ||
+ | | 16:22 | ||
+ | | 1:26 | ||
+ | | Expanse | ||
+ | | QW | ||
+ | | compute | ||
+ | | 10.570 | ||
+ | | full result with index.html as zip file download | ||
+ | | Modified radius to 40km | ||
+ | |- | ||
+ | | 15:41 | ||
+ | | Akash | ||
+ | | 19:30 | ||
+ | | 3:49 | ||
+ | | Frontera | ||
+ | | commandline | ||
+ | | priority | ||
+ | | 15.729 | ||
+ | | full result with index.html on Frontera | ||
+ | | Modify Input params per KM | ||
+ | |- | ||
+ | | 15:57 | ||
+ | | Akash | ||
+ | | 15:57 | ||
+ | | 0:00 | ||
+ | | Expanse | ||
+ | | QW | ||
+ | | compute | ||
+ | | 0.084 | ||
+ | | null-pointer exception | ||
+ | | Modify Input params per KM | ||
+ | |- | ||
+ | | 21:02 | ||
+ | | Phil | ||
+ | | 23:38 | ||
+ | | 2:36 | ||
+ | | Expanse | ||
+ | | commandline | ||
+ | | compute | ||
+ | | 12.000 | ||
+ | | full results with index.html on Expanse | ||
+ | | Modified source types and increased radius to 40km | ||
+ | |} | ||
+ | |||
+ | == Successful Runs == | ||
+ | |||
+ | {| class="wikitable" | ||
+ | ! Submit time | ||
+ | ! Operator | ||
+ | ! Complete Time | ||
+ | ! Makespan (H:M) | ||
+ | ! System | ||
+ | ! RunType | ||
+ | ! Queue | ||
+ | ! DataSize (GB) | ||
+ | ! Result | ||
+ | ! Config | ||
+ | |- | ||
+ | | 12:25 | ||
+ | | Akash | ||
+ | | 16:40 | ||
+ | | 4:15 | ||
+ | | Frontera | ||
+ | | commandline | ||
+ | | priority | ||
+ | | 15.829 | ||
+ | | [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-n14-s100000/index.html index.html] | ||
+ | | default | ||
+ | |- | ||
+ | | 13:35 | ||
+ | | Phil | ||
+ | | 16:30 | ||
+ | | 2:55 | ||
+ | | Expanse | ||
+ | | commandline | ||
+ | | compute | ||
+ | | 9.700 | ||
+ | | [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T133515-34540008/index.html index.html] | ||
+ | | default | ||
+ | |- | ||
+ | | 14:56 | ||
+ | | Phil | ||
+ | | 16:22 | ||
+ | | 1:26 | ||
+ | | Expanse | ||
+ | | QW | ||
+ | | compute | ||
+ | | 10.570 | ||
+ | | [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/Northridge_u3_etas_40k/outputs/index.html index.html] | ||
+ | | Modified radius to 40km | ||
+ | |- | ||
+ | | 15:41 | ||
+ | | Akash | ||
+ | | 19:30 | ||
+ | | 3:49 | ||
+ | | Frontera | ||
+ | | commandline | ||
+ | | priority | ||
+ | | 15.729 | ||
+ | | [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/index.html index.html] | ||
+ | | Modify Input params per KM | ||
+ | |- | ||
+ | | 21:02 | ||
+ | | Phil | ||
+ | | 23:38 | ||
+ | | 2:36 | ||
+ | | Expanse | ||
+ | | commandline | ||
+ | | compute | ||
+ | | 12.000 | ||
+ | | [https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T210255-34546712/index.html index.html] | ||
+ | | Modified source types and increased radius to 40km | ||
+ | |} | ||
+ | |||
+ | === Frontera Command line priority Queue === | ||
+ | *[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-n14-s100000/index.html index.html] | ||
+ | **[/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-n14-s100000/results] | ||
+ | *[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/index.html index.html] | ||
+ | **[/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/result] | ||
+ | |||
+ | === Expanse Command line compute Queue === | ||
+ | *[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T210255-34546712/index.html index.html] | ||
+ | *[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/20241017T133515-34540008/index.html index.html] | ||
+ | |||
+ | === Quakeworx Expanse === | ||
+ | *[https://g-c662a6.a78b8.36fe.data.globus.org/ucerf3-etas/2024-10-17/Northridge_u3_etas_40k/outputs/index.html index.html] | ||
== Northridge Event Info == | == Northridge Event Info == | ||
+ | Details about the Scenario Event used for ShakeOut 2024 testing: | ||
*CI3144585 | *CI3144585 | ||
*M6.7 | *M6.7 | ||
Line 10: | Line 239: | ||
*118.537°W | *118.537°W | ||
*18.2 km depth | *18.2 km depth | ||
+ | |||
+ | == QW U3-ETAS using Northridge ID and default on App Page == | ||
+ | Using the input page, specified a value in all input fields, typing in the default values in all boxes, and changed queue to compute, and submitted the job Last message: Setting job status to queued. Remote job ID: 34541195 Remote job submitted: 2024-10-17T19:16:37. Screen output from QW is below: | ||
+ | * App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 --radius 20 --random-seed 123456789 --binary-output | ||
+ | |||
+ | This QW job is visible on Expanse as: | ||
+ | <pre> | ||
+ | (base) squeue -u qwxdev | ||
+ | JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON) | ||
+ | 34541195 compute tapisjob qwxdev PD 0:00 14 (Priority) | ||
+ | (base) | ||
+ | </pre> | ||
+ | |||
+ | A ucerf3-etas job submitted as individual researcher is visible on Expanse as: | ||
+ | <pre> | ||
+ | (base) squeue -u ux454496 | ||
+ | JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON) | ||
+ | 34540008 compute run.sh ux454496 PD 0:00 14 (Priority) | ||
+ | </pre> | ||
+ | == Results from QW Run == | ||
+ | Three runs on 10/17 failed (Amit app and Fabio app) due to Expanse filesystem outage. | ||
+ | |||
+ | == Second QW u3-etas command string == | ||
+ | * App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 6 --max-point-src-mag 5 --radius 40 --random-seed 123456789 --binary-output | ||
== Proposed ETAS post-earthquake configuration for Northridge EQ == | == Proposed ETAS post-earthquake configuration for Northridge EQ == | ||
* u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 | * u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 | ||
− | == Proposed == | + | == Proposed Frontera Commands == |
− | * cd $ETAS_SIM_DIR | + | * NUM_NODE=14 |
+ | * NUM_SIM=100000 | ||
+ | * cd $ETAS_SIM_DIR | ||
+ | * u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations $NUM_SIM --days-before 7 --max-point-src-mag 6 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --reset-sects 1409,1410,1411,1412,1413 --hpc-site TACC_FRONTERA --nodes $NUM_NODE --hours 24 --queue normal --output-dir $ETAS_SIM_DIR/frontera-comcat-northridge-m6.7-n${NUM_NODE}-s$NUM_SIM | ||
+ | |||
+ | == Results from Frontera Run == | ||
+ | * First run without settings elastic rebound parameter (reset-sects): 4:14:43 | ||
+ | * Second run with parameter set: 3:47:59 | ||
== UCERF3-ETAS Config string == | == UCERF3-ETAS Config string == |
Latest revision as of 06:11, 4 November 2024
Contents
- 1 ShakeOut U3-ETAS Results for Northridge EQ
- 2 Successful Runs
- 3 Northridge Event Info
- 4 QW U3-ETAS using Northridge ID and default on App Page
- 5 Results from QW Run
- 6 Second QW u3-etas command string
- 7 Proposed ETAS post-earthquake configuration for Northridge EQ
- 8 Proposed Frontera Commands
- 9 Results from Frontera Run
- 10 UCERF3-ETAS Config string
- 11 Comcat Info
- 12 Related Entries
ShakeOut U3-ETAS Results for Northridge EQ
Submit time | Operator | Complete Time | Makespan (H:M) | System | RunType | Queue | DataSize (GB) | Result | Config |
---|---|---|---|---|---|---|---|---|---|
10:20 | Akash | 10:27 | 0:07 | Expanse | QW | compute | 0.082 | null-pointer exception | default |
10:23 | Phil | 10:26 | 0:03 | Expanse | commandline | compute | 0.084 | error writing configuration file to temp storage | default |
10:50 | Akash | 11:22 | 0:32 | Expanse | QW | compute | 0.091 | null-pointer exception | default |
11:20 | Phil | 11:55 | 0:35 | Expanse | commandline | compute | 2.300 | partial results - no slurm logs | default |
12:16 | Phil | 14:07 | 1:51 | Expanse | QW | compute | 0.089 | log files only in zip file download | default |
12:25 | Akash | 16:40 | 4:15 | Frontera | commandline | priority | 15.829 | full result with index.html | default |
13:23 | Akash | 13:24 | 0:01 | Expanse | commandline | compute | 0.000 | remote directory error | default |
13:35 | Phil | 16:30 | 2:55 | Expanse | commandline | compute | 9.700 | full result with index.html on Expanse | default |
14:56 | Phil | 16:22 | 1:26 | Expanse | QW | compute | 10.570 | full result with index.html as zip file download | Modified radius to 40km |
15:41 | Akash | 19:30 | 3:49 | Frontera | commandline | priority | 15.729 | full result with index.html on Frontera | Modify Input params per KM |
15:57 | Akash | 15:57 | 0:00 | Expanse | QW | compute | 0.084 | null-pointer exception | Modify Input params per KM |
21:02 | Phil | 23:38 | 2:36 | Expanse | commandline | compute | 12.000 | full results with index.html on Expanse | Modified source types and increased radius to 40km |
Successful Runs
Submit time | Operator | Complete Time | Makespan (H:M) | System | RunType | Queue | DataSize (GB) | Result | Config |
---|---|---|---|---|---|---|---|---|---|
12:25 | Akash | 16:40 | 4:15 | Frontera | commandline | priority | 15.829 | index.html | default |
13:35 | Phil | 16:30 | 2:55 | Expanse | commandline | compute | 9.700 | index.html | default |
14:56 | Phil | 16:22 | 1:26 | Expanse | QW | compute | 10.570 | index.html | Modified radius to 40km |
15:41 | Akash | 19:30 | 3:49 | Frontera | commandline | priority | 15.729 | index.html | Modify Input params per KM |
21:02 | Phil | 23:38 | 2:36 | Expanse | commandline | compute | 12.000 | index.html | Modified source types and increased radius to 40km |
Frontera Command line priority Queue
- index.html
- [/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-n14-s100000/results]
- index.html
- [/scratch1/10177/bhatthal/etas-results-tmp/frontera-comcat-northridge-m6.7-elastic-rebound-n14-s100000/result]
Expanse Command line compute Queue
Quakeworx Expanse
Northridge Event Info
Details about the Scenario Event used for ShakeOut 2024 testing:
- CI3144585
- M6.7
- Northridge, California, earthquake
- 1994-01-17
- 12:30:55 (UTC)
- 34.213°N
- 118.537°W
- 18.2 km depth
QW U3-ETAS using Northridge ID and default on App Page
Using the input page, specified a value in all input fields, typing in the default values in all boxes, and changed queue to compute, and submitted the job Last message: Setting job status to queued. Remote job ID: 34541195 Remote job submitted: 2024-10-17T19:16:37. Screen output from QW is below:
- App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6 --radius 20 --random-seed 123456789 --binary-output
This QW job is visible on Expanse as:
(base) squeue -u qwxdev JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON) 34541195 compute tapisjob qwxdev PD 0:00 14 (Priority) (base)
A ucerf3-etas job submitted as individual researcher is visible on Expanse as:
(base) squeue -u ux454496 JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON) 34540008 compute run.sh ux454496 PD 0:00 14 (Priority)
Results from QW Run
Three runs on 10/17 failed (Amit app and Fabio app) due to Expanse filesystem outage.
Second QW u3-etas command string
- App command: /expanse/lustre/projects/usc143/qwxdev/apps/expanse/rocky8.8/ucerf3-etas/02b30e5/osp_run.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --etas-k-cov 1.5 --finite-surf-shakemap --finite-surf-shakemap-min-mag 6 --max-point-src-mag 5 --radius 40 --random-seed 123456789 --binary-output
Proposed ETAS post-earthquake configuration for Northridge EQ
- u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --max-point-src-mag 6
Proposed Frontera Commands
- NUM_NODE=14
- NUM_SIM=100000
- cd $ETAS_SIM_DIR
- u3etas_comcat_event_config_builder.sh --event-id ci3144585 --num-simulations $NUM_SIM --days-before 7 --max-point-src-mag 6 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --reset-sects 1409,1410,1411,1412,1413 --hpc-site TACC_FRONTERA --nodes $NUM_NODE --hours 24 --queue normal --output-dir $ETAS_SIM_DIR/frontera-comcat-northridge-m6.7-n${NUM_NODE}-s$NUM_SIM
Results from Frontera Run
- First run without settings elastic rebound parameter (reset-sects): 4:14:43
- Second run with parameter set: 3:47:59
UCERF3-ETAS Config string
Example ucerf3 run points source for in 2022.
- u3etas_comcat_event_config_builder.sh --event-id nc73799091 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --hpc-site USC_CARC --nodes 36 --hours 24 --queue scec_hiprio
Example from Aug 2024
- u3etas_comcat_event_config_builder.sh --event-id ew1723003800 --num-simulations 100000 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --hpc-site USC_CARC --nodes 36 --hours 24 --queue scec --etas-k-cov 1.5
Example using a Random Number input
- u3etas_comcat_event_config_builder.sh --event-id ci38457511 --num-simulations 10 --days-before 7 --finite-surf-shakemap --finite-surf-shakemap-min-mag 5 --output-dir target/test_case_1 --random-seed 12345678