CISM Evaluation Metrics - Revision history

Keithrd: /* List of Metrics */

2017-03-27T21:20:01Z

List of Metrics

Keithrd: /* List of Metrics */

2017-03-15T21:56:58Z

List of Metrics

Keithrd: /* List of Metrics */

2017-03-15T21:56:44Z

List of Metrics

Keithrd at 21:53, 15 March 2017

2017-03-15T21:53:48Z

Kmilner at 17:02, 13 April 2016

2016-04-13T17:02:25Z

Kmilner at 16:59, 13 April 2016

2016-04-13T16:59:25Z

Kmilner at 16:58, 13 April 2016

2016-04-13T16:58:10Z

Kmilner at 16:56, 13 April 2016

2016-04-13T16:56:44Z

Kmilner: Created page with "List of metrics/regression tests for all catalogs as a way to compare them, ensure that RSQSim is behaving the same on different machines, and to compare/validate results from..."

2016-04-13T16:55:01Z

Created page with "List of metrics/regression tests for all catalogs as a way to compare them, ensure that RSQSim is behaving the same on different machines, and to compare/validate results from..."

New page

List of metrics/regression tests for all catalogs as a way to compare them, ensure that RSQSim is behaving the same on different machines, and to compare/validate results from updated versions of RSQSim:

* Magnitude-Frequency distribution
** Whole-system
*** [http://opensha.usc.edu/ftp/kmilner/ucerf3/2013_05_10-ucerf3p3-production-10runs/fss_mfd_plots/2013_05_10-ucerf3p3-production-10runs_COMPOUND_SOL_MFD_RELM_TESTING_Region.pdf UCERF3 example]
** Region- and fault-specific (for more complex models)
• Inter-event time and distance distributions
• Scaling relations
o Magnitude-area
o Slip-area
o Stress drop - magnitude
• Rupture speed
• Recurrence time distributions for event sets of interest

 Most of these are already in plotEqs(), one of the RSQSim post-processing functions that Keith includes with RSQSim, but we probably want to do regional tests that focus on particular sites or faults as well.
 We should create a new function or package of them, similar to plotEqs() that does all the tests and reports/plots the results.

Additional tests and ways of comparing RSQSim catalogs, to both simulated and real data:

 We also want some measure of the divergence of these catalogs when small changes are made to the parameters, as well as the number of cores the simulations are run on.
o Lyapunov exponent
 Set up a reference rupture set or catalog.
 Compare regional RSQSim MFD’s to UCERF3’s on-fault MFD’s.

@@ Line 17: / Line 17: @@
 * Recurrence time distributions for event sets of interest
 * Rupture jumping
 == RSQSim notes ==

@@ Line 14: / Line 14: @@
 ** Stress drop - magnitude
 * Rupture speed
-* Single (first large?) event characterstics
+* Single (first large?) event characteristics
 * Recurrence time distributions for event sets of interest
 * Rupture jumping

@@ Line 14: / Line 14: @@
 ** Stress drop - magnitude
 * Rupture speed
 * Recurrence time distributions for event sets of interest
 * Rupture jumping

@@ Line 15: / Line 15: @@
 * Rupture speed
 * Recurrence time distributions for event sets of interest
 == RSQSim notes ==

@@ Line 5: / Line 5: @@
 * Magnitude-Frequency distribution
 ** Whole-system
-*** [http://opensha.usc.edu/ftp/kmilner/ucerf3/2013_05_10-ucerf3p3-production-10runs/fss_mfd_plots/2013_05_10-ucerf3p3-production-10runs_COMPOUND_SOL_MFD_RELM_TESTING_Region.pdf UCERF3 example]: Gray is off fault and on fault sub-seismogenic, Blue is on fault supra-seismogenic, Red is total
+*** [http://opensha.usc.edu/ftp/kmilner/ucerf3/2013_05_10-ucerf3p3-production-10runs/fss_mfd_plots/2013_05_10-ucerf3p3-production-10runs_COMPOUND_SOL_MFD_RELM_TESTING_Region.pdf UCERF3 example]: Gray is off fault and on fault sub-seismogenic, Blue is on fault supra-seismogenic, Red is total. These are nucleation MFDs (as opposed to participation)
 ** Region- and fault-specific (for more complex models)
 *** [http://opensha.usc.edu/ftp/kmilner/ucerf3/2013_05_10-ucerf3p3-production-10runs/parent_sect_mfds/participation_cumulative/ UCERF3 fault participation MFD examples]

@@ Line 1: / Line 1: @@
 List of metrics/regression tests for all catalogs as a way to compare them, ensure that RSQSim is behaving the same on different machines, and to compare/validate results from updated versions of RSQSim:
@@ Line 14: / Line 16: @@
 * Recurrence time distributions for event sets of interest
-RSQSim notes:
+== RSQSim notes ==
 * Most of these are already in plotEqs(), one of the RSQSim post-processing functions that Keith includes with RSQSim, but we probably want to do regional tests that focus on particular sites or faults as well.
 * We should create a new function or package of them, similar to plotEqs() that does all the tests and reports/plots the results.

@@ Line 14: / Line 14: @@
 * Recurrence time distributions for event sets of interest
-	Most of these are already in plotEqs(), one of the RSQSim post-processing functions that Keith includes with RSQSim, but we probably want to do regional tests that focus on particular sites or faults as well.
+RSQSim notes:
-	We should create a new function or package of them, similar to plotEqs() that does all the tests and reports/plots the results.
+* Most of these are already in plotEqs(), one of the RSQSim post-processing functions that Keith includes with RSQSim, but we probably want to do regional tests that focus on particular sites or faults as well.
+* We should create a new function or package of them, similar to plotEqs() that does all the tests and reports/plots the results.
 Additional tests and ways of comparing RSQSim catalogs, to both simulated and real data:
-	We also want some measure of the divergence of these catalogs when small changes are made to the parameters, as well as the number of cores the simulations are run on.
+* We also want some measure of the divergence of these catalogs when small changes are made to the parameters, as well as the number of cores the simulations are run on.
-o	Lyapunov exponent
+** Lyapunov exponent
-	Set up a reference rupture set or catalog.
+* Set up a reference rupture set or catalog.
-	Compare regional RSQSim MFD’s to UCERF3’s on-fault MFD’s.
+* Compare regional RSQSim MFD’s to UCERF3’s on-fault MFD’s.

@@ Line 3: / Line 3: @@
 * Magnitude-Frequency distribution
 ** Whole-system
-*** [http://opensha.usc.edu/ftp/kmilner/ucerf3/2013_05_10-ucerf3p3-production-10runs/fss_mfd_plots/2013_05_10-ucerf3p3-production-10runs_COMPOUND_SOL_MFD_RELM_TESTING_Region.pdf UCERF3 example]
+*** [http://opensha.usc.edu/ftp/kmilner/ucerf3/2013_05_10-ucerf3p3-production-10runs/fss_mfd_plots/2013_05_10-ucerf3p3-production-10runs_COMPOUND_SOL_MFD_RELM_TESTING_Region.pdf UCERF3 example]: Gray is off fault and on fault sub-seismogenic, Blue is on fault supra-seismogenic, Red is total
 ** Region- and fault-specific (for more complex models)
-•	Inter-event time and distance distributions
+*** [http://opensha.usc.edu/ftp/kmilner/ucerf3/2013_05_10-ucerf3p3-production-10runs/parent_sect_mfds/participation_cumulative/ UCERF3 fault participation MFD examples]
-•	Scaling relations
+* Inter-event time and distance distributions
-o	Magnitude-area
+* Scaling relations
-o	Slip-area
+** Magnitude-area
-o	Stress drop - magnitude
+** Slip-area
-•	Rupture speed
+** Stress drop - magnitude
-•	Recurrence time distributions for event sets of interest
+* Rupture speed
 	Most of these are already in plotEqs(), one of the RSQSim post-processing functions that Keith includes with RSQSim, but we probably want to do regional tests that focus on particular sites or faults as well.