Difference between revisions of "Computational Result Review Process"

From SCECpedia
Jump to navigationJump to search
Line 1: Line 1:
We define three states through which large scale computational results increasing in confidence.
+
We define various states through which large scale computational results are migrated. Each stage indicates and increasing level of confidence in the correctness of the results.
  
 
== Define Data Set ==
 
== Define Data Set ==
Define which data set under consideration. For example, a hazard curve that is part of a study, might be considered complete, even if the full study is not complete.
+
To begin, we define the data set under consideration. For example, a hazard curve that is part of a study, might be considered, even if the full study is not complete. A single hazard curve could be in one state, while full study can be in another state.
 +
 
 +
== Started ==
 +
Data set calculations have begun.
  
 
== Preliminary ==
 
== Preliminary ==
Just created but complete
+
The data set calculations are completed, and complete results are believed to exist.
  
 
== Reviewed ==
 
== Reviewed ==
Data-set specific, standardized, defined, checks ready for use internal researchers. For example, for a hazard curve, review checks might include:
+
Data-set specific, standardized, defined, checks ready for use internal researchers.  
* no Nan
+
 
 +
For example, for a hazard curve, review checks might include:
 +
* No Nan
 +
* No zero entries (for data sets where non-zero entries are not defined)
 
* No amplitudes beyond 5g
 
* No amplitudes beyond 5g
* all rupture variations have amplitudes for all components
+
* All rupture variations have amplitudes for all components
* no zero entries
 
  
At study level:
+
When we consider the full study as the data set under consideration, we might define the following rules:
* all hazard curves reviewed state, plus
+
* all component hazard curves are in the reviewed state, plus
* new hazard maps
+
* Calculate new hazard maps
* ratio maps between new results and 14.2
+
* Calculate ratio maps between new results and 14.2
  
 
== Publishable ==
 
== Publishable ==

Revision as of 20:56, 20 May 2015

We define various states through which large scale computational results are migrated. Each stage indicates and increasing level of confidence in the correctness of the results.

Define Data Set

To begin, we define the data set under consideration. For example, a hazard curve that is part of a study, might be considered, even if the full study is not complete. A single hazard curve could be in one state, while full study can be in another state.

Started

Data set calculations have begun.

Preliminary

The data set calculations are completed, and complete results are believed to exist.

Reviewed

Data-set specific, standardized, defined, checks ready for use internal researchers.

For example, for a hazard curve, review checks might include:

  • No Nan
  • No zero entries (for data sets where non-zero entries are not defined)
  • No amplitudes beyond 5g
  • All rupture variations have amplitudes for all components

When we consider the full study as the data set under consideration, we might define the following rules:

  • all component hazard curves are in the reviewed state, plus
  • Calculate new hazard maps
  • Calculate ratio maps between new results and 14.2

Publishable

Ready for use by external researchers.

Related Entries