CSEP Test Results - Revision history

Maechlin: /* One month Results */

2017-11-28T01:08:12Z

One month Results

Maechlin: /* One month Results */

2017-11-27T04:34:18Z

One month Results

Maechlin: /* One month Results */

2017-11-27T04:33:13Z

One month Results

Maechlin at 04:31, 27 November 2017

2017-11-27T04:31:13Z

Fsilva: /* Source Codes */

2017-11-10T17:32:57Z

Source Codes

Maechlin at 22:38, 9 November 2017

2017-11-09T22:38:53Z

Maechlin: /* N-Test Results */

2017-11-08T06:15:55Z

N-Test Results

Maechlin at 06:13, 8 November 2017

2017-11-08T06:13:20Z

Maechlin: /* one-day-models N-Test Results */

2017-11-07T04:56:19Z

one-day-models N-Test Results

Maechlin: /* Format evaluation */

2017-11-07T04:56:02Z

Format evaluation

@@ Line 11: / Line 11: @@
 The xml result file format changed during the course of the test run, and the scripts have to check the results date to identify which format the results are in.
-== One month Results ==
+== One Month Results ==
-We have extracted the first month of results to confirm that the output files are properly formatted.
+We have extracted the first week of results to confirm that the output files are properly formatted.
-*[http://hypocenter.usc.edu/research/CSEP/one_day_models_ntest_results.csv August 2007 ETAS and STEP results in CSV format]
+*[http://hypocenter.usc.edu/research/CSEP/one_day_step_etas_ntest_short.csv August 2007 Week 1 ETAS and STEP results in CSV format]
 == Source Codes ==

← Older revision		Revision as of 04:34, 27 November 2017
Line 12:		Line 12:

	== One month Results ==		== One month Results ==
		+	We have extracted the first month of results to confirm that the output files are properly formatted.
	*[http://hypocenter.usc.edu/research/CSEP/one_day_models_ntest_results.csv August 2007 ETAS and STEP results in CSV format]		*[http://hypocenter.usc.edu/research/CSEP/one_day_models_ntest_results.csv August 2007 ETAS and STEP results in CSV format]

@@ Line 12: / Line 12: @@
 == One month Results ==
-*[http://hypocenter.usc.edu/research/CSEP/one_day_models_n_test_results.csv August 2007 ETAS and STEP results in CSV format]
+*[http://hypocenter.usc.edu/research/CSEP/one_day_models_ntest_results.csv August 2007 ETAS and STEP results in CSV format]
 == Source Codes ==

@@ Line 1: / Line 1: @@
 SCEC is developing software tools for extracting CSEP test results from the CSEP data archives.
-== Purpose ==
+== Purpose Of Scripts ==
-CSEP one-day-model test results are posted in a series of files, one every day of operation. We want a script that will open the daily files, extract some information, and then print it in a csv table summary form. We will develop tools working with one-day-models because those have been running the longest.
+CSEP one-day-model test results are posted in a series of files, one every day of operation. We want a script that will open the daily files, extract some information, and then print it in a comma separated values (csv) ASCII file form. We are starting with one-day-models because those have been running the longest.
-== SCEC-natural-laboratory/one-day-models/results N-Test Result  ==
+== one-day-models ==
-Testing center has one day model results from 2007-03-01 through 2017-03-03. The xml result file format changed during the course of the test run, and the scripts have to check the results date to identify which format the results are in.
+Forecast models in a forecast group use the same input catalogs, and run the same evaluation tests. The SCEC CSEP testing center has one day model results from
-*[http://hypocenter.usc.edu/research/CSEP/one-day-models-n-test_results.csv CSEP Test Results in csv format file (242Kb)]
+*2007-08-01 through 2017-03-03.
-== Format Updates ==
+To support the full date range, we must handle the changes in XML result file format.
-We've updated the csv output format, with the goal of reducing repeated information. The CSV header includes test_name, start_date.
+The xml result file format changed during the course of the test run, and the scripts have to check the results date to identify which format the results are in.
-<pre>
+== One month Results ==
-#testName: NTest
+*[http://hypocenter.usc.edu/research/CSEP/one_day_models_n_test_results.csv August 2007 ETAS and STEP results in CSV format]
 == Source Codes ==
 * [https://github.com/SCECcode/CSEPcode CSEP Code Repository]

@@ Line 22: / Line 22: @@
 == Source Codes ==
-*[https://github.com/SCECcode/CSEPcode CSEPcode Repository]
 == Related Entries ==
 *[[CSEP]]
 *[[Software]]

@@ Line 5: / Line 5: @@
 == SCEC-natural-laboratory/one-day-models/results N-Test Result  ==
-Testing center has one day model results from 2007-03-01 through 2017-03-03. These results are preliminary. The xml result file format changed during the course of the test run, and the scripts have built-in date format checks.
+Testing center has one day model results from 2007-03-01 through 2017-03-03. The xml result file format changed during the course of the test run, and the scripts have to check the results date to identify which format the results are in.
-*[http://hypocenter.usc.edu/research/CSEP/one-day-models-n-test.csv CSEP Test Results in csv format file (200Kb)]
+*[http://hypocenter.usc.edu/research/CSEP/one-day-models-n-test_results.csv CSEP Test Results in csv format file (242Kb)]
-== Example N-Test Result Format ==
+== Format Updates ==
-For testing dates 02 March 2010 through 04 March 2017, we can find a AllModelsSummary file. We scan the directories, and produce the csv file below, with about 2500 rows of N-test results.
+We've updated the csv output format, with the goal of reducing repeated information. The CSV header includes test_name, start_date.
-*[http://hypocenter.usc.edu/research/CSEP/one-day-models_n-test_2010March02_2017March4.csv csv format file (200Kb)]
+<pre>
+#testName: NTest
-== Format evaluation ==
+#startDate: 2007-08-01
-We are refining the format for the csv file.
+#endDate: 2017-03-03
-# Comment header with information about the report, once per file
+#result_dir: /home/csep/operations/SCEC-natural-laboratory/one-day-models/results
-# columnHeader1,columnHeader2,columnHeader3, before any data
+#number_of_expected_results: 3503
-# one row of data, one for each test date:time
+#number_of_found_results: 3417
+resultDate	modelName	eventCount	delta1	delta2	eventCountForecast
-For testing dates 2016-01-01 through 2017-01-01, we generate the comma separated values (csv) file posted below.
+</pre>
 == Source Codes ==

← Older revision		Revision as of 04:56, 7 November 2017
Line 7:		Line 7:

	== Format evaluation ==		== Format evaluation ==
		+	We are refining the format for the csv file.
		+	# Comment header with information about the report, once per file
		+	# columnHeader1,columnHeader2,columnHeader3, before any data
		+	# one row of data, one for each test date:time
		+
		+	For testing dates 2016-01-01 through 2017-01-01, we generate the comma separated values (csv) file posted below.
		+	*[http://hypocenter.usc.edu/research/CSEP/one-day-models_n-test_2016.csv 2016 Ntest Results]

	== one-day-models N-Test Results ==		== one-day-models N-Test Results ==