BBP Flat File Format - Revision history

Fsilva: /* Assumptions */

2017-08-18T15:20:16Z

Assumptions

Fsilva: /* Assumptions */

2017-08-18T15:17:59Z

Assumptions

Fsilva at 15:16, 18 August 2017

2017-08-18T15:16:31Z

Fsilva: /* Assumptions */

2017-08-17T17:04:42Z

Assumptions

Fsilva at 22:09, 16 August 2017

2017-08-16T22:09:53Z

Fsilva at 21:58, 16 August 2017

2017-08-16T21:58:42Z

Fsilva: Created page with "This page contains information regarding the BBP Flat File Format, used to collect data from BBP simulations. * [http://hypocenter.usc.edu/research/bbp/NHERI_DraftFlatfileFie..."

2017-08-16T21:29:08Z

Created page with "This page contains information regarding the BBP Flat File Format, used to collect data from BBP simulations. * [http://hypocenter.usc.edu/research/bbp/NHERI_DraftFlatfileFie..."

New page

This page contains information regarding the BBP Flat File Format, used to collect data from BBP simulations.

* [http://hypocenter.usc.edu/research/bbp/NHERI_DraftFlatfileFields_Explanation_20170206.xlsx File format guide]
* [http://hypocenter.usc.edu/research/bbp/bbp-summary-file-16-aug-2017.csv Sample flat file]

The sample flat file above contains data for 50 realizations of the 1994 Northridge earthquake. It uses the GP method and includes data for all stations.

@@ Line 31: / Line 31: @@
 * Velocity Structure Model : Region for the simulation (e.g. LABasin)
 * Greens Function File Name: Comes directly from Rob's naming of the GFs (methods not using GFs have a "NA")
-* Vs30 : Need information on how to calculate it
+* Vs30 : Need information on how to calculate it. Is this just the value from the velocity profile corresponding to 30m?
 * Recording Station Name, Station Elevation : Not available, need to be provided as indicated below
-* Number of Unique Components : 1 for ExSIM, 3 for the others
+* Number of Unique Components : 1 for ExSIM, 3 for the other methods
-* File Name : BBP uses 3-component BBP files so only 1 field needed
+* File Name : BBP uses 3-component BBP files so only 1 file needed for all components
 * LUF/HUF/LUP/HUP : Need to be checked (data coming from the station file, but not sure if correct)
 * Arias Durations : For which component? Should we have 3 sets (5-75, 5-95, total) one for each component?
@@ Line 46: / Line 46: @@
 * For the LUF/HUF/LUP/HUP, there's a question of observations (where the recording equipment dictates some of these values) versus simulations (where modelers tell us what their methods can do). How do we incorporate this concept? Also, this may be relevant when we consider scenario simulations.
 * Should we add a "Method" field to include the simulation method used to generate the data?

← Older revision		Revision as of 15:17, 18 August 2017
Line 45:		Line 45:
	* Should we add a DT field for the GFs?		* Should we add a DT field for the GFs?
	* For the LUF/HUF/LUP/HUP, there's a question of observations (where the recording equipment dictates some of these values) versus simulations (where modelers tell us what their methods can do). How do we incorporate this concept? Also, this may be relevant when we consider scenario simulations.		* For the LUF/HUF/LUP/HUP, there's a question of observations (where the recording equipment dictates some of these values) versus simulations (where modelers tell us what their methods can do). How do we incorporate this concept? Also, this may be relevant when we consider scenario simulations.
		+	* Should we add a "Method" field to include the simulation method used to generate the data?

@@ Line 25: / Line 25: @@
 * Simulation Workflow Description: BBP modules used in the workflow, separated by a '/'
-* Site Effects Model: Currently GP2014 or None
+* Site Effects Model: Currently "GP2014" or "None"
 * Realization: Added a realization field to identify from which realization the data comes from
 * Number of SRC files: This field indicates how many times the following 18 fields are repeated (once for each SRC file)

@@ Line 22: / Line 22: @@
 * TBD - To Be Determined
-Also, the following assumptions were made on these fields:
+The following assumptions were made on these fields:
 * Simulation Workflow Description: BBP modules used in the workflow, separated by a '/'
 * Site Effects Model: Currently GP2014 or None
+* Realization: Added a realization field to identify from which realization the data comes from
 Additionally:
-* The missing information needed in the General category (Fault ID/Fault Name/etc) could be provided either as a separate file that would server as input to the flat file generation script, or as additional keys to the SRC file. In the second case, they would be ignored by the BBP and the script would check for their presence before writing "TBD" or "NA" to the file.
+* The missing information needed in the General category (Fault ID/Fault Name/etc), Recording Station Name, could be provided either as a separate file that would server as input to the flat file generation script, or as additional keys to the SRC file. In the second case, they would be ignored by the BBP and the script would check for their presence before writing "TBD" or "NA" to the file.

← Older revision		Revision as of 22:09, 16 August 2017
Line 24:		Line 24:
	Also, the following assumptions were made on these fields:		Also, the following assumptions were made on these fields:

−	*	+	* Simulation Workflow Description: BBP modules used in the workflow, separated by a '/'
		+	* Site Effects Model: Currently GP2014 or None
		+
		+
		+	Additionally:
		+
		+	* The missing information needed in the General category (Fault ID/Fault Name/etc) could be provided either as a separate file that would server as input to the flat file generation script, or as additional keys to the SRC file. In the second case, they would be ignored by the BBP and the script would check for their presence before writing "TBD" or "NA" to the file.

← Older revision		Revision as of 21:58, 16 August 2017
Line 5:		Line 5:

	The sample flat file above contains data for 50 realizations of the 1994 Northridge earthquake. It uses the GP method and includes data for all stations.		The sample flat file above contains data for 50 realizations of the 1994 Northridge earthquake. It uses the GP method and includes data for all stations.
		+
		+	==== Export Script ====
		+
		+	The current script only works for simulations performed at the cluster, it requires (a small) change to be able to generate a flat file for a single BBP simulation. Here's the current usage:
		+
		+	$ export_bbp_cluster_simulation.py -i <cluster_top_level_input_directory> -o <output_directory> [-c]
		+
		+	The top level cluster directory is the same directory provided to the scripts that generated the cluster simulation (bbp_hpcc_validation.py). The output directory will be created if needed and will contain the output flat file (currently named bbl-summary-file.csv). The optional -c parameter causes the script to copy the time series from the various realizations into subdirectories inside the output directory. This can be used to generate a package containing the simulation parameters and the time series that can be distributed.
		+
		+	==== Assumptions ====
		+
		+	In the produced flat file, linked above, the following abbreviations were used:
		+
		+	* NA - Not Available
		+	* TBC - To Be Calculated
		+	* TBD - To Be Determined
		+
		+	Also, the following assumptions were made on these fields:
		+
		+	*