Difference between revisions of "CSEP 2 CATALOG FORMAT"

From SCECpedia
Jump to navigationJump to search
Line 2: Line 2:
  
 
== Summary ==
 
== Summary ==
 +
The general philosophy is that the file type should be human readable and easy to use for both researchers and developers. We should support multiple readers to ingest various catalog formats into the PyCSEP codebase.
 +
 
The catalog will initially be defined as an ASCII .csv format where each row corresponds to a single event. This file will have the following headers:<br><br>
 
The catalog will initially be defined as an ASCII .csv format where each row corresponds to a single event. This file will have the following headers:<br><br>
 
<code>
 
<code>
Line 20: Line 22:
 
* comcat: eg., 'ci0000000'
 
* comcat: eg., 'ci0000000'
 
* ucerf3: eg., fault-system solution of supraseismogenic
 
* ucerf3: eg., fault-system solution of supraseismogenic
 +
 +
This format can be easily extended to additional file types, including more advanced storage types like HDF5 or databases.
  
 
== Catalog Format ==
 
== Catalog Format ==

Revision as of 06:50, 19 May 2020

Summary

The general philosophy is that the file type should be human readable and easy to use for both researchers and developers. We should support multiple readers to ingest various catalog formats into the PyCSEP codebase.

The catalog will initially be defined as an ASCII .csv format where each row corresponds to a single event. This file will have the following headers:

longitude, latitude, M, epoch_time (time in millisecond since Unix epoch in GMT), depth, +x-offset, +y-offset, catalog_id, event_id

longitude: longitude in decimal degrees [-180,180]
latitude: latitude in decimal degrees [-90,90]
M: magnitude arbitrary units
epoch_time: time since unix epoch [-inf, inf]
depth: hypocenter depth in (km) [0, inf]
+x-offset: east-west offset from lon/lat in (m) [-inf, inf]
+y-offset: north-south offset from lon/lat in (m) [inf,inf]
catalog_id: indicates type of catalog

  • observed: -1
  • simulated: [0,n_cat-1]

event_id: used to indentify events beyond the basic properties

  • comcat: eg., 'ci0000000'
  • ucerf3: eg., fault-system solution of supraseismogenic

This format can be easily extended to additional file types, including more advanced storage types like HDF5 or databases.

Catalog Format

Catalog properties:

1. User friendly (easy for non-developers to work with)
2. Self-consistent and Independent
3. Extensible
4. Easy represented in other formats

Considerations:

1. File format
2. Catalogs per File
3. Contents of File


Example Catalog

lon,lat,M,epoch_time,depth,+x-offset,+y-offset,catalog_id,event_id -117.43017,35.616665,4.73,1562383355630,9.35,0.0,0.0,-1,ci37219500
-117.7365,35.891,4.64,1562383368300,9.1,0.0,0.0,-1,ci37219156
-117.617836,35.803165,4.84,1562383430720,11.44,0.0,0.0,-1,ci37219164
-117.67083,35.86067,4.61,1562383527970,10.32,0.0,0.0,-1,ci37219172
-117.72583,35.913834,4.5,1562383627010,8.0,0.0,0.0,-1,ci37219180
-117.431335,35.530334,4.57,1562383631370,3.83,0.0,0.0,-1,ci37219564
-117.7115,35.902832,4.51,1562383772080,3.18,0.0,0.0,-1,ci38457583
-117.35817,35.556667,4.49,1562383825050,8.71,0.0,0.0,-1,ci38457591
-117.73033,35.890335,4.17,1562383966660,6.15,0.0,0.0,-1,ci38457599
-117.505165,35.714832,4.13,1562383989850,1.74,0.0,0.0,-1,ci37219692
-117.466835,35.65217,4.09,1562384105420,1.97,0.0,0.0,-1,ci38457607
-117.73383,35.902832,4.35,1562384176460,7.27,0.0,0.0,-1,ci38457615
-117.722,35.892334,3.98,1562384498650,7.87,0.0,0.0,-1,ci38457639
-117.693,35.9045,3.96,1562384657670,6.44,0.0,0.0,-1,ci37219924
-117.47034,35.6805,4.26,1562384786870,6.85,0.0,0.0,-1,ci38457679
-117.7495,35.901165,5.5,1562384873420,5.04,0.0,0.0,-1,ci38457687
-117.69,35.9025,3.98,1562384904660,0.5,0.0,0.0,-1,ci37220300
-117.700165,35.9035,4.97,1562385059710,8.26,0.0,0.0,-1,ci38457703
-117.6875,35.9055,4.06,1562385320020,8.43,0.0,0.0,-1,ci38457735
-117.66133,35.869,4.31,1562385470900,7.21,0.0,0.0,-1,ci37421229
-117.70883,35.917,3.9,1562385949900,2.34,0.0,0.0,-1,ci37221188
-117.37383,35.578,3.79,1562385974580,5.91,0.0,0.0,-1,ci38457887
-117.52167,35.55517,4.68,1562386024570,5.64,0.0,0.0,-1,ci38457775
-117.58083,35.777668,3.85,1562386249040,10.41,0.0,0.0,-1,ci37221580
-117.69067,35.902332,3.83,1562386262210,7.27,0.0,0.0,-1,ci37221588
-117.72283,35.887333,3.87,1562386338850,9.17,0.0,0.0,-1,ci37221620
-117.6145,35.584667,4.8,1562386387080,9.73,0.0,0.0,-1,ci38457815
-117.402664,35.604168,3.84,1562386460800,6.72,0.0,0.0,-1,ci37221644
-117.49067,35.6795,3.74,1562386471370,0.91,0.0,0.0,-1,ci37221708
-117.68483,35.910168,5.44,1562386735790,7.41,0.0,0.0,-1,ci38457847
-117.6175,35.785,4.49,1562386755470,10.6,0.0,0.0,-1,ci37221932
-117.717,35.885,3.83,1562386794940,4.9,0.0,0.0,-1,ci38457855