CSEP Hardware Inventory
From SCECpedia
Jump to navigationJump to searchThe SCEC CSEP Testing Center includes computers, networking, and storage capabilies hosted on USC campus. Below is an inventory of the current CSEP computing hardware, and storage capabilities at USC.
Contents
CSEP CURRENT HARDWARE (6/16)
- CSEP-OP
- 32 core Intel Xeon E5-2670@2.60GHZ
- 132Gb RAM
- 13.5 TB total available storage
- 10.0 TB Used
- CSEP-CERT
- 32 core Intel Xeon E5-2670@2.60GHZ
- 198Gb RAM
- 5.4 TB total available storage
- 5.0 TB used
- CSEP-DEVEL (Expanded to 4 nodes, same build)
- Four - 8 core Intel Xeon E5420 @ 2.50GHz
- 12Gb RAM
- 0.6 TB storage available
- CSEP-CANTERBURY (UPGRADED)
- 24 core Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz
- 132Gb RAM
- 16 TB storage available
- 2.2 TB used
- CSEP-Testing (WebServer)
- CSEP Data Archives Backup Storage
- 10TB disk storage containing second copy of CSEP home archives
- CSEP results server containing third copy of CSEP forecasts and evaluation results
Types of CSEP Data Storage
- CSEP maintains data archive that enable reproducibility of results. This is achieved by tagged version controlled software associated with each release, together with processing inputs (including raw and processed earthquake catalogs), forecast model inputs, forecast results, and forecast evaluation results. The amount of storage of each type depends on the authorotative earthquake catalogs used by a forecast, the forecast group (groups of comparable forecasts), the forecast type, and the evalutation tests. In 2010, a storage saving approach to saving earthquake catalogs, based on Subversion version controls software, which saves only the deltas between earthquake catalogs was introduced which significantly reduced the amount of storage required to save daily earthquake catalogs.
- Raw and post-processed catalogs
- Input parameters for forecasts models, forecasts
- Forecasts (as earthquake rates in regular meshes)
- Evaluation tests results
- Backup of CSEP home directory, providing a second copy of CSEP data sets
- CSEP results pages, providing a third copy of CSEP results
Storage estimate for new forecasts classes within SCEC Testing Center
- High-resolution 0.1degree Global testing region (per year)
- 1-day forecasts (KJSS)
- 5Tb (if using uncompressed original and HDF5 formats of forecasts)
- 750Gb (if using gzip-compressed original and HDF5 formats of forecasts)
- 1-year forecasts (KJSS, SHIFT_GSRM)
- 50Gb (if using uncompressed original and HDF5 formats of forecasts)
- 1-day forecasts (KJSS)
- CA testing region (per year)
- 30-minutes forecasts (ETAS, ETASPPE): 1.5Tb
- Disable publishing of forecasts to preserve storage on publishing server (only 22Gb disk space left as of 2014/03/03)
- Switch to event-based testing
- 30-minutes forecasts (ETAS, ETASPPE): 1.5Tb
Current Storage
Current CSEP usage is at 10TB on operational server, plus another 10TB backup. We are also introducing new experiments with models using synthetic catalogs, CSEP might start using much more storage based on how big and how many of synthetic catalogs models will be generating.
Storage Options
Direct attached, 60TB usable, $13.5k
Direct attached 220TB usable, $20.5k
1013757565306 The MD3460 is a SAS array - and you can connect more than one host to it however there is no switch so it is DAS via 12G sas. This array has onboard storage processors with mirrored cache and can be expanded to 60 drives plus up to 2 more 60 drive shelves. Note this array does require 20amp circuit. I have included 3yrs 4hour critical support installation and 96TB raw.
1023015889109 The MD1200 is a JBOD which uses a Perc Controller to attach to host server. This is for 12G servers only (so R720xd is good). This shelf of drives has 12x3.5" slots so I quoted two MD1200's for raw capacity of 96TB. You can chain more shelves together if you need to expand later. I have included 3yrs 4hour critical support installation and 96TB raw.
