Moment-carc configuration - Revision history

Scottcal: /* Initial database setup */

2024-05-03T05:02:00Z

Initial database setup

Scottcal: /* Initial database setup */

2024-05-02T21:55:13Z

Initial database setup

Scottcal at 21:17, 2 May 2024

2024-05-02T21:17:48Z

Scottcal: /* Network configuration */

2023-10-23T20:06:34Z

Network configuration

Scottcal: /* Network configuration */

2023-10-18T20:55:48Z

Network configuration

Scottcal: /* Database configuration */

2023-10-18T20:40:36Z

Database configuration

Scottcal: /* Database configuration */

2023-10-18T20:40:18Z

Database configuration

Scottcal: /* Software (installed by CARC) */

2023-10-18T20:40:00Z

Software (installed by CARC)

Scottcal: /* Hardware */

2023-10-18T20:39:39Z

Hardware

Scottcal: /* Hardware */

2023-10-18T20:38:59Z

Hardware

@@ Line 125: / Line 125: @@
 ! Table !! Data !! Size (index + data)
 |-
-! AR_Hazard_Curve_Points || all || 41.5 GB
+| AR_Hazard_Curve_Points || all || 41.5 GB
 |-
-! AR_Hazard_Curves || all || 1.3 GB
+| AR_Hazard_Curves || all || 1.3 GB
 |-
-! AR_Hazard_Datasets || all || <1 MB
+| AR_Hazard_Datasets || all || <1 MB
 |-
-! Atten_Rel_Metadata || all || <1 MB
+| Atten_Rel_Metadata || all || <1 MB
 |-
-! Atten_Rels || all || <1 MB
+| Atten_Rels || all || <1 MB
 |-
-! CyberShake_Runs || all || <1 GB
+| CyberShake_Runs || all || <1 GB
 |-
-! CyberShake_Site_Regions || all || <1 GB
+| CyberShake_Site_Regions || all || <1 GB
 |-
-! CyberShake_Site_Ruptures || all || 9.6 GB
+| CyberShake_Site_Ruptures || all || 9.6 GB
 |-
-! CyberShake_Site_Types || all || <1 MB
+| CyberShake_Site_Types || all || <1 MB
 |-
-! CyberShake_Sites || all || <1 MB
+| CyberShake_Sites || all || <1 MB
 |-
-! ERF_IDs || all || <1 MB
+| ERF_IDs || all || <1 MB
 |-
-! ERF_Metadata || all || <1 MB
+| ERF_Metadata || all || <1 MB
 |-
-! ERF_Probability_Models || all || <1 MB
+| ERF_Probability_Models || all || <1 MB
 |-
-! Hazard_Curve_Points || all || <1 GB
+| Hazard_Curve_Points || all || <1 GB
 |-
-! Hazard_Curves || all || <1 GB
+| Hazard_Curves || all || <1 GB
 |-
-! Hazard_Curves_old || none
+| Hazard_Curves_old || none
 |-
-! Hazard_Datasets || all || <1 MB
+| Hazard_Datasets || all || <1 MB
 |-
-! IM_Types || all || <1 MB
+| IM_Types || all || <1 MB
 |-
-! Mesh_Vsitop_Metadata || all || <1 MB
+| Mesh_Vsitop_Metadata || all || <1 MB
 |-
-! PeakAmplitudes
+| PeakAmplitudes
 |-
-! Points || none
+| Points || none
 |-
-! Rup_Var_Seeds || all || <1 GB
+| Rup_Var_Seeds || all || <1 GB
 |-
-! Rupture_Variation_Probability_Modifier || all || <1 MB
+| Rupture_Variation_Probability_Modifier || all || <1 MB
 |-
-! Rupture_Variation_Scenario_IDs || all || <1 MB
+| Rupture_Variation_Scenario_IDs || all || <1 MB
 |-
-! Rupture_Variation_Scenario_Metadata || all || <1 MB
+| Rupture_Variation_Scenario_Metadata || all || <1 MB
 |-
-! Rupture_Variations || all || 2.4 GB
+| Rupture_Variations || all || 2.4 GB
 |-
-! Ruptures || all || 2.2 GB
+| Ruptures || all || 2.2 GB
 |-
-! SGT_Variation_IDs || all || <1 MB
+| SGT_Variation_IDs || all || <1 MB
 |-
-! SGT_Variation_Metadata || all || <1 MB
+| SGT_Variation_Metadata || all || <1 MB
 |-
-! Studies || all || <1 MB
+| Studies || all || <1 MB
 |-
-! Time_Spans || all || <1 MB
+| Time_Spans || all || <1 MB
 |-
-! Velocity_Model_Metadata || all || <1 MB
+| Velocity_Model_Metadata || all || <1 MB
 |-
-! Velocity_Models || all || <1 MB
+| Velocity_Models || all || <1 MB
 |-
-! Vref_eff_Metadata || all || <1 MB
+| Vref_eff_Metadata || all || <1 MB
 |}

@@ Line 123: / Line 123: @@
 {| border="1" cellpadding="3"
-! Table !! Data
+! Table !! Data !! Size (index + data)
 |-
-! AR_Hazard_Curve_Points
+! AR_Hazard_Curve_Points || all || 41.5 GB
 |-
-! AR_Hazard_Curves
+! AR_Hazard_Curves || all || 1.3 GB
 |-
-! AR_Hazard_Datasets
+! AR_Hazard_Datasets || all || <1 MB
 |-
-! Atten_Rel_Metadata
+! Atten_Rel_Metadata || all || <1 MB
 |-
-! Atten_Rels
+! Atten_Rels || all || <1 MB
 |-
-! CyberShake_Runs
+! CyberShake_Runs || all || <1 GB
 |-
-! CyberShake_Site_Regions
+! CyberShake_Site_Regions || all || <1 GB
 |-
-! CyberShake_Site_Ruptures
+! CyberShake_Site_Ruptures || all || 9.6 GB
 |-
-! CyberShake_Site_Types
+! CyberShake_Site_Types || all || <1 MB
 |-
-! CyberShake_Sites
+! CyberShake_Sites || all || <1 MB
 |-
-! ERF_IDs
+! ERF_IDs || all || <1 MB
 |-
-! ERF_Metadata
+! ERF_Metadata || all || <1 MB
 |-
-! ERF_Probability_Models
+! ERF_Probability_Models || all || <1 MB
 |-
-! Hazard_Curve_Points
+! Hazard_Curve_Points || all || <1 GB
 |-
-! Hazard_Curves
+! Hazard_Curves || all || <1 GB
 |-
-! Hazard_Curves_old
+! Hazard_Curves_old || none
 |-
-! Hazard_Datasets
+! Hazard_Datasets || all || <1 MB
 |-
-! IM_Types
+! IM_Types || all || <1 MB
 |-
-! Mesh_Vsitop_Metadata
+! Mesh_Vsitop_Metadata || all || <1 MB
 |-
 ! PeakAmplitudes
 |-
-! Points
+! Points || none
 |-
-! Rup_Var_Seeds
+! Rup_Var_Seeds || all || <1 GB
 |-
-! Rupture_Variation_Probability_Modifier
+! Rupture_Variation_Probability_Modifier || all || <1 MB
 |-
-! Rupture_Variation_Scenario_IDs
+! Rupture_Variation_Scenario_IDs || all || <1 MB
 |-
-! Rupture_Variation_Scenario_Metadata
+! Rupture_Variation_Scenario_Metadata || all || <1 MB
 |-
-! Rupture_Variations
+! Rupture_Variations || all || 2.4 GB
 |-
-! Ruptures
+! Ruptures || all || 2.2 GB
 |-
-! SGT_Variation_IDs
+! SGT_Variation_IDs || all || <1 MB
 |-
-! SGT_Variation_Metadata
+! SGT_Variation_Metadata || all || <1 MB
 |-
-! Studies
+! Studies || all || <1 MB
 |-
-! Time_Spans
+! Time_Spans || all || <1 MB
 |-
-! Velocity_Model_Metadata
+! Velocity_Model_Metadata || all || <1 MB
 |-
-! Velocity_Models
+! Velocity_Models || all || <1 MB
 |-
-! Vref_eff_Metadata
+! Vref_eff_Metadata || all || <1 MB
 |}

← Older revision		Revision as of 21:17, 2 May 2024
Line 117:		Line 117:

	For SSH access, we would like support for logging in from endeavour.		For SSH access, we would like support for logging in from endeavour.
		+
		+	== Initial database setup ==
		+
		+	We will copy the following data from the database at moment.usc.edu to moment-carc:
		+
		+	{\| border="1" cellpadding="3"
		+	! Table !! Data
		+	\|-
		+	! AR_Hazard_Curve_Points
		+	\|-
		+	! AR_Hazard_Curves
		+	\|-
		+	! AR_Hazard_Datasets
		+	\|-
		+	! Atten_Rel_Metadata
		+	\|-
		+	! Atten_Rels
		+	\|-
		+	! CyberShake_Runs
		+	\|-
		+	! CyberShake_Site_Regions
		+	\|-
		+	! CyberShake_Site_Ruptures
		+	\|-
		+	! CyberShake_Site_Types
		+	\|-
		+	! CyberShake_Sites
		+	\|-
		+	! ERF_IDs
		+	\|-
		+	! ERF_Metadata
		+	\|-
		+	! ERF_Probability_Models
		+	\|-
		+	! Hazard_Curve_Points
		+	\|-
		+	! Hazard_Curves
		+	\|-
		+	! Hazard_Curves_old
		+	\|-
		+	! Hazard_Datasets
		+	\|-
		+	! IM_Types
		+	\|-
		+	! Mesh_Vsitop_Metadata
		+	\|-
		+	! PeakAmplitudes
		+	\|-
		+	! Points
		+	\|-
		+	! Rup_Var_Seeds
		+	\|-
		+	! Rupture_Variation_Probability_Modifier
		+	\|-
		+	! Rupture_Variation_Scenario_IDs
		+	\|-
		+	! Rupture_Variation_Scenario_Metadata
		+	\|-
		+	! Rupture_Variations
		+	\|-
		+	! Ruptures
		+	\|-
		+	! SGT_Variation_IDs
		+	\|-
		+	! SGT_Variation_Metadata
		+	\|-
		+	! Studies
		+	\|-
		+	! Time_Spans
		+	\|-
		+	! Velocity_Model_Metadata
		+	\|-
		+	! Velocity_Models
		+	\|-
		+	! Vref_eff_Metadata
		+	\|}

← Older revision		Revision as of 20:06, 23 October 2023
Line 112:		Line 112:

	We would like the following systems to be whitelisted:		We would like the following systems to be whitelisted:
		+	*USC VPN
		+	*opensha.usc.edu
		+	*Summit compute nodes

	For SSH access, we would like support for logging in from endeavour.		For SSH access, we would like support for logging in from endeavour.

@@ Line 109: / Line 109: @@
 == Network configuration ==
-To support access to the MariaDB server, we would like to enable access to the MySQL port (3306 by default) for external users.  We would prefer the database port be open to all external access.  If necessary, we could produce a whitelist of systems that require access.
+To support access to the MariaDB server, we would like to enable access to the MySQL port (3306 by default) for external users.
 For SSH access, we would like support for logging in from endeavour.

@@ Line 33: / Line 33: @@
 </pre>
-In terms of users, The functionality we want is read-only access for the user 'cybershk_ro' who can authenticate from anywhere, and read/write access for the user 'cybershk', from anywhere.  In our current setup, entries for these users in the USER_PRIVILEGES table are:
+In terms of users, The functionality we want is read-only access for the user 'cybershk_ro', and read/write access for the user 'cybershk'.  In our current setup, entries for these users in the USER_PRIVILEGES table are:
 {|

@@ Line 25: / Line 25: @@
 <pre>
 innodb_file_per_table = 1
-innodb_buffer_pool_size = 112G (should be 16 GB less than the available system memory)
+innodb_buffer_pool_size = 48G (should be 16 GB less than the available system memory)
 innodb_buffer_pool_instances = 8
 query_cache_type = 0

@@ Line 15: / Line 15: @@
 == Software (installed by CARC) ==
-*Latest production version of MariaDB (10.6.7 as of 4/27/22)
+*Latest production version of MariaDB (11.1.2 as of 10/18/23)
 == Software (installed by SCEC) ==

@@ Line 10: / Line 10: @@
 == Hardware ==
-*2 TB of local storage for the database (SSD, if possible).  Current database size on moment is ~1.5 TB, but some of that should be migrated to focal, as the intent is that focal serves as the access point for completed studies.
+*2 TB of local storage for the database (SSD, if possible).
 *Current system has 64 GB RAM