Difference between revisions of "CyberShake Database Server Requirements"

From SCECpedia
Jump to navigationJump to search
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
Below are a list of requirements for CyberShake database servers, hosted at CARC.
 
Below are a list of requirements for CyberShake database servers, hosted at CARC.
  
== Focal ==
+
== Moment ==
  
Focal is the user-facing CyberShake database server.  It is the database used by the CS Data Access Tool, as well as the database used for user queries.  It should be optimized for fast read access.
+
Moment is the production database for CyberShake, used to keep track of CyberShake runs, store intensity measures, and produce hazard curves.
  
 
=== Configuration ===
 
=== Configuration ===
Line 9: Line 9:
 
==== Hardware ====
 
==== Hardware ====
  
*At least 64 GB RAM
+
*128 GB RAM
 
*6-8 TB hard drive space, ideally SSD+redundancy (RAID 5?)
 
*6-8 TB hard drive space, ideally SSD+redundancy (RAID 5?)
  
Line 15: Line 15:
  
 
*Linux OS
 
*Linux OS
 +
*Well-known MySQL port (3306) externally accessible for read-only access
 +
*Writes can be restricted to CARC servers
 +
*Project filesystem doesn't need to be mounted once DB is set up
 
*MariaDB, current stable release (10.11.2 as of 3/7/23).
 
*MariaDB, current stable release (10.11.2 as of 3/7/23).
 
*Ideally, user scottcal would be able to edit the /etc/my.cnf.d/* MariaDB config files, and restart the DB server.  If not possible, please set the following values:
 
*Ideally, user scottcal would be able to edit the /etc/my.cnf.d/* MariaDB config files, and restart the DB server.  If not possible, please set the following values:
 
<pre>
 
<pre>
 
     innodb_file_per_table = 1
 
     innodb_file_per_table = 1
     innodb_buffer_pool_size = 52G
+
     innodb_buffer_pool_size = 102G
 
     innodb_buffer_pool_instances = 8
 
     innodb_buffer_pool_instances = 8
     query_cache_type = 1
+
     query_cache_type = 0
    query_cache_size = 64M
 
 
     tmp_table_size = 64M
 
     tmp_table_size = 64M
 
     max_heap_table_size = 64M
 
     max_heap_table_size = 64M
Line 30: Line 32:
 
*screen
 
*screen
  
== Moment ==
+
== Focal ==
  
Moment is the production database for CyberShake, used to keep track of CyberShake runs, store intensity measures, and produce hazard curves.
+
Focal is the user-facing CyberShake database server.  It is the database used by the CS Data Access Tool, as well as the database used for user queries.  It should be optimized for fast read access.
  
 
=== Configuration ===
 
=== Configuration ===
Line 38: Line 40:
 
==== Hardware ====
 
==== Hardware ====
  
*128 GB RAM
+
*At least 64 GB RAM
 
*6-8 TB hard drive space, ideally SSD+redundancy (RAID 5?)
 
*6-8 TB hard drive space, ideally SSD+redundancy (RAID 5?)
  
Line 44: Line 46:
  
 
*Linux OS
 
*Linux OS
 +
*Well-known MySQL port (3306) externally accessible
 
*MariaDB, current stable release (10.11.2 as of 3/7/23).
 
*MariaDB, current stable release (10.11.2 as of 3/7/23).
 
*Ideally, user scottcal would be able to edit the /etc/my.cnf.d/* MariaDB config files, and restart the DB server.  If not possible, please set the following values:
 
*Ideally, user scottcal would be able to edit the /etc/my.cnf.d/* MariaDB config files, and restart the DB server.  If not possible, please set the following values:
 
<pre>
 
<pre>
 
     innodb_file_per_table = 1
 
     innodb_file_per_table = 1
     innodb_buffer_pool_size = 102G
+
     innodb_buffer_pool_size = 52G
 
     innodb_buffer_pool_instances = 8
 
     innodb_buffer_pool_instances = 8
     query_cache_type = 0
+
     query_cache_type = 1
 +
    query_cache_size = 64M
 
     tmp_table_size = 64M
 
     tmp_table_size = 64M
 
     max_heap_table_size = 64M
 
     max_heap_table_size = 64M

Latest revision as of 20:30, 13 March 2023

Below are a list of requirements for CyberShake database servers, hosted at CARC.

Moment

Moment is the production database for CyberShake, used to keep track of CyberShake runs, store intensity measures, and produce hazard curves.

Configuration

Hardware

  • 128 GB RAM
  • 6-8 TB hard drive space, ideally SSD+redundancy (RAID 5?)

Software

  • Linux OS
  • Well-known MySQL port (3306) externally accessible for read-only access
  • Writes can be restricted to CARC servers
  • Project filesystem doesn't need to be mounted once DB is set up
  • MariaDB, current stable release (10.11.2 as of 3/7/23).
  • Ideally, user scottcal would be able to edit the /etc/my.cnf.d/* MariaDB config files, and restart the DB server. If not possible, please set the following values:
    innodb_file_per_table = 1
    innodb_buffer_pool_size = 102G
    innodb_buffer_pool_instances = 8
    query_cache_type = 0
    tmp_table_size = 64M
    max_heap_table_size = 64M
    innodb_log_file_size = 2G
  • SQLite, current stable release (3.41.0 as of 3/7/23).
  • screen

Focal

Focal is the user-facing CyberShake database server. It is the database used by the CS Data Access Tool, as well as the database used for user queries. It should be optimized for fast read access.

Configuration

Hardware

  • At least 64 GB RAM
  • 6-8 TB hard drive space, ideally SSD+redundancy (RAID 5?)

Software

  • Linux OS
  • Well-known MySQL port (3306) externally accessible
  • MariaDB, current stable release (10.11.2 as of 3/7/23).
  • Ideally, user scottcal would be able to edit the /etc/my.cnf.d/* MariaDB config files, and restart the DB server. If not possible, please set the following values:
    innodb_file_per_table = 1
    innodb_buffer_pool_size = 52G
    innodb_buffer_pool_instances = 8
    query_cache_type = 1
    query_cache_size = 64M
    tmp_table_size = 64M
    max_heap_table_size = 64M
    innodb_log_file_size = 2G
  • SQLite, current stable release (3.41.0 as of 3/7/23).
  • screen