Difference between revisions of "Broadband Server"

From SCECpedia
Jump to navigationJump to search
 
(18 intermediate revisions by 3 users not shown)
Line 5: Line 5:
 
If you encounter any problems with the SCEC Broadband Server, or to request access, please contact software@scec.org.
 
If you encounter any problems with the SCEC Broadband Server, or to request access, please contact software@scec.org.
  
 +
== Proposed Virtualized Server Software Stack ==
 +
To facilitate migrating our broadband server configuration, we will use a virtualized version of the system, with a host OS the runs the hypervisor, and a guest OS which we use to perform software development.
 +
[[Image:Guest_host.png|left|250px]]
 +
Based on our use of KVM, the resulting system will be considered a type 2 hypervisor system.
 +
[[Image:Kvm_stack.jpg|left|250px]]
  
== Checks During First Login ==
+
== Host OS that include KVM ==
 +
We want a recent version of CentOS as the Host OS
 +
* CentOS 8.2 (release date 6/2020)
  
Your account has already been configured, but what follows are some checks to verify that everything is properly configured. First, ssh to the system using the hostname and login that we provided to you.  
+
== Guest OS for Broadband Server Configuration ==
 +
We want a recent version of Ubuntu as the Guest OS. This should have a full set of software developer tools.
 +
* Ubuntu 20.04 LTS (release date August 2020)
  
 +
== Configuration Details ==
  
Change your password from the default we assigned to one of your choosing with this command:
+
* SSH access
 +
* Accounts set up via LDAP server (Edric)
  
<pre>
+
== Software Stack ==
$ passwd
 
</pre>
 
  
 +
We would like these gnu compilers installed which are required to compile the Broadband Platform components:
  
Then, verify that your PYTHONPATH environment variable is set with the command:
+
* gcc and gfortran (9.3.0)
 +
* fftw libraries (3.3.4 or later)
  
<pre>
 
$ env | grep PYTHONPATH
 
</pre>
 
  
You should see the following line displayed:
+
We would like the Python3 software installed using the Anaconda distribution tool. These are needed for running the Broadband Platform:
  
<pre>
+
* Python3 (3.8.2)
PYTHONPATH=/home/broadband-01/$USER/11.2.2/bbp_2g/comps
+
* NumPy (1.17.4)
</pre>
+
* SciPy (1.3.3)
 +
* Matplotlib (3.1.2)
 +
* PyProj (2.5.0)
 +
* Numba (0.48.0)
  
 +
Other tools/packages that should be installed on the system are:
  
Verify that your PATH environment variable includes the correct python interpreter with the command:
+
* wget
 +
* automake/autoconf
 +
* awk/sed
 +
* emacs
 +
* git
  
<pre>
+
== Filesystems ==
$ which python
 
</pre>
 
  
You should see the following line displayed:
+
These are local filesystems on the Broadband Server and they should be backed up periodically.
  
<pre>
+
* /home/broadband-01 2.7T (2.5T Used, 0.2T Available)
/usr/bin/python
+
* /home/broadband-02 3.6T (3.0T Used, 0.6T Available)
</pre>
 
  
 +
These are remote filesystems available from the Broadband Server, needed for Broadband work:
  
Finally, verify that the checksums match in your copy of the Broadband platform with these commands (replace "$USER" with the userid we assigned to you):
+
* /home/hypocenter-01 7.3T (2.6T Used, 4.8T Available, hypocenter.usc.edu:/hypocenter-01)
 
+
* /home/rcf-104 286T (248T Used, 38T Available, almaak-07.usc.edu:/export/samfs-scec0/rcf-104)
<pre>
+
* /home/scec-00 286T (249T Used, 37T Available, almaak-07.usc.edu:/export/samfs-scec0/scec-00)
$ cd /home/broadband-01/$USER/11.2.2/bbp_2g/checksums
+
* /home/scec-01 13T (8.1T Used, 3.9T Available, arc.usc.edu:/scec-01)
$ ./md5sum_check.py
 
</pre>
 
 
 
All checksums should agree. At this point you are ready to use the Broadband Platform.
 
 
 
 
 
== Using the Platform ==
 
 
 
Please see [[Broadband Platform]] for full usage documentation. The current version installed on this server is 11.2.2. Each user has their own copy of the platform installed in the following directory:
 
 
 
<pre>
 
/home/broadband-01/$USER/11.2.2/bbp_2g
 
</pre>
 
 
 
 
 
For example, you can run the platform with these commands:
 
 
 
<pre>
 
$ cd /home/broadband-01/$USER/11.2.2/bbp_2g/comps
 
$ ./run_bbp_2G.py
 
</pre>
 
 
 
 
 
Please run yours simulations on the /home/broadband-01 filesystem, as these are disks that have been dedicated to this server. We ask that you do not run simulations from your home directory.
 
 
 
 
 
== Support ==
 
 
 
If you encounter problems with the SCEC Broadband Server, please contact software@scec.org.
 

Latest revision as of 18:22, 21 October 2020

Overview

The SCEC Broadband server is a computing resource with the Broadband Platform platform pre-installed and configured. Access to this server is by request, and requires a login which is provided once your account has been activated.

If you encounter any problems with the SCEC Broadband Server, or to request access, please contact software@scec.org.

Proposed Virtualized Server Software Stack

To facilitate migrating our broadband server configuration, we will use a virtualized version of the system, with a host OS the runs the hypervisor, and a guest OS which we use to perform software development.

Guest host.png

Based on our use of KVM, the resulting system will be considered a type 2 hypervisor system.

Kvm stack.jpg

Host OS that include KVM

We want a recent version of CentOS as the Host OS

  • CentOS 8.2 (release date 6/2020)

Guest OS for Broadband Server Configuration

We want a recent version of Ubuntu as the Guest OS. This should have a full set of software developer tools.

  • Ubuntu 20.04 LTS (release date August 2020)

Configuration Details

  • SSH access
  • Accounts set up via LDAP server (Edric)

Software Stack

We would like these gnu compilers installed which are required to compile the Broadband Platform components:

  • gcc and gfortran (9.3.0)
  • fftw libraries (3.3.4 or later)


We would like the Python3 software installed using the Anaconda distribution tool. These are needed for running the Broadband Platform:

  • Python3 (3.8.2)
  • NumPy (1.17.4)
  • SciPy (1.3.3)
  • Matplotlib (3.1.2)
  • PyProj (2.5.0)
  • Numba (0.48.0)

Other tools/packages that should be installed on the system are:

  • wget
  • automake/autoconf
  • awk/sed
  • emacs
  • git

Filesystems

These are local filesystems on the Broadband Server and they should be backed up periodically.

  • /home/broadband-01 2.7T (2.5T Used, 0.2T Available)
  • /home/broadband-02 3.6T (3.0T Used, 0.6T Available)

These are remote filesystems available from the Broadband Server, needed for Broadband work:

  • /home/hypocenter-01 7.3T (2.6T Used, 4.8T Available, hypocenter.usc.edu:/hypocenter-01)
  • /home/rcf-104 286T (248T Used, 38T Available, almaak-07.usc.edu:/export/samfs-scec0/rcf-104)
  • /home/scec-00 286T (249T Used, 37T Available, almaak-07.usc.edu:/export/samfs-scec0/scec-00)
  • /home/scec-01 13T (8.1T Used, 3.9T Available, arc.usc.edu:/scec-01)