Difference between revisions of "OLCF Summit"

From SCECpedia
Jump to navigationJump to search
Line 1: Line 1:
 +
The following notes are for large mesh extraction on OLCF Summit.
 +
 
== Configuration for large mesh extraction using UCVM ==
 
== Configuration for large mesh extraction using UCVM ==
Scott module list
+
Two Summit users were able to build and run the UCVM 22.7 with taper. Their module lists are below:
 
<pre>
 
<pre>
 
Currently Loaded Modules:
 
Currently Loaded Modules:
Line 7: Line 9:
 
   3) xalt/1.2.1      7) cuda/11.0.3                11) gcc/9.1.0
 
   3) xalt/1.2.1      7) cuda/11.0.3                11) gcc/9.1.0
 
   4) DefApps        8) subversion/1.14.1          12) spectrum-mpi/10.4.0.3-20210112
 
   4) DefApps        8) subversion/1.14.1          12) spectrum-mpi/10.4.0.3-20210112
 +
</pre>
 +
 +
<pre>
 +
Currently Loaded Modules:
 +
  1) lsf-tools/2.0  3) xalt/1.2.1  5) gcc/9.1.0                        7) python/3.8-anaconda3
 +
  2) hsi/5.0.2.p5    4) DefApps      6) spectrum-mpi/10.4.0.3-20210112  8) fftw/3.3.10
 
</pre>
 
</pre>
  
 
== 50 mesh configuration ==
 
== 50 mesh configuration ==
 
 
[pmaech@login5.summit ucvm_for_yifeng]$ more *.conf
 
[pmaech@login5.summit ucvm_for_yifeng]$ more *.conf
 
<pre>
 
<pre>
Line 63: Line 70:
 
date
 
date
 
</pre>
 
</pre>
 +
 
== jsrun configuration tools ==
 
== jsrun configuration tools ==
 
*https://code.ornl.gov/t4p/Hello_jsrun
 
*https://code.ornl.gov/t4p/Hello_jsrun
 
*https://jobstepviewer.olcf.ornl.gov/
 
*https://jobstepviewer.olcf.ornl.gov/
 +
 +
== Related Entries ==
 +
*[[CME]]

Revision as of 05:31, 12 April 2023

The following notes are for large mesh extraction on OLCF Summit.

Configuration for large mesh extraction using UCVM

Two Summit users were able to build and run the UCVM 22.7 with taper. Their module lists are below:

Currently Loaded Modules:
  1) lsf-tools/2.0   5) nsight-compute/2021.2.1      9) imagemagick/7.0.8-7             13) fftw/3.3.10
  2) hsi/5.0.2.p5    6) nsight-systems/2021.3.1.54  10) python/3.6.10-anaconda3
  3) xalt/1.2.1      7) cuda/11.0.3                 11) gcc/9.1.0
  4) DefApps         8) subversion/1.14.1           12) spectrum-mpi/10.4.0.3-20210112
Currently Loaded Modules:
  1) lsf-tools/2.0   3) xalt/1.2.1   5) gcc/9.1.0                        7) python/3.8-anaconda3
  2) hsi/5.0.2.p5    4) DefApps      6) spectrum-mpi/10.4.0.3-20210112   8) fftw/3.3.10

50 mesh configuration

[pmaech@login5.summit ucvm_for_yifeng]$ more *.conf

# List of CVMs to query
ucvmlist=cvmsi,elygtl:ely
# UCVM conf file
ucvmconf=/gpfs/alpine/proj-shared/geo112/CyberShake/software/UCVM/ucvm-22.7.0/conf/ucvm.conf
# Gridding cell centered or vertex
gridtype=CENTER
# Spacing of cells
spacing=50.0
# Projection
proj=+proj=utm +datum=NAD27 +zone=11
rot=-27.5082989431
x0=-119.261301
y0=33.834327
z0=0.0
# Number of cells along each dim
nx=6000
ny=2744
nz=1600
# Partitioning of grid among processors
px=40
py=7
pz=4
# Vs/Vp minimum
vp_min=710.
vs_min=500.
# Mesh and grid files, format
meshfile=cvmsi50+elygtl.media
gridfile=cvmsi50+elygtl.grid
meshtype=IJK-12
# Location of scratch dir
scratch=/gpfs/alpine/scratch/callag/geo112/ucvm_for_yifeng

job submit script

#!/bin/bash
#BSUB -P geo112
#BSUB -W 2:00
#BSUB -q debug
#BSUB -nnodes 28
#BSUB -J cvmsi50Mesh
#BSUB -oo cvmsi50Mesh.o
#BSUB -oe cvmsi50Mesh.e

#source ./ucvm_env.sh

cd $LS_SUBCWD
jsrun -n 1120 -r 40 -a 1 -c 1 /gpfs/alpine/proj-shared/geo112/CyberShake/software/UCVM/ucvm-22.7.0/bin/ucvm2mesh_mpi -f cvmsi50.conf
date

jsrun configuration tools

Related Entries