Difference between revisions of "Ucvm2mesh-mpi"

From SCECpedia
Jump to navigationJump to search
Line 21: Line 21:
  
 
== Example Usage ==
 
== Example Usage ==
 +
ucvm2mesh.conf file
 
<pre>
 
<pre>
 
 
# List of CVMs to query
 
# List of CVMs to query
 
ucvmlist=cvmh,bbp1d
 
ucvmlist=cvmh,bbp1d
Line 66: Line 66:
 
</pre>
 
</pre>
  
 +
ucvm2mesh pbs file
 +
<pre>
 +
 +
-bash-4.2$ more *.pbs
 +
#!/bin/bash
 +
#
 +
# This is the pbs script ucvm2mesh
 +
#
 +
#PBS -l nodes=4:ppn=5
 +
#PBS -l walltime=00:10:00
 +
#PBS -m ae
 +
#PBS -M maechlin@usc.edu
 +
##PBS -q main
 +
#PBS -o $PBS_JOBID.out
 +
#PBS -e $PBS_JOBID.err
 +
cd $PBS_O_WORKDIR
 +
np=$(cat $PBS_NODEFILE | wc -l)
 +
cat $PBS_NODEFILE
 +
 +
mpirun -np $np -machinefile $PBS_NODEFILE /auto/scec-00/maechlin/t1/bin/ucvm2mesh-mpi -f /auto/scec-00/maechlin/ucvm_mpi/ucvm2mesh_2
 +
0cores.conf
 +
#mv /scratch/maechlin/mesh_cvmh_ijk12_2000m.media $PBS_O_WORKDIR/mesh_cvmh_ijk12_200m.media
 +
#mv /scratch/maechlin/mesh_cvmh_ijk12_2000m.grid  $PBS_O_WORKDIR/mesh_cvmh_ijk12_200m.grid
 +
exit
 +
</pre>
 
== Dumpgrid.py Utility ==
 
== Dumpgrid.py Utility ==
  

Revision as of 04:48, 28 March 2018

We are working on ucvm2mesh-mpi software to confirm it works in ucvmc

Questions that we will resolve

  • ucvm2mesh-mpi documentation (look for configuraiton file)
  • How can we set origin at center of region (rather than at lower left point)
  • What direction is the X axis and Y axis (confirm x is horizontal before rotation)
  • Confirm that positive rotation is counter clockwise
  • Describe differences in output format mesh file versus grid file
  • describe differences in output format for ijk-12, ijk-16, ijk-32 and SORD
  • Describe output file formats and locations

small scale ucvm queries

  • Define small scale sample problem
  • 20 km x 10km x 10k volume
  • 1km spacing
  • with rotation
  • without rotation
  • with ucvm2mesh
  • with ucvm2mesh-mpi

Example Usage

ucvm2mesh.conf file

# List of CVMs to query
ucvmlist=cvmh,bbp1d

# UCVM conf file
ucvmconf=/auto/scec-00/maechlin/t1/conf/ucvm.conf

# Gridding cell centered or vertex
gridtype=CENTER

# Spacing of cells
spacing=2000.0

# Projection
proj=+proj=utm +datum=WGS84 +zone=11
rot=-40.0
x0=-122.3
y0=34.7835
z0=0.0

# Number of cells along each dim
nx=384
ny=248
nz=25

# Partitioning of grid among processors
px=2
py=2
pz=5

# Vs/Vp minimum
vp_min=0
vs_min=0

# Mesh and grid files, format
meshfile=/auto/scec-00/maechlin/ucvm_mpi/mesh_cvmhbbp1d_ijk12_2000m.media
gridfile=/auto/scec-00/maechlin/ucvm_mpi/mesh_cvmhbbp1d_ijk12_2000m.grid
meshtype=IJK-12

# Location of scratch dir
scratch=/scratch

ucvm2mesh pbs file


-bash-4.2$ more *.pbs
#!/bin/bash
#
# This is the pbs script ucvm2mesh 
#
#PBS -l nodes=4:ppn=5
#PBS -l walltime=00:10:00
#PBS -m ae
#PBS -M maechlin@usc.edu
##PBS -q main
#PBS -o $PBS_JOBID.out
#PBS -e $PBS_JOBID.err
cd $PBS_O_WORKDIR
np=$(cat $PBS_NODEFILE | wc -l)
cat $PBS_NODEFILE

mpirun -np $np -machinefile $PBS_NODEFILE /auto/scec-00/maechlin/t1/bin/ucvm2mesh-mpi -f /auto/scec-00/maechlin/ucvm_mpi/ucvm2mesh_2
0cores.conf
#mv /scratch/maechlin/mesh_cvmh_ijk12_2000m.media $PBS_O_WORKDIR/mesh_cvmh_ijk12_200m.media
#mv /scratch/maechlin/mesh_cvmh_ijk12_2000m.grid  $PBS_O_WORKDIR/mesh_cvmh_ijk12_200m.grid
exit

Dumpgrid.py Utility

  • dump_grid.py utility reads in grid file and dumps the i j values, and the lat/lon values
./dumpgrid.py mesh_bbp1d_ijk12_2000m.grid 384 248

produces

380, 247 : -112.506316, 33.825386
381, 247 : -112.490418, 33.813224
382, 247 : -112.474526, 33.801059
383, 247 : -112.458637, 33.788893

Links to Relevant Information

Related Entries