Product Backlog - Mei
From SCECpedia
Mei-Hui Su's Project/Product Backlog
Project/Product Backlog
- CFM,gather and define the functions needed for the leaflet CFM viewers and study api and start building up the viewer utilities
- CFM, update CFM db/tb schema after science group fix the excel page and resolve typo/conflicts/missing data
- learn the tools used in https://ds.iris.edu/ds/products/emc-desktoptools/. paraview for desktop
- refine sop & doc steps for generating ucvm.e
- tied up loose ends in UCVMC18.5 and test
- need to make UCVMC work with python3(Scott said bw is stern about it), mainly plotting and config/build scripts
- Discuss mesh plotting Scripts with Scott Cal.
DONE
- CFM, add the linkup in js for the leaflet viewer and postgis' geoJSON geometry trace info
- CFM, add php/js to extract geoJSON for target fault object during query and track them to be sent to the viewer
- CFM, translate shapesfiles from release tarball into postgis db sql script and ingest into backend db
- CFM, explore and code a leaflet viewer with canned geoJSON data
- CFM, code php/java scripts/html page for queries with user input:query by region (with on the fly region list extracted from backend db via php), query by a range of strike value(with on the
fly min/max strike range, extracted from the backend db via php), query by keyword(full text search from postgres db on object name, can be expanded in the future per request); query by latlon (within 0.0001 precision, a small roi box is created and used postgis to make overlap check)
- CFM, preprocess the excel from CFM5_release_2017, define db/tb schema and ingest the information into postgres db.
- UCVMC,generate the tiled v1000 data that Kevin needed for https://github.com/kevinmilner/cybershake-analysis/tree/master/study_18_8/hazard_maps#study-188-hazard-maps, they are left with https://scec.usc.edu/scecpedia/Bay_Area_Velocity_Model_Z2.5_data#Bay_Area_Velocity_Model
- CFM,study requirements for work on SCEC Community Fault Model,start with postgres db, postgis extension, php service, javascript, leaflet, tile service from open street map.
- define the json blob for material properties used in plotting scripts, define import and export to file format, rpretell@ucdavis.edu, https://scec.usc.edu/scecpedia/LA_Vertical_Profiles#Result
- look into updating Wills' map in UCVMC, https://scec.usc.edu/scecpedia/Wills_Map, ucvm.e
- work to make Rob Grave's mesh generating code to work for him (tweak Rob's directory and Scott's https://source.usc.edu/svn/cybershake/import/trunk/UCVM)
- doc how to process .bin file generated from plotting script or ucvm basin_query call, https://scec.usc.edu/scecpedia/UCVMC_How_to_process_bin_data
- translate pbs/hpc/ucvm2mesh to slurm calls
- (No work done)Generate large (100M+ point) AWP mesh using ucvmc and ucvmp and compare(Scott said ucvmp can not generate big mesh since it does not have mpi flavor to it)
- Bay Area velocity model's z2.5 plots for Kevin -- different tiling order of cca/cencal/cvms5 , https://scec.usc.edu/scecpedia/Bay_Area_Velocity_Model_Z2.5_data#Result
- updated cca06 crossing data for Kevin (fuzzy edge problem compare to UCVM python version, a bug found by Scott in CCA06 C version), nwo includes two sets, one without GTL and the other with GTL, https://scec.usc.edu/scecpedia/Final_CCA06_Crossings_Result
- Doc how La Habra mesh is made with ucvm2mesh_mpi_layer, https://scec.usc.edu/scecpedia/UCVMC_La_Habra_mesh_generation#ucvm2mesh_mpi_layer
- Generated various plots highlight CS17.3-H, https://scec.usc.edu/scecpedia/UCVMC_CS17.3-H_plots#Plots
- Registered new Central California Basin Model from Havard. CS17.3-H with ELY GTL
- built a useable UCVMC installation on Titan, /lustre/atlas/proj-shared/geo112/ucvm_18_5/
- made UCVMC statically linkable and the plugin models worked as in dynamically linked UCVMC
- reworked logic in ucvm2mesh-mpi to have a more 'feasible' compute node requirement for very large mesh like La Habra, ucvm2mesh_mpi_layer, remember to strip result directory when running at blue waters. lfs setstripe -c 4 /path/to/working/directory
- extract UCVMC cs173 info for Scott's gridpoints (off alittle but okayed by Scott)
- reworked basin_query tests in slurm on hpc
- created a pull request to official UCVM-C, fix up each models that is in github -- merged into official UCVMC's dev branch
- Ran tests tiling cencal+cca+cvms5+bbp1d, the 1d part gets surface gtl
- Tiled cencal+cca(with gtl)+cvms5(with gtl)+1d tested and verified
- GTL for CCA06- verified by generating identical plots to CyberShake_Study_18.5
- Fixed plugin/dynamic loading of modules, Scott's interleaving bug, fixes for cvmsi is also needed for the plugin module. There was the missed case for left-over points in chunking/processing code, fixed that. Also the code was not setup to take more than one dynamic library
- Setup to run my latest UCVMC on blue water - query works but plotting scripts do not work with BW's installed default pthread library(too old, conflicting with matplotlib's pyplot from Anaconda2)
- Fixed segfaults flagged from a working ucvmc installation on local mac (fixed cs173_final(), cca_final()), (mac gdb installation hints: https://gist.github.com/gravitylow/fb595186ce6068537a6e9da6d8b5b96d)
- Ran basin_query_mpi on hpc with SLURM
- Doc projection fix on scecpedia, https://scec.usc.edu/scecpedia/Final_Projection_Review_Result
- Add the fixed config file into CCA's github, also edits from below(pending moving to scec space): https://github.com/meihuisu/CCA.git
- Copy the CCA06 data on scec-01/Intensity to hypocenter, change the dependency to hypocenter in the make-data script
- adding elygtl to CCA06
- new cs173 github location(pending moving to scec space):https://github.com/meihuisu/cs173.git
- Register Scott NorCal model into UCVM - CS173, compare CS173 plots from ScottC with my version
- Doc CCA06 Crossing review, https://scec.usc.edu/scecpedia/Final_CCA06_Crossings_Result
- Update basin_query_mpi to return list of crossing per grid point, also return one crossing output file for each algorithm.
- To check projection fix, trace processing from en-jui data files to configuration files
- Cross section plots showing 0-10km depth through CCA06, showing velocity inversions, starting at one end of region at 5km spacing to other end of region. **No need, posted inversion plot in scecpedia**
