Difference between revisions of "Product Backlog - Mei"
From SCECpedia
Jump to navigationJump to search(106 intermediate revisions by the same user not shown) | |||
Line 2: | Line 2: | ||
== Project/Product Backlog == | == Project/Product Backlog == | ||
− | #learn the tools used in https://ds.iris.edu/ds/products/emc-desktoptools/. paraview for desktop | + | #UCVM, SFCVM running on frontier |
− | # | + | #UCVM, continue adding ci to more cvms |
− | + | #UCVM, move CVMH and CENCAL to be pluggable models | |
− | # | + | #UCVM, upgrade CENCAL to newer version |
− | # | + | #UCVM, study LSU model blending code |
− | + | #UCVM, find replacement(pyGMT) to matplotlib used in the plotting scripts because matplotlib's Basemap is not being supported in python3 | |
+ | #UCVMC, setup remote GitHub runner for UCVM's GitHub actions | ||
+ | #UCVMC, survey different kinds of unittest/regrssion testing platforms in C/bash/python | ||
+ | #UCVMC, explore Valgrind as memory leak tool and perhaps coverage tools | ||
+ | #UCVMC, explore gcov, and prof as coverage tool | ||
+ | #UCVMC, need to make UCVMC work with python3, mainly plotting and config/build scripts - with docker setup | ||
+ | #CTM, study the CTM python code from Liz Hearn | ||
+ | #UCVMC, add watermark on ucvm_web's viewer part (Look at Edric's leaflet overlay for CGM web) | ||
+ | #WEB, status review for CFM, UCVM, GFM | ||
+ | #UCVMC, design/test out continuous integration testing framework on github for ucvmc. | ||
+ | #UCVMC, prepare Plotly usage example to the group | ||
+ | #UCVMC, internal GTL for cvms5/cca is different from external elygtl:ely, https://scec.usc.edu/scecpedia/UCVM_cca/cvms5_comparing_builtin-gtl_vs_elygtl:ely | ||
+ | #CFM, update CFM db/tb schema after science group fix the excel page ands typo/conflicts/missing data | ||
+ | #UCVMC, config dumping tool | ||
+ | #UCVMC,learn the tools used in https://ds.iris.edu/ds/products/emc-desktoptools/. paraview for desktop | ||
+ | #UCVMC,refine sop & doc steps for generating ucvm.e | ||
+ | |||
+ | LOST | ||
+ | #GFM+CRM, add Moho search option | ||
+ | #UCVMC, user reports UCVM used for simulation SPECFEM3D seems to be causing segfaults (ctape@alaska.edu)>> ?? no segfault ??https://scec.usc.edu/scecpedia/UCVM_elevation_vs_depth,_model_boundary | ||
DONE | DONE | ||
− | #look into updating Wills' map in UCVMC, https://scec.usc.edu/scecpedia/Wills_Map, ucvm.e | + | #PBR, prototype a PBR web tool for Xiaofeng |
− | #work to make Rob Grave's mesh generating code to work for him (tweak Rob's directory and Scott's https://source.usc.edu/svn/cybershake/import/trunk/UCVM) | + | #GRD, new web dashboard/CPD |
− | #doc how to process .bin file generated from plotting script or ucvm basin_query call, https://scec.usc.edu/scecpedia/UCVMC_How_to_process_bin_data | + | #CSM, new web dashboard |
− | #translate pbs/hpc/ucvm2mesh to slurm calls | + | #CGM, adding new INSAR tracks |
+ | #UCVM, create a new software stack for SFCVM/geomodelgrids | ||
+ | #CFM, add separate models, CFM6.0 preferred/alternative/rupture set in addition to CFM5.3 | ||
+ | #CFM, add copy-to-clipboard action to plot3D's share link call | ||
+ | #CFM, add map expansion option | ||
+ | #CFM, allow external KML/KMZ files be ingest as an overlay layer over the map | ||
+ | #CFM, allow user upload of traces to support CFM6.0 fault review process | ||
+ | #UCVM, add tapering interpolation method | ||
+ | #UCVM, add San Jacinto Fault Zone velocity model(sjfz) | ||
+ | #UCVM, change largefiles location to Globus online collection at CARC (/project/scec_608/public/ucvm) | ||
+ | #UCVM, add 9 new basin models from Andreas/Harvard group | ||
+ | #UCVM, add ci to cvms models in GitHub | ||
+ | #UCVM, work on getting release for upcoming UCVM release, retest on CARC | ||
+ | #UCVM, link Github runner from ucvm_plotting to UCVM | ||
+ | #UCVM, test out docker setup for python2/ucvm/ucvm_plotting | ||
+ | #UCVM, rework get_largefiles.py to pick up path/config info from setup.list instead of current hardwired method. | ||
+ | #CFM, extend the REST API to allow ingesting of 'external' gocad tsurf file and displaying it on plot3D | ||
+ | #CFM, add 'sharing link' option to plot3D, implement command option/REST API, to CFM viewer. | ||
+ | #CGM, add surface plot for INSAR's velocity data given a boundary | ||
+ | #CGM, add 2d view of INSAR data, add time series plot for INSAR data (calling python pkg) | ||
+ | #CGM, add GNSS time series data hosted at MIT with plotly plot | ||
+ | #CGM, flesh out GNSS data access, add INSAR data | ||
+ | #CGM, trimmed out CFM part of code out of CGM_view 1.0, rework some search logic | ||
+ | #CFM, add seismicity data to 3dPlot vtk viewer as point scatter plots | ||
+ | #CFM, add seismicity data to map base leaflet as pixi overlay - Hauksson, Ross, and significant faults layers | ||
+ | #CM, update UCVM part of code with new UCVM+ucvm_plotting code bases | ||
+ | #UCVM, reactivated and updated the Utah velocity model, WH | ||
+ | #UCVM, add 2 new basin velocity models from LSU, (SSIP Imperial Valley, SSIP Coachella Valley) | ||
+ | #CFM, release CFM viewer with CFM5.3, plus many updates to viewer functions, ie. fault search filtering, strike and dip search option | ||
+ | #UCVM, split the plotting out to different github repository to simplify the UCVM's dependency python3. --https://github.com/SCECcode/ucvm_plotting | ||
+ | #USC, test out USC discovery/endeavour slurm/sbatch/srun/mpirun with UCVM's mpi code | ||
+ | #UCVM, Elnaz TACC/ucvm2etree_extract_MPI was having problem. It turns out global variable for zrange needs to be initalized when using intel mpi compiler on Frontera. | ||
+ | #GFM, add 3d viewer to GFM viewer | ||
+ | #CRM/CXM viewer tool to do shp file -> Geojson conversion with postgis -> convert data for CTM, CRM | ||
+ | #CM+UCVM, create CM viewer with integrated 2d mapview with CFM/GFM/CTM, and ucvm viewer capability | ||
+ | #GFM+CRM, update GFM with CRM and a new viewer setup | ||
+ | #GFM, process the shp CRM_polygons_Plesch_Mar_7_2019 from Liz Hearn (CRM pqsql schema) | ||
+ | #CFM, expand 3d viewer to include surface california shoreline+border as reference orientation | ||
+ | #CFM, expand 3d viewer to include surface trace/blind for faults | ||
+ | #CFM, expand 3d viewer to have a orientation axes marker | ||
+ | #CFM, expand 3d viewer to allow user selectable color picker for each 3D fault representation | ||
+ | #CFM, expand 3d viewer to include toggle option for surface/wireframe | ||
+ | #UCVMC, extract geometry geoJson for the 2D area from CRM_polygons_Plesch_Mar_7_2019 and create an optional layer over UCVMC viewer | ||
+ | #CFM, VTK.js has some updates, need to bring that in, look into vtkOrientationMarkerWidget for CFM_web | ||
+ | #UCVMC, test GitHub actions and runner for continuous integration setup for ucvm build | ||
+ | #CFM, on fixing the mixing blindness in a fault - array of blinds at OBJECT_tb | ||
+ | #CFM, extract geometry geoJson of faults from CFM5.2 into a standalone external file and code ingest leaflet groupLayer that can be reused with any leaflet based scec viewers | ||
+ | #UCVMC, review various places where vs30/Wallis is used in ucvm/models | ||
+ | #UCVMC, adding Cencal & CCA06 to Moho's ucvm_web | ||
+ | #UCVMC, trace the UCVM VS30 values that differ from Rob Grave's VS30 list. interpolation vs nearest point:https://scec.usc.edu/scecpedia/UCVM_VS30_etree_map_(Wills_2015)_UCVM%27s_interpolation#vs30_etree_map | ||
+ | #UCVMC, add a new model for UCVMC, Albacore, Southern California Offshore velocity model, kohler@caltech.edu, Daniel.bowden@erdw.ethz.ch | ||
+ | #UCVMC, a list of elevations for elevation-based profile script in generated meta file | ||
+ | #UCVMC, branch cleanup on UCVMC -- only Master, forGFM, withSVM, forPython3 left | ||
+ | #UCVMC, verify UCVM's CVMS4.26 profile plots matches with Billy's averaging profile plot with EnJui's CVM4SI26_slices. Also, tested with PO Chan's set of CVMS4.26 dataset. | ||
+ | #UCVMC, make a mini dockerized UCVM image with cvms, cvms5, and cvmh1511 git@github.com:SCECcode/ucvm_docker.git | ||
+ | #UCVMC, needs some Z25/Z10 data for some models with GTL https://scec.usc.edu/scecpedia/UCVM_z1,z2.5_for_CCA06_with_GTL,_CVM-S4.26.M01 | ||
+ | #UCVMC, viewer that allow user to query for UCVMC material property and initiate the plotting capability in UCVMC/utilities(git@github.com:SCECcode/UCVM_web.git) | ||
+ | #UCVMC, add Elevation query mode to ucvm2mesh, ucvm2mesh_mpi, ucvm2mesh_mpi_layer, (currently on branch -forGFM). User needs to include cvmh as part of cvmlist and let UCVM's model tiling to set the property values for in-air, in-water properly,ucvmlist=cvmsi,cvmh. Note: if region is outside of cvmh area, then no data would exists for those regions. In configuration file, specify querymode=ELEVATION | ||
+ | #CFM, add simple 3d viewer (using vtk.js) to selected faults | ||
+ | #SVM, Elnas has requested generation of 3 new etrees, https://scec.usc.edu/scecpedia/UCVM_svm_etree and new data is at https://scec.usc.edu/scecpedia/UCVM_svmgtl_and_elygtl | ||
+ | #GFM, viewer that allow user to query for GFM material property + plotting capability(https://github.com/SCECcode/GFM_web.git) | ||
+ | #GFM, geological features decorated model -- update vx-lite with new g model files | ||
+ | #CFM, study web page accessibility, https://www.w3.org/TR/wai-aria-practices, study ui write-up, https://www.smashingmagazine.com/06/designing-perfect-accordion-checklist/ | ||
+ | #CFM, prep the core CFM code for the new CFM data release (Edric has been updating and maintaining UI per user's requests) -- CFM5.2-Fault_ID_preferred_final.xlsx, CFM52_db, nonblind, blind native ts files | ||
+ | #UCVMC, SVM GTL from Caltech (https://scec.usc.edu/scecpedia/UCVM_svmgtl_and_elygtl) and (https://scec.usc.edu/scecpedia/UCVM_svmgtl) | ||
+ | #UCVMC,review and update the GitHub UCVMC's wiki pages | ||
+ | #UCVMC,tied up loose ends and tests for UCVM V19.4,add examples directory for program and plots examples | ||
+ | #UCVMC, generate etree for Garner Valley, CA for elnaz@caltech.edu, https://scec.usc.edu/scecpedia/UCVM_etree_for_Garner_Valley | ||
+ | #UCVMC, add plot_elevation_profile.py and plot_elevation_cross_section.py,(ctape@alaska.edu) https://scec.usc.edu/scecpedia/UCVM_elevation_vs_depth,_model_boundary | ||
+ | #CFM, document CFM dashboard in github and transfer to SCEC space | ||
+ | #CFM, streamline the preprocessing of CFM database -- xlsx file to Postgres db | ||
+ | #UCVMC, generate plots for USGS CVM doc -- http://hypocenter.usc.edu/research/ucvmc/USGS-CVM-plot.tar.gz | ||
+ | #CFM, add analytic tracking to the dashboard -- Edric/google | ||
+ | #CFM, add latlon search option with direct location selection on the map area | ||
+ | #CFM, add highlighting of faults on the viewer part in addition to be from the table | ||
+ | #CFM, add group download(zip) of multiple faults geo data and meta data | ||
+ | #UCVMC, final set of plot/data for jplet@cpp.edu, 400+ 1d plots in http://hypocenter.usc.edu/research/ucvmc_result/pomona4.tar.gz, cross section plots in http://hypocenter.usc.edu/research/ucvmc_result/pomona3.tar.gz | ||
+ | #CFM, update cfm dashboard(add dip search, add 'key' trigger to keywordTxt, change latlon search to 4 inputs) | ||
+ | #CFM, add download function to CFM dashboard (on popup window) | ||
+ | #CFM, stash the CFM5.2 dataset at asperity's /var/www/html/CFM5_preferred/native, 500m, 1000m | ||
+ | #CFM, refine end-to-end setup of new CFM dashboard to server/client test environment | ||
+ | #CFM, setup initial CFM db host over at AWS, http://asperity.scec.org/CFM/web/cfm_view.html | ||
+ | #UCVMC, first set of plot/data for jplet@cpp.edu. https://scec.usc.edu/scecpedia/UCVMC_basin_depth_study,_poly_tech,_Pomona | ||
+ | #UCVMC, support jpolet@cpp.edu's group with cross_section and depth_profile processing (added metadata/data output to depth_profile.py) https://scec.usc.edu/scecpedia/UCVMC_how_to_plot_cross_section_and_depth_profile | ||
+ | #CFM, gather and define the functions needed for the leaflet CFM viewers and study leaflet api and start building up the viewer utilities | ||
+ | #UCVMC, update 1d grid reference data for UCVMC acceptance test | ||
+ | #CFM, add the linkup in js for the leaflet viewer and postgis' geoJSON geometry trace info | ||
+ | #CFM, add php/js to extract geoJSON for target fault object during query and track them to be sent to the viewer | ||
+ | #CFM, translate shapesfiles from release tarball into postgis db sql script and ingest into backend db | ||
+ | #CFM, explore and code a leaflet viewer with canned geoJSON data | ||
+ | #CFM, code php/java scripts/html page for queries with user input:query by region (with on the fly region list extracted from backend db via php), query by a range of strike value(with on the fly min/max strike range, extracted from the backend db via php), query by keyword(full text search from postgres db on object name, can be expanded in the future per request); query by latlon (within 0.0001 precision, a small roi box is created and used postgis to make overlap check) | ||
+ | #CFM, preprocess the excel from CFM5_release_2017, define db/tb schema and ingest the information into postgres db. | ||
+ | #UCVMC,generate the tiled v1000 data that Kevin needed for https://github.com/kevinmilner/cybershake-analysis/tree/master/study_18_8/hazard_maps#study-188-hazard-maps, they are left with https://scec.usc.edu/scecpedia/Bay_Area_Velocity_Model_Z2.5_data#Bay_Area_Velocity_Model | ||
+ | #CFM,study requirements for work on SCEC Community Fault Model,start with postgres db, postgis extension, php service, javascript, leaflet, tile service from open street map. | ||
+ | #UCVMC,define the json blob for material properties used in plotting scripts, define import and export to file format, rpretell@ucdavis.edu, https://scec.usc.edu/scecpedia/LA_Vertical_Profiles#Result | ||
+ | #UCVMC,look into updating Wills' map in UCVMC, https://scec.usc.edu/scecpedia/Wills_Map, ucvm.e | ||
+ | #UCVMC,work to make Rob Grave's mesh generating code to work for him (tweak Rob's directory and Scott's https://source.usc.edu/svn/cybershake/import/trunk/UCVM) | ||
+ | #UCVMC,doc how to process .bin file generated from plotting script or ucvm basin_query call, https://scec.usc.edu/scecpedia/UCVMC_How_to_process_bin_data | ||
+ | #UCVMC,translate pbs/hpc/ucvm2mesh to slurm calls | ||
#(No work done)Generate large (100M+ point) AWP mesh using ucvmc and ucvmp and compare(Scott said ucvmp can not generate big mesh since it does not have mpi flavor to it) | #(No work done)Generate large (100M+ point) AWP mesh using ucvmc and ucvmp and compare(Scott said ucvmp can not generate big mesh since it does not have mpi flavor to it) | ||
− | #Bay Area velocity model's z2.5 plots for Kevin, https://scec.usc.edu/scecpedia/Bay_Area_Velocity_Model_Z2.5_data#Result | + | #UCVMC,Bay Area velocity model's z2.5 plots for Kevin -- different tiling order of cca/cencal/cvms5 , https://scec.usc.edu/scecpedia/Bay_Area_Velocity_Model_Z2.5_data#Result |
− | #updated cca06 crossing data for Kevin (fuzzy edge problem compare to UCVM python version, a bug found by Scott in CCA06 C version), nwo includes two sets, one without GTL and the other with GTL, https://scec.usc.edu/scecpedia/Final_CCA06_Crossings_Result | + | #UCVMC,updated cca06 crossing data for Kevin (fuzzy edge problem compare to UCVM python version, a bug found by Scott in CCA06 C version), nwo includes two sets, one without GTL and the other with GTL, https://scec.usc.edu/scecpedia/Final_CCA06_Crossings_Result |
#Doc how La Habra mesh is made with ucvm2mesh_mpi_layer, https://scec.usc.edu/scecpedia/UCVMC_La_Habra_mesh_generation#ucvm2mesh_mpi_layer | #Doc how La Habra mesh is made with ucvm2mesh_mpi_layer, https://scec.usc.edu/scecpedia/UCVMC_La_Habra_mesh_generation#ucvm2mesh_mpi_layer | ||
− | #Generated various plots highlight CS17.3-H, https://scec.usc.edu/scecpedia/UCVMC_CS17.3-H_plots#Plots | + | #UCVMC,Generated various plots highlight CS17.3-H, https://scec.usc.edu/scecpedia/UCVMC_CS17.3-H_plots#Plots |
− | #Registered new Central California Basin Model from Havard. CS17.3-H with ELY GTL | + | #UCVMC,Registered new Central California Basin Model from Havard. CS17.3-H with ELY GTL |
− | #built a useable UCVMC installation on Titan, /lustre/atlas/proj-shared/geo112/ucvm_18_5/ | + | #UCVMC,built a useable UCVMC installation on Titan, /lustre/atlas/proj-shared/geo112/ucvm_18_5/ |
− | #made UCVMC statically linkable and the plugin models worked as in dynamically linked UCVMC | + | #UCVMC,made UCVMC statically linkable and the plugin models worked as in dynamically linked UCVMC |
− | #reworked logic in ucvm2mesh-mpi to have a more 'feasible' compute node requirement for very large mesh like La Habra, ucvm2mesh_mpi_layer, remember to strip result directory when running at blue waters. lfs setstripe -c 4 /path/to/working/directory | + | #UCVMC,reworked logic in ucvm2mesh-mpi to have a more 'feasible' compute node requirement for very large mesh like La Habra, ucvm2mesh_mpi_layer, remember to strip result directory when running at blue waters. lfs setstripe -c 4 /path/to/working/directory |
− | #extract UCVMC cs173 info for Scott's gridpoints (off alittle but okayed by Scott) | + | #UCVMC,extract UCVMC cs173 info for Scott's gridpoints (off alittle but okayed by Scott) |
− | #reworked basin_query tests in slurm on hpc | + | #UCVMC,reworked basin_query tests in slurm on hpc |
− | #created a pull request to official UCVM-C, fix up each models that is in github -- merged into official UCVMC's dev branch | + | #UCVMC,created a pull request to official UCVM-C, fix up each models that is in github -- merged into official UCVMC's dev branch |
− | #Ran tests tiling cencal+cca+cvms5+bbp1d, the 1d part gets surface gtl | + | #UCVMC,Ran tests tiling cencal+cca+cvms5+bbp1d, the 1d part gets surface gtl |
− | #Tiled cencal+cca(with gtl)+cvms5(with gtl)+1d tested and verified | + | #UCVMC,Tiled cencal+cca(with gtl)+cvms5(with gtl)+1d tested and verified |
− | #GTL for CCA06- verified by generating identical plots to CyberShake_Study_18.5 | + | #UCVMC,GTL for CCA06- verified by generating identical plots to CyberShake_Study_18.5 |
− | #Fixed plugin/dynamic loading of modules, Scott's interleaving bug, fixes for cvmsi is also needed for the plugin module. There was the missed case for left-over points in chunking/processing code, fixed that. Also the code was not setup to take more than one dynamic library | + | #UCVMC,Fixed plugin/dynamic loading of modules, Scott's interleaving bug, fixes for cvmsi is also needed for the plugin module. There was the missed case for left-over points in chunking/processing code, fixed that. Also the code was not setup to take more than one dynamic library |
− | #Setup to run my latest UCVMC on blue water - query works but plotting scripts do not work with BW's installed default pthread library(too old, conflicting with matplotlib's pyplot from Anaconda2) | + | #UCVMC,Setup to run my latest UCVMC on blue water - query works but plotting scripts do not work with BW's installed default pthread library(too old, conflicting with matplotlib's pyplot from Anaconda2) |
− | #Fixed segfaults flagged from a working ucvmc installation on local mac (fixed cs173_final(), cca_final()), (mac gdb installation hints: https://gist.github.com/gravitylow/fb595186ce6068537a6e9da6d8b5b96d) | + | #UCVM,Fixed segfaults flagged from a working ucvmc installation on local mac (fixed cs173_final(), cca_final()), (mac gdb installation hints: https://gist.github.com/gravitylow/fb595186ce6068537a6e9da6d8b5b96d) |
− | #Ran basin_query_mpi on hpc with SLURM | + | #UCVMC,Ran basin_query_mpi on hpc with SLURM |
− | #Doc projection fix on scecpedia, https://scec.usc.edu/scecpedia/Final_Projection_Review_Result | + | #UCVMC,Doc projection fix on scecpedia, https://scec.usc.edu/scecpedia/Final_Projection_Review_Result |
− | #Add the fixed config file into CCA's github, also edits from below(pending moving to scec space): https://github.com/meihuisu/CCA.git | + | #UCVMC,Add the fixed config file into CCA's github, also edits from below(pending moving to scec space): https://github.com/meihuisu/CCA.git |
− | #Copy the CCA06 data on scec-01/Intensity to hypocenter, change the dependency to hypocenter in the make-data script | + | #UCVMC,Copy the CCA06 data on scec-01/Intensity to hypocenter, change the dependency to hypocenter in the make-data script |
− | #adding elygtl to CCA06 | + | #UCVMC,adding elygtl to CCA06 |
− | #new cs173 github location(pending moving to scec space):https://github.com/meihuisu/cs173.git | + | #UCVMC,new cs173 github location(pending moving to scec space):https://github.com/meihuisu/cs173.git |
− | #Register Scott NorCal model into UCVM
- CS173, compare CS173 plots from ScottC with my version | + | #UCVMC,Register Scott NorCal model into UCVM
- CS173, compare CS173 plots from ScottC with my version |
− | #Doc CCA06 Crossing review, https://scec.usc.edu/scecpedia/Final_CCA06_Crossings_Result | + | #UCVMC,Doc CCA06 Crossing review, https://scec.usc.edu/scecpedia/Final_CCA06_Crossings_Result |
− | #Update basin_query_mpi to return list of crossing per grid point, also return one crossing output file for each algorithm. | + | #UCVMC,Update basin_query_mpi to return list of crossing per grid point, also return one crossing output file for each algorithm. |
− | #To check projection fix, trace processing from en-jui data files to configuration files | + | #UCVMC,To check projection fix, trace processing from en-jui data files to configuration files |
− | #Cross section plots showing 0-10km depth through CCA06, showing velocity inversions, starting at one end of region at 5km spacing to other end of region. **No need, posted inversion plot in scecpedia** | + | #UCVMC,Cross section plots showing 0-10km depth through CCA06, showing velocity inversions, starting at one end of region at 5km spacing to other end of region. **No need, posted inversion plot in scecpedia** |
== Related Entries == | == Related Entries == | ||
*[[CME Software Staff]] | *[[CME Software Staff]] | ||
*[[CME Project]] | *[[CME Project]] |
Latest revision as of 00:30, 10 October 2023
Mei-Hui Su's Project/Product Backlog
Project/Product Backlog
- UCVM, SFCVM running on frontier
- UCVM, continue adding ci to more cvms
- UCVM, move CVMH and CENCAL to be pluggable models
- UCVM, upgrade CENCAL to newer version
- UCVM, study LSU model blending code
- UCVM, find replacement(pyGMT) to matplotlib used in the plotting scripts because matplotlib's Basemap is not being supported in python3
- UCVMC, setup remote GitHub runner for UCVM's GitHub actions
- UCVMC, survey different kinds of unittest/regrssion testing platforms in C/bash/python
- UCVMC, explore Valgrind as memory leak tool and perhaps coverage tools
- UCVMC, explore gcov, and prof as coverage tool
- UCVMC, need to make UCVMC work with python3, mainly plotting and config/build scripts - with docker setup
- CTM, study the CTM python code from Liz Hearn
- UCVMC, add watermark on ucvm_web's viewer part (Look at Edric's leaflet overlay for CGM web)
- WEB, status review for CFM, UCVM, GFM
- UCVMC, design/test out continuous integration testing framework on github for ucvmc.
- UCVMC, prepare Plotly usage example to the group
- UCVMC, internal GTL for cvms5/cca is different from external elygtl:ely, https://scec.usc.edu/scecpedia/UCVM_cca/cvms5_comparing_builtin-gtl_vs_elygtl:ely
- CFM, update CFM db/tb schema after science group fix the excel page ands typo/conflicts/missing data
- UCVMC, config dumping tool
- UCVMC,learn the tools used in https://ds.iris.edu/ds/products/emc-desktoptools/. paraview for desktop
- UCVMC,refine sop & doc steps for generating ucvm.e
LOST
- GFM+CRM, add Moho search option
- UCVMC, user reports UCVM used for simulation SPECFEM3D seems to be causing segfaults (ctape@alaska.edu)>> ?? no segfault ??https://scec.usc.edu/scecpedia/UCVM_elevation_vs_depth,_model_boundary
DONE
- PBR, prototype a PBR web tool for Xiaofeng
- GRD, new web dashboard/CPD
- CSM, new web dashboard
- CGM, adding new INSAR tracks
- UCVM, create a new software stack for SFCVM/geomodelgrids
- CFM, add separate models, CFM6.0 preferred/alternative/rupture set in addition to CFM5.3
- CFM, add copy-to-clipboard action to plot3D's share link call
- CFM, add map expansion option
- CFM, allow external KML/KMZ files be ingest as an overlay layer over the map
- CFM, allow user upload of traces to support CFM6.0 fault review process
- UCVM, add tapering interpolation method
- UCVM, add San Jacinto Fault Zone velocity model(sjfz)
- UCVM, change largefiles location to Globus online collection at CARC (/project/scec_608/public/ucvm)
- UCVM, add 9 new basin models from Andreas/Harvard group
- UCVM, add ci to cvms models in GitHub
- UCVM, work on getting release for upcoming UCVM release, retest on CARC
- UCVM, link Github runner from ucvm_plotting to UCVM
- UCVM, test out docker setup for python2/ucvm/ucvm_plotting
- UCVM, rework get_largefiles.py to pick up path/config info from setup.list instead of current hardwired method.
- CFM, extend the REST API to allow ingesting of 'external' gocad tsurf file and displaying it on plot3D
- CFM, add 'sharing link' option to plot3D, implement command option/REST API, to CFM viewer.
- CGM, add surface plot for INSAR's velocity data given a boundary
- CGM, add 2d view of INSAR data, add time series plot for INSAR data (calling python pkg)
- CGM, add GNSS time series data hosted at MIT with plotly plot
- CGM, flesh out GNSS data access, add INSAR data
- CGM, trimmed out CFM part of code out of CGM_view 1.0, rework some search logic
- CFM, add seismicity data to 3dPlot vtk viewer as point scatter plots
- CFM, add seismicity data to map base leaflet as pixi overlay - Hauksson, Ross, and significant faults layers
- CM, update UCVM part of code with new UCVM+ucvm_plotting code bases
- UCVM, reactivated and updated the Utah velocity model, WH
- UCVM, add 2 new basin velocity models from LSU, (SSIP Imperial Valley, SSIP Coachella Valley)
- CFM, release CFM viewer with CFM5.3, plus many updates to viewer functions, ie. fault search filtering, strike and dip search option
- UCVM, split the plotting out to different github repository to simplify the UCVM's dependency python3. --https://github.com/SCECcode/ucvm_plotting
- USC, test out USC discovery/endeavour slurm/sbatch/srun/mpirun with UCVM's mpi code
- UCVM, Elnaz TACC/ucvm2etree_extract_MPI was having problem. It turns out global variable for zrange needs to be initalized when using intel mpi compiler on Frontera.
- GFM, add 3d viewer to GFM viewer
- CRM/CXM viewer tool to do shp file -> Geojson conversion with postgis -> convert data for CTM, CRM
- CM+UCVM, create CM viewer with integrated 2d mapview with CFM/GFM/CTM, and ucvm viewer capability
- GFM+CRM, update GFM with CRM and a new viewer setup
- GFM, process the shp CRM_polygons_Plesch_Mar_7_2019 from Liz Hearn (CRM pqsql schema)
- CFM, expand 3d viewer to include surface california shoreline+border as reference orientation
- CFM, expand 3d viewer to include surface trace/blind for faults
- CFM, expand 3d viewer to have a orientation axes marker
- CFM, expand 3d viewer to allow user selectable color picker for each 3D fault representation
- CFM, expand 3d viewer to include toggle option for surface/wireframe
- UCVMC, extract geometry geoJson for the 2D area from CRM_polygons_Plesch_Mar_7_2019 and create an optional layer over UCVMC viewer
- CFM, VTK.js has some updates, need to bring that in, look into vtkOrientationMarkerWidget for CFM_web
- UCVMC, test GitHub actions and runner for continuous integration setup for ucvm build
- CFM, on fixing the mixing blindness in a fault - array of blinds at OBJECT_tb
- CFM, extract geometry geoJson of faults from CFM5.2 into a standalone external file and code ingest leaflet groupLayer that can be reused with any leaflet based scec viewers
- UCVMC, review various places where vs30/Wallis is used in ucvm/models
- UCVMC, adding Cencal & CCA06 to Moho's ucvm_web
- UCVMC, trace the UCVM VS30 values that differ from Rob Grave's VS30 list. interpolation vs nearest point:https://scec.usc.edu/scecpedia/UCVM_VS30_etree_map_(Wills_2015)_UCVM%27s_interpolation#vs30_etree_map
- UCVMC, add a new model for UCVMC, Albacore, Southern California Offshore velocity model, kohler@caltech.edu, Daniel.bowden@erdw.ethz.ch
- UCVMC, a list of elevations for elevation-based profile script in generated meta file
- UCVMC, branch cleanup on UCVMC -- only Master, forGFM, withSVM, forPython3 left
- UCVMC, verify UCVM's CVMS4.26 profile plots matches with Billy's averaging profile plot with EnJui's CVM4SI26_slices. Also, tested with PO Chan's set of CVMS4.26 dataset.
- UCVMC, make a mini dockerized UCVM image with cvms, cvms5, and cvmh1511 git@github.com:SCECcode/ucvm_docker.git
- UCVMC, needs some Z25/Z10 data for some models with GTL https://scec.usc.edu/scecpedia/UCVM_z1,z2.5_for_CCA06_with_GTL,_CVM-S4.26.M01
- UCVMC, viewer that allow user to query for UCVMC material property and initiate the plotting capability in UCVMC/utilities(git@github.com:SCECcode/UCVM_web.git)
- UCVMC, add Elevation query mode to ucvm2mesh, ucvm2mesh_mpi, ucvm2mesh_mpi_layer, (currently on branch -forGFM). User needs to include cvmh as part of cvmlist and let UCVM's model tiling to set the property values for in-air, in-water properly,ucvmlist=cvmsi,cvmh. Note: if region is outside of cvmh area, then no data would exists for those regions. In configuration file, specify querymode=ELEVATION
- CFM, add simple 3d viewer (using vtk.js) to selected faults
- SVM, Elnas has requested generation of 3 new etrees, https://scec.usc.edu/scecpedia/UCVM_svm_etree and new data is at https://scec.usc.edu/scecpedia/UCVM_svmgtl_and_elygtl
- GFM, viewer that allow user to query for GFM material property + plotting capability(https://github.com/SCECcode/GFM_web.git)
- GFM, geological features decorated model -- update vx-lite with new g model files
- CFM, study web page accessibility, https://www.w3.org/TR/wai-aria-practices, study ui write-up, https://www.smashingmagazine.com/06/designing-perfect-accordion-checklist/
- CFM, prep the core CFM code for the new CFM data release (Edric has been updating and maintaining UI per user's requests) -- CFM5.2-Fault_ID_preferred_final.xlsx, CFM52_db, nonblind, blind native ts files
- UCVMC, SVM GTL from Caltech (https://scec.usc.edu/scecpedia/UCVM_svmgtl_and_elygtl) and (https://scec.usc.edu/scecpedia/UCVM_svmgtl)
- UCVMC,review and update the GitHub UCVMC's wiki pages
- UCVMC,tied up loose ends and tests for UCVM V19.4,add examples directory for program and plots examples
- UCVMC, generate etree for Garner Valley, CA for elnaz@caltech.edu, https://scec.usc.edu/scecpedia/UCVM_etree_for_Garner_Valley
- UCVMC, add plot_elevation_profile.py and plot_elevation_cross_section.py,(ctape@alaska.edu) https://scec.usc.edu/scecpedia/UCVM_elevation_vs_depth,_model_boundary
- CFM, document CFM dashboard in github and transfer to SCEC space
- CFM, streamline the preprocessing of CFM database -- xlsx file to Postgres db
- UCVMC, generate plots for USGS CVM doc -- http://hypocenter.usc.edu/research/ucvmc/USGS-CVM-plot.tar.gz
- CFM, add analytic tracking to the dashboard -- Edric/google
- CFM, add latlon search option with direct location selection on the map area
- CFM, add highlighting of faults on the viewer part in addition to be from the table
- CFM, add group download(zip) of multiple faults geo data and meta data
- UCVMC, final set of plot/data for jplet@cpp.edu, 400+ 1d plots in http://hypocenter.usc.edu/research/ucvmc_result/pomona4.tar.gz, cross section plots in http://hypocenter.usc.edu/research/ucvmc_result/pomona3.tar.gz
- CFM, update cfm dashboard(add dip search, add 'key' trigger to keywordTxt, change latlon search to 4 inputs)
- CFM, add download function to CFM dashboard (on popup window)
- CFM, stash the CFM5.2 dataset at asperity's /var/www/html/CFM5_preferred/native, 500m, 1000m
- CFM, refine end-to-end setup of new CFM dashboard to server/client test environment
- CFM, setup initial CFM db host over at AWS, http://asperity.scec.org/CFM/web/cfm_view.html
- UCVMC, first set of plot/data for jplet@cpp.edu. https://scec.usc.edu/scecpedia/UCVMC_basin_depth_study,_poly_tech,_Pomona
- UCVMC, support jpolet@cpp.edu's group with cross_section and depth_profile processing (added metadata/data output to depth_profile.py) https://scec.usc.edu/scecpedia/UCVMC_how_to_plot_cross_section_and_depth_profile
- CFM, gather and define the functions needed for the leaflet CFM viewers and study leaflet api and start building up the viewer utilities
- UCVMC, update 1d grid reference data for UCVMC acceptance test
- CFM, add the linkup in js for the leaflet viewer and postgis' geoJSON geometry trace info
- CFM, add php/js to extract geoJSON for target fault object during query and track them to be sent to the viewer
- CFM, translate shapesfiles from release tarball into postgis db sql script and ingest into backend db
- CFM, explore and code a leaflet viewer with canned geoJSON data
- CFM, code php/java scripts/html page for queries with user input:query by region (with on the fly region list extracted from backend db via php), query by a range of strike value(with on the fly min/max strike range, extracted from the backend db via php), query by keyword(full text search from postgres db on object name, can be expanded in the future per request); query by latlon (within 0.0001 precision, a small roi box is created and used postgis to make overlap check)
- CFM, preprocess the excel from CFM5_release_2017, define db/tb schema and ingest the information into postgres db.
- UCVMC,generate the tiled v1000 data that Kevin needed for https://github.com/kevinmilner/cybershake-analysis/tree/master/study_18_8/hazard_maps#study-188-hazard-maps, they are left with https://scec.usc.edu/scecpedia/Bay_Area_Velocity_Model_Z2.5_data#Bay_Area_Velocity_Model
- CFM,study requirements for work on SCEC Community Fault Model,start with postgres db, postgis extension, php service, javascript, leaflet, tile service from open street map.
- UCVMC,define the json blob for material properties used in plotting scripts, define import and export to file format, rpretell@ucdavis.edu, https://scec.usc.edu/scecpedia/LA_Vertical_Profiles#Result
- UCVMC,look into updating Wills' map in UCVMC, https://scec.usc.edu/scecpedia/Wills_Map, ucvm.e
- UCVMC,work to make Rob Grave's mesh generating code to work for him (tweak Rob's directory and Scott's https://source.usc.edu/svn/cybershake/import/trunk/UCVM)
- UCVMC,doc how to process .bin file generated from plotting script or ucvm basin_query call, https://scec.usc.edu/scecpedia/UCVMC_How_to_process_bin_data
- UCVMC,translate pbs/hpc/ucvm2mesh to slurm calls
- (No work done)Generate large (100M+ point) AWP mesh using ucvmc and ucvmp and compare(Scott said ucvmp can not generate big mesh since it does not have mpi flavor to it)
- UCVMC,Bay Area velocity model's z2.5 plots for Kevin -- different tiling order of cca/cencal/cvms5 , https://scec.usc.edu/scecpedia/Bay_Area_Velocity_Model_Z2.5_data#Result
- UCVMC,updated cca06 crossing data for Kevin (fuzzy edge problem compare to UCVM python version, a bug found by Scott in CCA06 C version), nwo includes two sets, one without GTL and the other with GTL, https://scec.usc.edu/scecpedia/Final_CCA06_Crossings_Result
- Doc how La Habra mesh is made with ucvm2mesh_mpi_layer, https://scec.usc.edu/scecpedia/UCVMC_La_Habra_mesh_generation#ucvm2mesh_mpi_layer
- UCVMC,Generated various plots highlight CS17.3-H, https://scec.usc.edu/scecpedia/UCVMC_CS17.3-H_plots#Plots
- UCVMC,Registered new Central California Basin Model from Havard. CS17.3-H with ELY GTL
- UCVMC,built a useable UCVMC installation on Titan, /lustre/atlas/proj-shared/geo112/ucvm_18_5/
- UCVMC,made UCVMC statically linkable and the plugin models worked as in dynamically linked UCVMC
- UCVMC,reworked logic in ucvm2mesh-mpi to have a more 'feasible' compute node requirement for very large mesh like La Habra, ucvm2mesh_mpi_layer, remember to strip result directory when running at blue waters. lfs setstripe -c 4 /path/to/working/directory
- UCVMC,extract UCVMC cs173 info for Scott's gridpoints (off alittle but okayed by Scott)
- UCVMC,reworked basin_query tests in slurm on hpc
- UCVMC,created a pull request to official UCVM-C, fix up each models that is in github -- merged into official UCVMC's dev branch
- UCVMC,Ran tests tiling cencal+cca+cvms5+bbp1d, the 1d part gets surface gtl
- UCVMC,Tiled cencal+cca(with gtl)+cvms5(with gtl)+1d tested and verified
- UCVMC,GTL for CCA06- verified by generating identical plots to CyberShake_Study_18.5
- UCVMC,Fixed plugin/dynamic loading of modules, Scott's interleaving bug, fixes for cvmsi is also needed for the plugin module. There was the missed case for left-over points in chunking/processing code, fixed that. Also the code was not setup to take more than one dynamic library
- UCVMC,Setup to run my latest UCVMC on blue water - query works but plotting scripts do not work with BW's installed default pthread library(too old, conflicting with matplotlib's pyplot from Anaconda2)
- UCVM,Fixed segfaults flagged from a working ucvmc installation on local mac (fixed cs173_final(), cca_final()), (mac gdb installation hints: https://gist.github.com/gravitylow/fb595186ce6068537a6e9da6d8b5b96d)
- UCVMC,Ran basin_query_mpi on hpc with SLURM
- UCVMC,Doc projection fix on scecpedia, https://scec.usc.edu/scecpedia/Final_Projection_Review_Result
- UCVMC,Add the fixed config file into CCA's github, also edits from below(pending moving to scec space): https://github.com/meihuisu/CCA.git
- UCVMC,Copy the CCA06 data on scec-01/Intensity to hypocenter, change the dependency to hypocenter in the make-data script
- UCVMC,adding elygtl to CCA06
- UCVMC,new cs173 github location(pending moving to scec space):https://github.com/meihuisu/cs173.git
- UCVMC,Register Scott NorCal model into UCVM - CS173, compare CS173 plots from ScottC with my version
- UCVMC,Doc CCA06 Crossing review, https://scec.usc.edu/scecpedia/Final_CCA06_Crossings_Result
- UCVMC,Update basin_query_mpi to return list of crossing per grid point, also return one crossing output file for each algorithm.
- UCVMC,To check projection fix, trace processing from en-jui data files to configuration files
- UCVMC,Cross section plots showing 0-10km depth through CCA06, showing velocity inversions, starting at one end of region at 5km spacing to other end of region. **No need, posted inversion plot in scecpedia**