Difference between revisions of "Research Computing"

From SCECpedia
Jump to navigationJump to search
(Created page with "Updates on Research Computing Activities == 7 Feb 2020 == # Developed RC material for FRES proposal **[https://drive.google.com/open?id=1PcserDpSu8Fp5Xg_6L20kjZ0yzV7uN9p RC T...")
 
 
(81 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
Updates on Research Computing Activities
 
Updates on Research Computing Activities
 +
== 22 October 2020 ==
 +
*[http://hypocenter.usc.edu/research/CME/SCEC_RC_Activities_2020_v2.pptx SCEC5 Milestone-Related RC Activities]
 +
 +
== 15 Oct 2020 ==
 +
*[[CIG Workshop]]
 +
**[http://hypocenter.usc.edu/research/CME/NAS_Seismology_Vision_2020_2030_25761.pdf CORES Seismology 2020-2030 Report]
 +
*[[Summit ML Training]]
 +
*[[SCEC CyberInfrastructure White Papers (2017-2020)]]
 +
**[http://hypocenter.usc.edu/research/CME/SCEC_CI_Papers/Maechling_SCEC6_Computational_Needs_v4.pdf  SCEC 6 Computational Needs Response]
 +
*[[SCEC CARC Migration Planning]]
 +
**[http://hypocenter.usc.edu/research/CME/SCEC5_DataMgmt_final_copy.pdf SCEC5 Data Management Plan]
 +
*[[Broadband Server]]
 +
 +
== 7 Aug 2020 ==
 +
* Updated distribution mapping rock types to mineral composition integrated into GFM/CTM site.
 +
**[http://hypocenter.usc.edu/research/CME/CRMslabformat_July282020_Oskin.xlsx Excel file mapping GFM regions and depths to mineral types]
 +
 +
* Updated query of GFM/CTM returns Thatcher CTM data, and rock types
 +
**[http://moho.scec.org/GFM_web/web/viewer.php GFM/CTM Webviewer]
 +
 +
* Group review of PyCSEP tutorial by WS
 +
**[https://github.com/SCECcode/csep2 PyCSEP source code repo]
 +
**[https://csep.readthedocs.io/en/latest/ PyCSEP software documenation]
 +
 +
*CVM-H model in netCDF format for CVM Workshop out for review
 +
**[https://scec.usc.edu/scecpedia/IRIS_EMC CVM-H Model bundle for IRIS]
 +
 +
* Workplanning with Group through SCEC annual meeting
 +
** CTM/GFM site, CFM 5.3 integration, SCMV site updates, UCVM consolidation for next release
 +
** BBP model development and runs to support Ridgecrest, High-F processing and tools to support La Habra sims
 +
** CSEP workshop planning and PyCSEP software release, and tutorial development
 +
** CyberShake BBP workflow development and testing
 +
** Contribution of CVM models to IRIS EMC to support CVM workshop
 +
 +
== 17 July 2020 ==
 +
CSEP Workshop Planning
 +
*Proposed workshop concept seems to be Workshop as series of talks overs several weeks, recorded, like a seminar series.
 +
* Are there two CSEP workshops?
 +
*What coordination is needed with HQ, what kind of help is CSEP group asking for (e.g. website), when does the workshop need to be completed, are there suggestions on what topics or speakers are covered.
 +
New prototypes for CFM and GFM Viewers
 +
*[http://asperity.scec.org/ Updated CFM Website with GFM Region overlays]
 +
*[http://moho.scec.org/GFM_web/web/viewer.php Updated GFM Viewer Mapview and updated query]
 +
*[http://hypocenter.usc.edu/research/CME/CXM_Call_Notes_8July_2020.docx Todo list created 8 July 2020]
 +
* Calculating updated temperature values from Thurber Temp model for each GFM Cell (866000 cells) to return to AP.
 +
AGU Sessions and Abstracts
 +
*“Developments in Earthquake Ground Motion Modeling and Advancements Towards Fault-to-Structure Simulations”
 +
** Scott Callaghan - CyberShake with BBP
 +
** Fabio Silva - BBP with Ridgecrest Validation Events
 +
*Integrating Related Earthquake Datasets: How to combine Geodesy, Seismology, and Geology in Informative Ways
 +
**Mei-Hui Su - CVM/GFM/CFM/CTM Webviewers
 +
*A tour of open-source software packages for the geosciences
 +
** Willian Savran - PyCSEP developments
 +
CSEP Cluster
 +
*Accessible through VPN
 +
*Documentation from JY
 +
AWS Gitlab Server
 +
* Reviewed Estimate from AWS with AWS/WS/SC
 +
* Continue with free service while reviewing GDPR requirements
 +
New laptop arrived this week
 +
* Will send old one in for battery repair once restore is completed
 +
 +
== June 19 2020 ==
 +
* Local version of kitchen scene
 +
* Received gitlab on aws estimate
 +
* Defined done for development of csep cluster
 +
* Updated CFM site change requests from Scott M
 +
* Suggest review of CXM sites and plans
 +
* BBP sprint planning with FS
 +
* Asking about XSEDE allocation computing needs
 +
* Ground Motion Modeling special issue
 +
* EarthCube yt geoplots and geochronology presentations
 +
* CSEP (D. Jackson) suggestion position papers for annual meeting
 +
* Cheese call Monday 8am
 +
* Activity info on slack channel
 +
 +
== June 5 2020 ==
 +
* SCEC Storage summaries
 +
**[http://hypocenter.usc.edu/research/CME/docs/SCEC_Storage_Summary.docx SCEC RC Storage Summary]
 +
**[http://hypocenter.usc.edu/research/CME/docs/DDN_USC032020_SR_114915_2MTH_EOSL.pdf DDN Maintainence Charges]
 +
**[http://hypocenter.usc.edu/research/CME/docs/CsepData_v3.docx CSEP Data Summary]
 +
**[http://hypocenter.usc.edu/research/CME/docs/USGS_DataLifecycle_of2013-1265.pdf USGS Research Data Lifecycle Description]
 +
*Cheese Agreement Discussions
 +
**[http://hypocenter.usc.edu/research/CME/docs/Cheese_Email.docx Cheese Agreement Email]
 +
* Call with USC Stevens to discuss Software IP and BSC agreement
 +
**[https://stevens.usc.edu/ USC Stevens Center for Innovation Research Disclosure]
 +
**[http://hypocenter.usc.edu/research/CME/docs/USC-Stevens-Guidance-on-Software-Distribution-050318.pdf Stevens Guidance on Software Distributions]
 +
**Proposed Call times:
 +
**Monday 11am-3pm
 +
**Tuesday 8am-10am
 +
**Wednesday after 10am
 +
<!--
 +
* Thorsten B Computational Geoscience Webinar planning
 +
**June 11, 1 pm Central (2 pm Eastern, 11 Pacific) seem to work for all.
 +
** Zoom link https://us02web.zoom.us/j/88017196449
 +
-->
 +
* XSEDE Jetstream Final Report
 +
**[http://hypocenter.usc.edu/research/CME/docs/SCEC_Jetstream_Allocation_Final_Report.pdf SCEC Jetstream Final Report on CSEP Cloud Testing]
 +
* Data Management White Paper to SAGE/GAGE
 +
**[http://hypocenter.usc.edu/research/CME/docs/Maechling_SAGE_GAGE_DCL.pdf DataManagement White Paper]
 +
 +
== 1 May 2020 ==
 +
<!--
 +
* USC Stevens recommendations on Software Licenses
 +
* USC Job Descriptions
 +
* Combined CVM/CFM/CRM webviewer
 +
* Improvements in CyberShake fit
 +
* Cheese Training on CyberShake for European researchers
 +
* Scott as Intern mentor
 +
* CSEP Gitlab AWS operations
 +
* Integration of EDGE results into High-F comparisons
 +
-->
 +
 +
== 17 April 2020 ==
 +
* Described a new type of "depth/elevation query model for Albacore Model
 +
**[http://hypocenter.usc.edu/research/ucvm/Albacore_Update_16April2020.pptx Plots of Model In Powerpoint]
 +
* Reviewed of Vs30 values returned from UCVM
 +
**[http://scec.usc.edu/scecpedia/UCVM_Vs30 Table comparing Wills Vs30 versus Slowness Vs30 from alternative SoCal CVMS]
 +
* New deployment of UCVM_Web adds new models (added .M01, CenCal, Albacore, 1D models)
 +
**[http://moho.scec.org/UCVM_web/web/viewer.php UCVM_Webviewer]
 +
* CSEP Software development configured to run tests on new codes
 +
**Travis-CI
 +
* Updating CyberShake to calc 10Hz seismograms
 +
* High-F improvements to process AWP, RGW, Hercules, and EDGE 4Hz+ seismograms consistently
 +
* SCEC Contributions to NSF OCI
 +
** NSF 20-015 Dear Colleague Letter: Data-Focused Cyberinfrastructure Needed to Support Future Data-Intensive Science and Engineering Research
 +
**[https://www.nsf.gov/cise/oac/datacirfi/rfi_responses.jsp Responses]
 +
**Dear Colleague Letter: Request for Information on Future Needs for Advanced Cyberinfrastructure to Support Science and Engineering Research (NSF CI 2030)
 +
**[https://www.nsf.gov/cise/oac/ci2030/rfi_responses.jsp CI2030 Responses]
 +
* Scott nomination for OLCF User Group Executive Board
 +
**[https://www.olcf.ornl.gov/about-olcf/oug/ Current OEG EB]
 +
* Proposed Staff Talk - Thursday
 +
** Maechling - Developing a CVM Testing System
 +
 +
== 13 March 2020 ==
 +
* Used UCVM to reproduce CVM-S4.26 results from Elymod/Jordan Paper
 +
**[[UCVM_Verification]]
 +
*Integrated Albacore (Bowden,Kholer) Off-shore Southern California Model into UCVM
 +
**[http://hypocenter.usc.edu/research/ucvm/Albacore_model_v2.pptx Albacore Model Plots]
 +
**[http://moho.scec.org/UCVM_web/web/viewer.php Review in UCVM Web prototype]
 +
**[[Offshore_Southern_California_Velocity_Structure]]
 +
* NVIDIA Follow-up Meeting
 +
**[http://hypocenter.usc.edu/research/nvidia/video-medium-2020-02-06_15-15_Trim.mp4 Improved Physics Version of Ridgecrest EQ]
 +
**[http://hypocenter.usc.edu/research/nvidia/SCEC_NVIDIA_12March2020.pptx Project Update 12 March 2020]
 +
**[[Magnitude_Versus_Intensity]]
 +
* CyberShake 50Hz Development
 +
* CSEP Japan forecast evaluation development with Rise
 +
*[https://www.usgs.gov/media/videos/animation-a-scenario-m69-earthquake-rose-canyon-fault USGS Article Rose Canyon Simulation - USGS, SCEC, Blue Waters Collaboration]
 +
* Software and HPC White Paper Development
 +
 +
== 14 Feb 2020 ==
 +
Activities since start of 2020
 +
*[https://www.openstoragenetwork.org/ Open Storage Network]
 +
*[https://fronteraweb.tacc.utexas.edu/about/ Frontera Phase 2 Leadership-Class Computing Facility (LCCF) Planning Meeting]
 +
**Ed Walker - NSF CISE/OAC
 +
*Submitted On-Demand Allocation to run Earthquake Forecast models after a significant California Earthquake
 +
* Docker hub distribution of UCVM with 3 models CVM-S4, CVM-H, and CVM-S4.26
 +
  docker pull sceccode/miniucvm
 +
*
  
 
== 7 Feb 2020 ==
 
== 7 Feb 2020 ==
−
# Developed RC material for FRES proposal
+
* Developed RC material for FRES proposal
−
**[https://drive.google.com/open?id=1PcserDpSu8Fp5Xg_6L20kjZ0yzV7uN9p RC Task Descriptions]
+
**[https://drive.google.com/open?id=1PcserDpSu8Fp5Xg_6L20kjZ0yzV7uN9p FRES RC Task Descriptions]
−
# Contributed drafts of 2 white papers
+
* Contributed drafts of 2 white papers
 +
**[https://drive.google.com/file/d/1kjR-5OYHYdZLwl5cyMK2WuLVlh64UIGU/view?usp=sharing Software Ecosystem]
 
**[https://drive.google.com/open?id=1O4Q8TleEPUNKstN9dUt6XYrFNRAdDqqX Ground Motion Model Testing Center]
 
**[https://drive.google.com/open?id=1O4Q8TleEPUNKstN9dUt6XYrFNRAdDqqX Ground Motion Model Testing Center]
−
**[https://drive.google.com/open?id=18j_FTZG1kiakaiBXxGkHIvE4gU56diqr Software Ecosystem]
+
* What messages do we want from our HPC collaborator (TACC,NCSA, SDSC, Pegasus)?
−
# What messages do we want from our HPC collaborator (TACC,NCSA, SDSC, Pegasus)?
 
 
**Earth science as a technology driver (Earth Simulator)
 
**Earth science as a technology driver (Earth Simulator)
 
**Co-design (computer and research goal) idea
 
**Co-design (computer and research goal) idea
Line 14: Line 172:
 
**Need for Simulation Data Management
 
**Need for Simulation Data Management
 
**Need for observational data management
 
**Need for observational data management
−
# Call with M. Kholer/D. Bowden about adding their offshore model to UCVM
+
* Call with M. Kholer/D. Bowden about adding their offshore model to UCVM
 
**[http://scec.usc.edu/scecpedia/Offshore_Southern_California_Velocity_Structure Albacore SoCal Velocity Model]
 
**[http://scec.usc.edu/scecpedia/Offshore_Southern_California_Velocity_Structure Albacore SoCal Velocity Model]
−
# Working on series CXM activities some with pending reviews from CXM group, CFM update, GFM review, CVM website, CVM-S4.26 distribution.
+
* Working on series CXM activities some with pending reviews from CXM group  
−
# CSEP needs support from Steve Lin. Specially a dedicated system for testing codes. Recommendation on how to get his help. Approach John Parker, or Steve, Yehuda coordination with Frank…setup ourselves?
+
**[https://www.scec.org/research/cfm-viewer/ CFM Web] Community Fault Model Viewer update  
−
# Several of us provided feedback on ways to improve the center. Possibly we can discuss those that have merit.  
+
**[http://moho.scec.org/GFM_web/web/viewer.php GFM Web] Geological Framework Model Viewer update
 +
**[http://moho.scec.org/UCVM_web/web/viewer.php CVM Web] Community Velocity Model Viewer review
 +
** Simplified CVM-S4.26 distribution
 +
* SCEC/USC now has some IT support from Steve Lin (replacement for John Yu). CSEP needs a dedicated system for testing codes, will coordinate with Yehuda on how to get his help. Options include approach John Parker, or Steve, Yehuda coordination with Frank, or we setup ourselves.
 +
**[[Dornsife_Technology_Services_(DTS)]]
 +
 
 +
== Coordinating Staff Meeting ==
 +
There is a series of documents describing your responsibilities when coordinating the staff meeting.
 +
*[https://docs.google.com/document/d/1pwYXPSMXG6IM4JyGZOuMoKrGc-DsAxpbWVhdfbN_lDU/edit#heading=h.z96hohjci1yk Instructions]
 +
 
 +
*[https://docs.google.com/presentation/d/1Pioqm1LmDo-kHPSCw9CUpS1ZH5Vrm2izTWBKnUscCJs/edit#slide=id.g579f000d53_0_0 More instructions]
  
 
== Related Entries ==
 
== Related Entries ==
 
*[[Main Page]]
 
*[[Main Page]]

Latest revision as of 05:33, 23 October 2020

Updates on Research Computing Activities

22 October 2020

15 Oct 2020

7 Aug 2020

  • Workplanning with Group through SCEC annual meeting
    • CTM/GFM site, CFM 5.3 integration, SCMV site updates, UCVM consolidation for next release
    • BBP model development and runs to support Ridgecrest, High-F processing and tools to support La Habra sims
    • CSEP workshop planning and PyCSEP software release, and tutorial development
    • CyberShake BBP workflow development and testing
    • Contribution of CVM models to IRIS EMC to support CVM workshop

17 July 2020

CSEP Workshop Planning

  • Proposed workshop concept seems to be Workshop as series of talks overs several weeks, recorded, like a seminar series.
  • Are there two CSEP workshops?
  • What coordination is needed with HQ, what kind of help is CSEP group asking for (e.g. website), when does the workshop need to be completed, are there suggestions on what topics or speakers are covered.

New prototypes for CFM and GFM Viewers

AGU Sessions and Abstracts

  • “Developments in Earthquake Ground Motion Modeling and Advancements Towards Fault-to-Structure Simulations”
    • Scott Callaghan - CyberShake with BBP
    • Fabio Silva - BBP with Ridgecrest Validation Events
  • Integrating Related Earthquake Datasets: How to combine Geodesy, Seismology, and Geology in Informative Ways
    • Mei-Hui Su - CVM/GFM/CFM/CTM Webviewers
  • A tour of open-source software packages for the geosciences
    • Willian Savran - PyCSEP developments

CSEP Cluster

  • Accessible through VPN
  • Documentation from JY

AWS Gitlab Server

  • Reviewed Estimate from AWS with AWS/WS/SC
  • Continue with free service while reviewing GDPR requirements

New laptop arrived this week

  • Will send old one in for battery repair once restore is completed

June 19 2020

  • Local version of kitchen scene
  • Received gitlab on aws estimate
  • Defined done for development of csep cluster
  • Updated CFM site change requests from Scott M
  • Suggest review of CXM sites and plans
  • BBP sprint planning with FS
  • Asking about XSEDE allocation computing needs
  • Ground Motion Modeling special issue
  • EarthCube yt geoplots and geochronology presentations
  • CSEP (D. Jackson) suggestion position papers for annual meeting
  • Cheese call Monday 8am
  • Activity info on slack channel

June 5 2020

1 May 2020

17 April 2020

  • Described a new type of "depth/elevation query model for Albacore Model
  • Reviewed of Vs30 values returned from UCVM
  • New deployment of UCVM_Web adds new models (added .M01, CenCal, Albacore, 1D models)
  • CSEP Software development configured to run tests on new codes
    • Travis-CI
  • Updating CyberShake to calc 10Hz seismograms
  • High-F improvements to process AWP, RGW, Hercules, and EDGE 4Hz+ seismograms consistently
  • SCEC Contributions to NSF OCI
    • NSF 20-015 Dear Colleague Letter: Data-Focused Cyberinfrastructure Needed to Support Future Data-Intensive Science and Engineering Research
    • Responses
    • Dear Colleague Letter: Request for Information on Future Needs for Advanced Cyberinfrastructure to Support Science and Engineering Research (NSF CI 2030)
    • CI2030 Responses
  • Scott nomination for OLCF User Group Executive Board
  • Proposed Staff Talk - Thursday
    • Maechling - Developing a CVM Testing System

13 March 2020

14 Feb 2020

Activities since start of 2020 

 docker pull sceccode/miniucvm

7 Feb 2020

  • Developed RC material for FRES proposal
  • Contributed drafts of 2 white papers
  • What messages do we want from our HPC collaborator (TACC,NCSA, SDSC, Pegasus)?
    • Earth science as a technology driver (Earth Simulator)
    • Co-design (computer and research goal) idea
    • Need for dedicated domain specific computing
    • Need for on-demand computing
    • Need for Simulation Data Management
    • Need for observational data management
  • Call with M. Kholer/D. Bowden about adding their offshore model to UCVM
  • Working on series CXM activities some with pending reviews from CXM group
    • CFM Web Community Fault Model Viewer update
    • GFM Web Geological Framework Model Viewer update
    • CVM Web Community Velocity Model Viewer review
    • Simplified CVM-S4.26 distribution
  • SCEC/USC now has some IT support from Steve Lin (replacement for John Yu). CSEP needs a dedicated system for testing codes, will coordinate with Yehuda on how to get his help. Options include approach John Parker, or Steve, Yehuda coordination with Frank, or we setup ourselves.

Coordinating Staff Meeting

There is a series of documents describing your responsibilities when coordinating the staff meeting.

Related Entries

Retrieved from "https://strike.scec.org/scecwiki/index.php?title=Research_Computing&oldid=25134"