Difference between revisions of "ALCF ML Workshop"

From SCECpedia
Jump to navigationJump to search
(Created page with "== ALCF ML Workshop == *[https://events.cels.anl.gov/event/41/timetable/#20201208 Agenda] *[https://www.alcf.anl.gov/science/projects/extreme-scale-simulations-advanced-seismi...")
 
 
(7 intermediate revisions by the same user not shown)
Line 1: Line 1:
 +
SCEC researchers participated in the ALCF ML Workshop 8 Dec - 10 Dec 2020
 +
 
== ALCF ML Workshop ==
 
== ALCF ML Workshop ==
 
*[https://events.cels.anl.gov/event/41/timetable/#20201208 Agenda]
 
*[https://events.cels.anl.gov/event/41/timetable/#20201208 Agenda]
 +
*[https://www.alcf.anl.gov/alcf-resources/theta ALCF Theta Description]]
 +
*[https://github.com/argonne-lcf/sdl_ai_workshop Workshop Github Repo]
 +
*[https://github.com/jonasrauber/eagerpy Useful ML Github repo]
 +
*[https://anl.app.box.com/s/zqo4v52e4bnl3ox8bvqtajjiuro2uha2 Getting Started at ALCF]
 +
 +
== Use of Google Colaboratory ==
 +
Workshop will use jupyter notebooks running in google collaboratory.
 +
*[https://colab.research.google.com/notebooks/intro.ipynb#recent=true Test Python Jupyter Notebook]
 +
*<username>@theta.alcf.anl.gov
 +
 +
== qsub ==
 +
From /home/maechlin/sdl_ai_workshop/01_distributedDeepLearning/Horovo
 +
*qsub -O pytorch_keras_scale -n 128 -q training -A SDL_Worsubmissions/theta/qsub_keras_mnist_scale.sh
 +
 +
From /home/maechlin/sdl_ai_workshop/02_dataPipelines/00_tensorflowDatasetA
 +
*qsub -O tensorflow_dataset -n 1 -q training -A SDL_Workshop submit_theta.sh
 +
 +
== SCEC At ALCF ==
 
*[https://www.alcf.anl.gov/science/projects/extreme-scale-simulations-advanced-seismic-ground-motion-and-hazard-modeling-0 SCEC at ALCF]
 
*[https://www.alcf.anl.gov/science/projects/extreme-scale-simulations-advanced-seismic-ground-motion-and-hazard-modeling-0 SCEC at ALCF]
  
 
== Related Entries ==
 
== Related Entries ==
*[[]]
+
*[[CyberShake]]

Latest revision as of 20:16, 8 December 2020

SCEC researchers participated in the ALCF ML Workshop 8 Dec - 10 Dec 2020

ALCF ML Workshop

Use of Google Colaboratory

Workshop will use jupyter notebooks running in google collaboratory.

qsub

From /home/maechlin/sdl_ai_workshop/01_distributedDeepLearning/Horovo

  • qsub -O pytorch_keras_scale -n 128 -q training -A SDL_Worsubmissions/theta/qsub_keras_mnist_scale.sh

From /home/maechlin/sdl_ai_workshop/02_dataPipelines/00_tensorflowDatasetA

  • qsub -O tensorflow_dataset -n 1 -q training -A SDL_Workshop submit_theta.sh

SCEC At ALCF

Related Entries