Intermediate Course 2025/04/10: Intermediate HPC and Data Management topics @KIT

Thursday Apr 10, 2025, 9:30 AM → 5:05 PM Europe/Berlin

Gebäude 20.21 (KIT Campus Süd)

Hany Ibrahim (KIT)

Das Scientific Computing Center lädt Sie herzlich am 10. April zum Kurs "Weiterführende Hochleistungsrechnen-(HPC) und Daten-Management-Themen" ein. Die Veranstaltung richtet sich an alle aktiven, forgeschrittenen Nutzer der bwHPC-Cluster (bwUniCluster, bwForCluster) und des Hochleistungsrechners HoreKa und umfasst Batch- und Job-Scripting, weiterführendes Jobmanagement (inkl. für parallele Anwendungen), Kompilieren, Remote-Visualisierung und Daten-Management. Vorkenntnisse im Umgang mit der Bash-Shell und dem Linux-Kommandozeileninterface werden für diesen Kurs empfohlen. Die Präsenzveranstaltung kombiniert Vorträge mit Tutorien. Der Kurs findet in englischer Sprache statt. Es fallen keine Teilnahmegebühren an.

---

The Scientific Computing Center is hosting the course: "Intermediate High Performance Computing (HPC) and Data Management topics" on April 10, 2025. This course is aimed at active, intermediate users of the bwHPC clusters (bwUniCluster, bwForClusters) and the HPC cluster HoreKa and includes advanced batch & job scripting, compiling, remote visualization and data management. Knowledge about the Bash shell and the Linux command line interface are recommended for this course. The event combines talks and tutorials. The course will be conducted in English. It is free of charge and will take place on-site.

slides

• 00_2025-04-10_HPC-DIC_course_-_Agenda_+_misc.pdf
• 01_2025-04-10_HPC-DIC-course_compute-time-projects-horeka.pdf
• 04_2025-04-10_HPC-DIC_course_-_batch_system_intermediate.pdf
• 06_2025-04-10_HPC-DIC_course_-_intermediate_filesystems.pdf

9:30 AM → 10:15 AM Hints for successful submitting procedure to the HPC cluster (Horeka)

Speaker: Martje Armbrecht

10:15 AM → 10:35 AM Break

10:35 AM → 12:35 PM Intermediate Bash Scripting + Exercises

• Bash and shell features and utilities:
  * loops
  * using the terminal efficiently
  * basic unix tools and their composability
  * defensive programming
• ssh tips and tricks
• Discussion about workflows
• Bash/Job Scripting and HPC workflows:
  • best practices for data/metadata organization and wokflows
  • Job Arrays
  • Coalescing work together: parbatch

Speaker: Michele Mesiti (KIT)

Collaborative pad

Lesson Material

12:35 PM → 2:15 PM Lunch Break

2:15 PM → 3:00 PM File Systems

• Learn more about the file systems available at our Clusters
• Understand the advantages and disadvantages of each file systems.
• How to use file systems like $TMPDIR, BeeOND, LSDF, and PFS6
• Run simple benchmarks on different file systems.

Speaker: Begatim Bytyqi (KIT)

06_2025-04-10_HPC-DIC_course_-_intermediate_filesystems.pdf

3:00 PM → 3:20 PM Break

3:20 PM → 4:50 PM Batch System: Best Practices and Running parallel jobs

• Best practices for job setup and resource specification
• Job script templates
• Making use of the greatly parallel systems: specifying resources for parallel programs
• MPI programs (compute bound, memory bound, ...)
• OpenMP programs
• MPI + OpenMP hybrid programs

Speaker: Andreas Baer (KIT)

04_2025-04-10_HPC-DIC_course_-_batch_system_intermediate.pdf