Intermediate Course 2025/04/10: Intermediate HPC and Data Management topics @KIT

Contribution List

6. Hints for successful submitting procedure to the HPC cluster (Horeka)

Martje Armbrecht

4/10/25, 9:30 AM

1. Intermediate Bash Scripting + Exercises

Michele Mesiti (KIT)

4/10/25, 10:35 AM

• Bash and shell features and utilities:
  * loops
  * using the terminal efficiently
  * basic unix tools and their composability
  * defensive programming
• ssh tips and tricks
• Discussion about workflows
• Bash/Job Scripting and HPC workflows:
  • best practices for data/metadata organization and wokflows
  • Job Arrays
  • Coalescing work...

5. File Systems

Begatim Bytyqi (KIT)

4/10/25, 2:15 PM

• Learn more about the file systems available at our Clusters
• Understand the advantages and disadvantages of each file systems.
• How to use file systems like $TMPDIR, BeeOND, LSDF, and PFS6
• Run simple benchmarks on different file systems.

4. Batch System: Best Practices and Running parallel jobs

Andreas Baer (KIT)

4/10/25, 3:20 PM

• Best practices for job setup and resource specification
• Job script templates
• Making use of the greatly parallel systems: specifying resources for parallel programs
• MPI programs (compute bound, memory bound, ...)
• OpenMP programs
• MPI + OpenMP hybrid programs

3. Adv. topics - Usage of bwHPC & HoreKa clusters

2. Advanced Job Scripting + Exercises