-
9/9/24, 10:00 AM
-
Achim Streit (KIT-SCC)9/9/24, 10:30 AMpublic to everybody attending HUF
Welcome
Go to contribution page -
Doris Ressmann (Karlsruhe Institute of Technlology)9/9/24, 10:45 AM
-
Jonathan Procknow9/9/24, 11:00 AM
-
Dorin Lobontu9/9/24, 1:30 PM
Dorin
Go to contribution page -
Pierre-Emmanuel BRINETTE (IN2P3 / CNRS)9/9/24, 2:00 PMpublic to everybody attending HUF
Updates on HPSS at IN2P3 Computing Center
- Infrastructure and HPSS upgrade
- ARM architecture support
-
Mr Basil Lalli (NERSC - LBNL)9/9/24, 2:50 PM
Last year at NERSC we retired our long-standing nagios-based HPSS monitoring deployment in favor of VictoriaMetrics, Loki and Alertmanager. We would like to share our experience and lessons learned on the way.
- Motivation for making this transition
- Limitations of Nagios-style monitoring
- How does VictoriaMetrics address these?
- General overview of our monitoring...
- Motivation for making this transition
-
Preslav Konstantinov (KIT)9/9/24, 3:10 PM
Preslav
Go to contribution page -
Andreas Petzold (KIT)9/9/24, 3:40 PM
-
9/9/24, 4:00 PM
-
9/9/24, 4:30 PM
-
Michael Meseke9/10/24, 10:00 AMhpss community only
-
Dr Forrest Greenwood (HPSS Subsriber)9/10/24, 10:45 AMhpss community only
As part of our efforts to upgrade our site to HPSS 10.3, Indiana University recently began development of a virtualized HPSS environment that we can use to quickly iterate on testing and development initiatives without tying up limited bare-metal hardware resources. This virtual-machine environment is patterned on the implementation created by IBM's HPSS Support team for use at the recent...
Go to contribution page -
Ms Guangwei Che9/10/24, 11:30 AM
SLAC National Accelerator Laboratory
Technology and Inovation Department
Scientific Computing SystemsWith a growing demand on HPSS S3 support from SLAC science user’s community, we eagerly started testing HPSS S3 interface since the pre-GA release in July 2023. From the initial fragile and immature version to today’s more robust and resilient state, we worked directly with HPSS S3...
Go to contribution page -
Elena Summer (Max Planck Computing and Data Facility (MPCDF))9/10/24, 11:45 AM
Starting from version 10.3, HPSS has an S3 interface. We at MPCDF have installed it on our test system to try it out in several usage scenarios including cloud sync - using Ceph Cloud Sync module as well as rclone, generating presigned URLs, and just using different S3 clients. Among our test actions, we are trying out put, get, remove S3 objects as well as getting S3 objects from tape. This...
Go to contribution page -
9/10/24, 1:05 PM
-
Mr Owen James (NERSC/LBNL)9/10/24, 1:45 PMpublic to everybody attending HUF
NERSC Site Report HUF24
Karlsruhe Institute of Technology Campus Nord from 09-12 September 2024Abstract
Topics to discuss
- NERSC Stats - PBs, etc
- Upgrade HPSS 7.4.3 to 9.3
New RHEL8 Core Servers.
New FS7300 metadata arrays.
Update existing movers to RHEL8.
Updated PAM auth module to work with NERSC Auth. - Install 4th TS4500...
-
Matt Starr9/10/24, 2:15 PM
-
Greg Thorsness9/10/24, 3:05 PMpublic to everybody attending HUF
-
Francis Dequenne (LBL)9/10/24, 4:05 PM
Abstract: For most sites, the HPSS disk cache is a critical component of the HPSS configuration, helping boosting performances of storing and retrieving data from the archive. However, it may be a bit of a black art to assess how big the disk cache should be, especially in environments that have grown over the tears. This talk will present a couple of tools that have been developed at NERSC,...
Go to contribution page -
Michael Meseke9/11/24, 10:00 AMhpss community only
-
Jonathan Procknow9/11/24, 11:00 AMhpss community only
2024 HUF Presentations by IBM
Go to contribution page -
Mr Geoff Cleary (LLNL)9/11/24, 11:30 AMpublic to everybody attending HUF
Imagine you turn on your work laptop or arrive at the office and find this message from the customer service team: "we have a user that is trying to retrieve many files from the HPSS archive. At the current retrieval rate, we estimate it will take 6 months for the user to retrieve all the files in the dataset. Can you help?"
What do you do? How do you proceed? What features does HPSS...
Go to contribution page -
9/11/24, 11:50 AM
-
9/11/24, 1:30 PM
-
Andreas Petzold9/11/24, 1:45 PM
At KIT we operate HPSS as a tape system for the GridKa WLCG Tier-1 and for the Baden-Württemberg Data Archive service. Performance limitations of the HPSS disk cache systems led us to explore new technology options for the disk cache, based on classic storage systems with SSDs, and storage servers with local NVMe devices. We will present details on the different possible solutions, including...
Go to contribution page -
Mr Charles McClary (HPSS Subscriber)9/11/24, 2:05 PMpublic to everybody attending HUF
Abstract: Data lifecycle management poses significant challenges, particularly in academic and research environments where data accumulation is rapid and perpetual. This presentation delves into the complexities surrounding data retention and abandonment, highlighting the prevalent issues of data hoarding and the lack of structured deletion policies. Specifically, it addresses the dilemma...
Go to contribution page -
Herb Wartens9/11/24, 3:05 PMpublic to everybody attending HUF
At LLNL we have been using commodity hardware more and more to serve our parallel filesystems and archival storage clusters. We wanted to explore how to use this same hardware for our HPSS Core Server systems. In order to make the system as reliable as possible, ZFS emerged as the underlying filesystem we wanted to utilize for its reliability and other advanced features. How would traditional...
Go to contribution page -
9/11/24, 5:00 PM
-
Greg Thorsness9/12/24, 10:00 AMpublic to everybody attending HUF
2024 HUF Presentations by IBM
Go to contribution page
!! duration 1h -
Manuel Panea (Max Planck Computing and Data Facility)9/12/24, 10:40 AM
We will present our activities with HPSS since the last HUF, including our upgrade to HPSS 10.3.
Go to contribution page -
Fabi Adams9/12/24, 11:40 AMpublic to everybody attending HUF
-
Tarak Patel9/12/24, 12:05 PM
SSC Site Report will be a recap of previous HUF presentations and focus on :
- Solution overview
- Review of components throughout upgrades
- HPNLS (High Performance Nearline Storage) architecture
- HPSS and RHEL Upgrade
- HPSS monitoring
- User tools and environment
-
Naoyuki FUJITA (Japan Aerospace Exploration Agency(JAXA))9/12/24, 2:00 PMpublic to everybody attending HUF
The recent operation status of JAXA HPSS "J-SPACE", the plans and issues for its replacement in 2025, and monitoring functionality will be reported.
Go to contribution page -
Doris Ressmann (Karlsruhe Institute of Technlology)9/12/24, 2:20 PM
-
public to everybody attending HUF
-
Mrs Thuy Tran (IBM)hpss community only
New deployment(s), completed upgrades, site statistics.
Go to contribution page
Choose timezone
Your profile timezone: