What question did this study set out to answer?

The research aims to address the challenges of massive data storage and processing in the HL-LHC project.

February 5, 2026

ATLAS HL-LHC Demonstrators with Data Carousel: Dataon-Demand and Tape Smart Writing

MBM. BorodinUniversity of Iowa AKAlexei Klimentov TKTatiana KorchuganovaUniversity of Pittsburgh

Key Points

The research aims to address the challenges of massive data storage and processing in the HL-LHC project.
Initiated the Data Carousel project for tape-driven workflow
Staging data for processing with a sliding window to disk buffer
Conducted studies with CERN and Tier-1 site experts
Achieved significant disk space savings through optimized tape usage
Implemented data-on-demand functionality
Developed tape smart writing techniques for better data management

Abstract

The High Luminosity upgrade to the LHC (HL-LHC) is expected to deliver scientific data at the multi-exabyte scale. To tackle this unprecedented data storage challenge, the ATLAS experiment initiated the Data Carousel project in 2018. Data Carousel is a tape-driven workflow in which bulk production campaigns with input data resident on tape are executed by staging and promptly processing a sliding window to disk buffer such that only a small fraction of inputs are pinned on disk at any one time. Put in ATLAS production before Run3, Data Carousel continues to be our focus for seeking new opportunities in disk space savings, and enhancing tape usage throughout the ATLAS Distributed Computing (ADC) environment. These efforts are highlighted by two recent ATLAS HL-LHC demonstrator projects: data-on-demand and tape smart writing. In this paper, we will discuss the recent studies and outcomes from these projects. The research was conducted together with site experts at CERN and Tier-1 centers.

AI से पूछें

Bookmark

View Full Paper