4–9 Sept 2022
Europe/Zurich timezone

Big data: fast access, transfer, storage

6 Sept 2022, 12:00
1h

Speaker

Thomas Stibor

Description

Data acquisition in high energy physics is a challenging task in terms of reliability and scalability. We present a framework for transferring raw acquisition data to the large-scale distributed file system Lustre and additionally archive the data in an archiving system in near real-time. The framework employs multiple queue data-structures and exploits producer-consumer paradigm to leverage reliable and scalable asynchronous data transfer. Latest 2022 beam time of the HADES experiment underpins the effectiveness of the framework.

Primary author

Presentation materials