Sep 4 – 9, 2022
Europe/Zurich timezone

Big data: fast access, transfer, storage

Sep 6, 2022, 12:00 PM


Thomas Stibor


Data acquisition in high energy physics is a challenging task in terms of reliability and scalability. We present a framework for transferring raw acquisition data to the large-scale distributed file system Lustre and additionally archive the data in an archiving system in near real-time. The framework employs multiple queue data-structures and exploits producer-consumer paradigm to leverage reliable and scalable asynchronous data transfer. Latest 2022 beam time of the HADES experiment underpins the effectiveness of the framework.

Primary author

Presentation materials