19–22 Sept 2022
Paul Scherer Institute, Villigen, Switzerland
Europe/Zurich timezone

Experiment data streaming and aggregation at the European Spallation Source

20 Sept 2022, 17:32
2m
WHGA/Auditorium and online (Paul Scherer Institute, Villigen, Switzerland)

WHGA/Auditorium and online

Paul Scherer Institute, Villigen, Switzerland

Paul Scherrer Institute Forschungsstrasse 111 CH-5232-Villigen-PSI
Poster NOBUGS 2022

Speaker

Daniel Cacabelos (European Spallation Source)

Description

The European Spallation Source will provide a collection of instruments for state-of-the-art neutron science. To support the scientific activities, high-throughput instrument data, environment parameters and other metadata must be timely collected, aggregated and made available for real-time and offline analysis. The data aggregation and streaming system comprises an Apache Kafka stream processing data store, collection and aggregation adapters for the different data sources, persistence adapters for the NeXus format, and integrations with the experiment control user interfaces. We present the architecture of this system, its current integration status and our latest performance results.

Email address of presenting author daniel.cacabelos@ess.eu

Primary author

Daniel Cacabelos (European Spallation Source)

Co-authors

Mr Afonso Haruo Carnielli Mukai (European Spallation Source) Dr Morten Jagd Christensen (European Spallation Source) Tobias Richter (European Spallation Source)

Presentation materials