Sep 19 – 22, 2022
Paul Scherer Institute, Villigen, Switzerland
Europe/Zurich timezone

Experiment data streaming and aggregation at the European Spallation Source

Sep 20, 2022, 5:32 PM
WHGA/Auditorium and online (Paul Scherer Institute, Villigen, Switzerland)

WHGA/Auditorium and online

Paul Scherer Institute, Villigen, Switzerland

Paul Scherrer Institute Forschungsstrasse 111 CH-5232-Villigen-PSI
Poster NOBUGS 2022


Daniel Cacabelos (European Spallation Source)


The European Spallation Source will provide a collection of instruments for state-of-the-art neutron science. To support the scientific activities, high-throughput instrument data, environment parameters and other metadata must be timely collected, aggregated and made available for real-time and offline analysis. The data aggregation and streaming system comprises an Apache Kafka stream processing data store, collection and aggregation adapters for the different data sources, persistence adapters for the NeXus format, and integrations with the experiment control user interfaces. We present the architecture of this system, its current integration status and our latest performance results.

Email address of presenting author

Primary author

Daniel Cacabelos (European Spallation Source)


Mr Afonso Haruo Carnielli Mukai (European Spallation Source) Dr Morten Jagd Christensen (European Spallation Source) Tobias Richter (European Spallation Source)

Presentation materials