hpc-ch forum on AI/ML Services for Science

Europe/Zurich
CSCS Conference Room

CSCS Conference Room

CSCS Via Trevano 131 6900 Lugano
Maria Grazia Giuffreda (CSCS), Pablo Fernandez (CSCS)
Description

Description

As the landscape of scientific research evolves, so do the demands on High-Performance Computing (HPC) centers. Today, integrating Machine Learning (ML) and Artificial Intelligence (AI) services into HPC offerings is becoming increasingly essential. However, this integration comes with its own set of technical challenges and questions that need to be addressed.

Join us for an insightful discussion as we delve into the intersection of High-Performance Computing and Machine Learning, exploring the challenges and opportunities in providing ML/AI services for scientific research. Whether you're a seasoned HPC professional, a data scientist, or an AI enthusiast, this forum promises to offer valuable insights and perspectives from experts in the field. We invite both speakers and attendees to contribute to this important conversation shaping the future of scientific computing.

Key Questions

  1. Challenges in Offering AI/ML Services:
    1. What are the unique challenges HPC centers face in providing AI/ML services alongside traditional HPC capabilities?
    2. How do we ensure scalability and efficiency in AI/ML workflows within HPC infrastructures?
  2. User Expectations:
    1. What are the expectations of users regarding AI/ML services within HPC environments?
    2. How can HPC centers tailor their offerings to meet these expectations effectively?
  3. Concrete Machine Learning Workflows:
    1. What are the typical workflows involved in integrating ML/AI with HPC resources?
    2. How can these workflows be optimized for performance and reliability?
  4. Tools for AI/ML Services:
    1. What tools and frameworks are currently available for providing AI/ML services in HPC settings?
    2. Are there any gaps in tooling that need to be addressed to better support AI/ML integration?
  5. Data Requirements and Considerations:
    1. What specific requirements does ML/AI integration impose on data storage, access, and management within HPC centers?
    2. How can HPC centers navigate the complexities of handling diverse data types and sources?

 

    • Welcome Coffee & Registration
    • 1
      Welcome and Introduction
      Speakers: Maria Grazia Giuffreda (CSCS), Michele De Lorenzi (CSCS), Pablo Fernandez (CSCS)
    • 2
      AI for Climate Data Generation, Assimilation, and Modeling

      This presentation explores the convergence of Artificial Intelligence (AI) and climate modeling for high-resolution (km-scale) climate prediction.

      We will discuss the use of accelerated km-scale simulations to generate synthetic climate data, enabling the training of even more sophisticated climate models. We'll delve into the integration of observational data from diverse sources – weather stations, satellites, and airborne platforms – through diffusion models, a technique commonly used for image generation.

      To address the exascale challenge posed by climate data volume, we will present an AI-based compression method utilizing deep neural networks for efficient data representation. This approach allows for near-lossless reconstruction of the original data for subsequent analysis. We posit that this synergistic approach, combining high-fidelity data generation with advanced data assimilation techniques, has the potential to significantly improve the accuracy of climate predictions. This, in turn, can inform policy decisions and guide societal responses to climate change.

      Speaker: Torsten Hoefler (ETH Zurich)
    • 3
      Accelerating Access to Data and Research Collaborations through Trusted Research Environments (TREs)
      Speaker: Jean-Louis Raisaro (CHUV)
    • 4
      An Overview of the "Alps" Research Infrastructure
      Speaker: Maxime Martinasso (CSCS)
    • 12:20 PM
      Lunch and Networking
    • 5
      Generative DNNs at Unibas: imagination, expectations, and infrastructure

      We will discuss the landscape of use cases and potential solutions for generative deep neural networks applications in research, administrative processes, and teaching.

      Speaker: Geoffrey Fucile (University of Basel)
    • 6
      Benchmarking AlphaFold2 on the Euler Cluster

      AlphaFold2 (AF2) is an ML-based software that revolutionized the structural biology field by folding protein sequences in 3D structures with accuracy that, in some cases, reached the experimental one. Consequently, AF2 has become a very popular software on the ETH Euler cluster. It has users with IT levels ranging from beginner to expert trying to request resources to fold their own protein sequences. We have conducted a wide range of tests to derive clear guidelines for requesting resources on Euler for AF2, avoiding the waste of CPU and GPU resources. In this presentation I will showcase how we managed to satisfactorily accommodate AF2 usage both for the users and us as the HPC provider.

      Speaker: Nadia Marounina (ETH Zurich)
    • 7
      Community Development

      The session will be dedicated to:

      • Introducing Our New Community Members: Agroscope and Idiap Research Institute
      • Planning the hpc-ch forums for 2025
    • 8
      Introduction to UNICC

      The United Nations International Computing Centre (UNICC) has over 50 years of experience as the largest strategic partner for digital solutions and cybersecurity within the United Nations system. We design and deploy transformational digital tools and programmes to support over 90 partners in fulfilling their mandates. With our world-class Cybersecurity Centre of Excellence, data and analytics practice and an array of platform, software and infrastructure solutions, UNICC serves the entire of the UN family and other international organizations with similar missions and values for the benefit of the world. Join us in learning more about our continuous commitment to delivering innovative, forward-looking and reliable system-wide solutions in line with the UN Secretary-General’s Strategy on New Technologies, the UN Secretary-General’s Roadmap for Digital Cooperation and the Common Agenda.

      Speaker: Gabriel Galati (United Nations International Computing Centre)
    • 9
      Chief Data & AI

      The UNICC AI Hub is committed to enhancing Predictive and Generative AI capabilities to support UN partners. By fostering strategic partnerships and adopting a cloud-first approach, UNICC aims to ensure robust data management, ethical compliance, and optimal model performance. This initiative addresses key technical challenges using High-Performance Computing (HPC), promoting a transparent and responsible AI governance framework. Join us in exploring how these advancements can drive impactful solutions for the UN community.

      Speaker: Anusha Dandapani (United Nations International Computing Centre)
    • 10
      Guided Tour of CSCS Machine Room
    • 11
      Farewell and End of the Meeting