2025-07-17 All-Hands Presentation Meeting Notes

2025-07-17 All-Hands Presentation Meeting Notes

High-Performance Workflows: In Situ Data Transport and Workflow Management
Tom Peterka and Orcun Yildiz, Argonne National Laboratory

 Abstract: In situ workflows have gained traction in the high-performance computing (HPC) community because of the need to analyze increasing data volumes together with the ever-growing gap between the computation and I/O capabilities of HPC systems. In situ workflows run within a single HPC system as a collection of multiple tasks, which are often large parallel programs. These tasks communicate over memory or the interconnect of the HPC system, bypassing the parallel file system. We will present our software for data transport (LowFive) and workflow management (Wilkins) for HPC in situ workflows, and we’ll highlight how the software is used to trace particles in situ with MPAS-Ocean as part of the ImPACTS SciDAC partnership.

Date Jul 17, 2025  

Time

  • PT: 8:30 am

  • ET: 11:30 am

Call Info

  • web session:   https://global.gotomeeting.com/join/570361173                   

  • call number:   (571) 317-3122 Access Code: 570-361-173,  If busy, use alternate number: (773) 945-1029

    Joining from a video-conferencing room or system?  Dial: 67.217.95.2##570361173 ,  Cisco devices: 570361173@67.217.95.2

Time

Title

Presenter

Presentation

Recording

Notes

Time

Title

Presenter

Presentation

Recording

Notes

30 min

High-Performance Workflows: In Situ Data Transport and Workflow Management

Tom Peterka and Orcun Yildiz

 

MP4 Movie (on the E3SM YouTube Channel)