End to End Computing research on Petascale Computers
Abstract:
ORNL has now procured a supercomputer with a peak performance of more than 1 petaflop, with over 300 TB of memory, 150K processors, and 10 PB of storage. One of the most daunting tasks of running simulations on this computer is with the associated scientific data management tasks, such as parallel I/O and workflow automation. In this talk I will present two middleware systems that we have worked with, and present the new research challenges that remain in each task. In particular, I will focus on the Adaptable I/O System (ADIOS), and the Kepler workflow system. We present many exciting research areas that our end to end team are working on, including: data staging/offloading, in situ visualization, fast reading of log based file formats, autonomic workflows, and fast writing of metadata rich output from 100K processors.
No comments:
Post a Comment