I/o access patterns in hpc applications: A 360-degree survey

JL Bez, S Byna, S Ibrahim - ACM Computing Surveys, 2023 - dl.acm.org
The high-performance computing I/O stack has been complex due to multiple software
layers, the inter-dependencies among these layers, and the different performance tuning …

Challenges and opportunities in magnetospheric space weather prediction

SK Morley - Space Weather, 2020 - Wiley Online Library
Abstract Space Weather is the study of the dynamics of the coupled Solar‐Terrestrial
environment, as these dynamics impact technological systems and human activity. This …

Big data and extreme-scale computing: Pathways to convergence-toward a sha** strategy for a future software and data ecosystem for scientific inquiry

M Asch, T Moore, R Badia, M Beck… - … Journal of High …, 2018 - journals.sagepub.com
Over the past four years, the Big Data and Exascale Computing (BDEC) project organized a
series of five international workshops that aimed to explore the ways in which the new forms …

I/o characterization and performance evaluation of beegfs for deep learning

F Chowdhury, Y Zhu, T Heer, S Paredes… - Proceedings of the 48th …, 2019 - dl.acm.org
Parallel File Systems (PFSs) are frequently deployed on leadership High Performance
Computing (HPC) systems to ensure efficient I/O, persistent storage and scalable …

Modular hpc i/o characterization with darshan

S Snyder, P Carns, K Harms, R Ross… - 2016 5th workshop …, 2016 - ieeexplore.ieee.org
Contemporary high-performance computing (HPC) applications encompass a broad range
of distinct I/O strategies and are often executed on a number of different compute platforms …

Revisiting I/O behavior in large-scale storage systems: The expected and the unexpected

T Patel, S Byna, GK Lockwood, D Tiwari - Proceedings of the …, 2019 - dl.acm.org
Large-scale applications typically spend a large fraction of their execution time performing
I/O to a parallel storage system. However, with rapid progress in compute and storage …

Scaling spark on hpc systems

N Chaimov, A Malony, S Canon, C Iancu… - Proceedings of the 25th …, 2016 - dl.acm.org
We report our experiences porting Spark to large production HPC systems. While Spark
performance in a data center installation (with local disks) is dominated by the network, our …

End-to-end I/O monitoring on leading supercomputers

B Yang, W Xue, T Zhang, S Liu, X Ma, X Wang… - ACM Transactions on …, 2023 - dl.acm.org
This paper offers a solution to overcome the complexities of production system I/O
performance monitoring. We present Beacon, an end-to-end I/O resource monitoring and …

A year in the life of a parallel file system

GK Lockwood, S Snyder, T Wang… - … conference for high …, 2018 - ieeexplore.ieee.org
I/O performance is a critical aspect of data-intensive scientific computing. We seek to
advance the state of the practice in understanding and diagnosing I/O performance issues …

CUBE: A scalable framework for large-scale industrial simulations

N Jansson, R Bale, K Onishi… - … international journal of …, 2019 - journals.sagepub.com
Writing high-performance solvers for engineering applications is a delicate task. These
codes are often developed on an application to application basis, highly optimized to solve a …