Parallel i/o evaluation techniques and emerging hpc workloads: A perspective

S Neuwirth, AK Paul - 2021 IEEE International Conference on …, 2021 - ieeexplore.ieee.org
Emerging workloads such as artificial intelligence, big data analytics and complex multi-step
workflows alongside future exascale applications are anticipated future HPC workloads …

I/o characterization and performance evaluation of beegfs for deep learning

F Chowdhury, Y Zhu, T Heer, S Paredes… - Proceedings of the 48th …, 2019 - dl.acm.org
Parallel File Systems (PFSs) are frequently deployed on leadership High Performance
Computing (HPC) systems to ensure efficient I/O, persistent storage and scalable …

Revisiting I/O behavior in large-scale storage systems: The expected and the unexpected

T Patel, S Byna, GK Lockwood, D Tiwari - Proceedings of the …, 2019 - dl.acm.org
Large-scale applications typically spend a large fraction of their execution time performing
I/O to a parallel storage system. However, with rapid progress in compute and storage …

Systematically inferring I/O performance variability by examining repetitive job behavior

E Costa, T Patel, B Schwaller, JM Brandt… - Proceedings of the …, 2021 - dl.acm.org
Monitoring and analyzing I/O behaviors is critical to the efficient utilization of parallel storage
systems. Unfortunately, with increasing I/O requirements and resource contention, I/O …

Uncovering access, reuse, and sharing characteristics of {I/O-Intensive} files on {Large-Scale} production {HPC} systems

T Patel, S Byna, GK Lockwood, NJ Wright… - … USENIX Conference on …, 2020 - usenix.org
Large-scale high-performance computing (HPC) applications running on supercomputers
produce large amounts of data routinely and store it in files on multi-PB shared parallel …

Improving performance of data dum** with lossy compression for scientific simulation

X Liang, S Di, D Tao, S Li, B Nicolae… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
Because of the ever-increasing data being produced by today's high performance
computing (HPC) scientific simulations, I/O performance is becoming a significant bottleneck …

Understanding hpc application i/o behavior using system level statistics

AK Paul, O Faaland, A Moody… - 2020 IEEE 27th …, 2020 - ieeexplore.ieee.org
The processor performance of high performance computing (HPC) systems is increasing at
a much higher rate than storage performance. This imbalance leads to I/O performance …