I/o access patterns in hpc applications: A 360-degree survey

JL Bez, S Byna, S Ibrahim - ACM Computing Surveys, 2023‏ - dl.acm.org
The high-performance computing I/O stack has been complex due to multiple software
layers, the inter-dependencies among these layers, and the different performance tuning …

A checkpoint of research on parallel i/o for high-performance computing

FZ Boito, EC Inacio, JL Bez, POA Navaux… - ACM Computing …, 2018‏ - dl.acm.org
We present a comprehensive survey on parallel I/O in the high-performance computing
(HPC) context. This is an important field for HPC because of the historic gap between …

Optimizing i/o performance of hpc applications with autotuning

B Behzad, S Byna, Prabhat, M Snir - ACM Transactions on Parallel …, 2019‏ - dl.acm.org
Parallel Input output is an essential component of modern high-performance computing
(HPC). Obtaining good I/O performance for a broad range of applications on diverse HPC …

IO-Sets: Simple and Efficient Approaches for I/O Bandwidth Management

F Boito, G Pallez, L Teylo, N Vidal - IEEE Transactions on …, 2023‏ - ieeexplore.ieee.org
One of the main performance issues faced by high-performance computing platforms is the
congestion caused by concurrent I/O from applications. When this happens, the platform's …

HPC I/O throughput bottleneck analysis with explainable local models

M Isakov, E Del Rosario, S Madireddy… - … Conference for High …, 2020‏ - ieeexplore.ieee.org
With the growing complexity of high-performance computing (HPC) systems, achieving high
performance can be difficult because of I/O bottlenecks. We analyze multiple years' worth of …

Server-side log data analytics for I/O workload characterization and coordination on large shared storage systems

Y Liu, R Gunasekaran, X Ma… - SC'16: Proceedings of …, 2016‏ - ieeexplore.ieee.org
Inter-application I/O contention and performance interference have been recognized as
severe problems. In this work, we demonstrate, through measurement from Titan (world's …

Leveraging burst buffer coordination to prevent I/O interference

A Kougkas, M Dorier, R Latham… - 2016 IEEE 12th …, 2016‏ - ieeexplore.ieee.org
Concurrent accesses to the shared storage resources in current HPC machines lead to
severe performance degradation caused by I/O contention. In this study, we identify some …

Hfetch: Hierarchical data prefetching for scientific workflows in multi-tiered storage environments

H Devarajan, A Kougkas, XH Sun - 2020 IEEE International …, 2020‏ - ieeexplore.ieee.org
In the era of data-intensive computing, accessing data with a high-throughput and low-
latency is more imperative than ever. Data prefetching is a well-known technique for hiding …

Harmonia: An interference-aware dynamic I/O scheduler for shared non-volatile burst buffers

A Kougkas, H Devarajan, XH Sun… - 2018 IEEE International …, 2018‏ - ieeexplore.ieee.org
Modern HPC systems employ burst buffer installations to reduce the peak I/O requirements
for external storage and deal with the burstiness of I/O in modern scientific applications …

Io-aware job-scheduling: Exploiting the impacts of workload characterizations to select the map** strategy

E Jeannot, G Pallez, N Vidal - The International Journal of …, 2023‏ - journals.sagepub.com
In high performance, computing concurrent applications are sharing the same file system.
However, the bandwidth which provides access to the storage is limited. Therefore, too …