Gekkofs-a temporary distributed file system for hpc applications

MA Vef, N Moti, T Süß, T Tocci, R Nou… - 2018 IEEE …, 2018‏ - ieeexplore.ieee.org
We present GekkoFS, a temporary, highly-scalable burst buffer file system which has been
specifically optimized for new access patterns of data-intensive High-Performance …

Ad hoc file systems for high-performance computing

A Brinkmann, K Mohror, W Yu, P Carns… - Journal of Computer …, 2020‏ - Springer
Storage backends of parallel compute clusters are still based mostly on magnetic disks,
while newer and faster storage technologies such as flash-based SSDs or non-volatile …

GekkoFS—A temporary burst buffer file system for HPC applications

MA Vef, N Moti, T Süß, M Tacke, T Tocci, R Nou… - Journal of Computer …, 2020‏ - Springer
Many scientific fields increasingly use high-performance computing (HPC) to process and
analyze massive amounts of experimental data while storage systems in today's HPC …

Automatic,{Application-Aware}{I/O} forwarding resource allocation

X Ji, B Yang, T Zhang, X Ma, X Zhu, X Wang… - … USENIX Conference on …, 2019‏ - usenix.org
The I/O forwarding architecture is widely adopted on modern supercomputers, with a layer of
intermediate nodes sitting between the many compute nodes and backend storage nodes …

Map** and scheduling HPC applications for optimizing I/O

J Carretero, E Jeannot, G Pallez, DE Singh… - Proceedings of the 34th …, 2020‏ - dl.acm.org
In HPC platforms, concurrent applications are sharing the same file system. This can lead to
conflicts, especially as applications are more and more data intensive. I/O contention can …

Performance characterization of scientific workflows for the optimal use of burst buffers

CS Daley, D Ghoshal, GK Lockwood, S Dosanjh… - Future Generation …, 2020‏ - Elsevier
Scientific discoveries are increasingly dependent upon the analysis of large volumes of data
from observations and simulations of complex phenomena. Scientists compose the complex …

Harmonia: An interference-aware dynamic I/O scheduler for shared non-volatile burst buffers

A Kougkas, H Devarajan, XH Sun… - 2018 IEEE International …, 2018‏ - ieeexplore.ieee.org
Modern HPC systems employ burst buffer installations to reduce the peak I/O requirements
for external storage and deal with the burstiness of I/O in modern scientific applications …

TaskVine: Managing in-cluster storage for high-throughput data intensive workflows

B Sly-Delgado, TS Phung, C Thomas… - Proceedings of the SC' …, 2023‏ - dl.acm.org
Many scientific applications are expressed as high-throughput workflows that consist of
large graphs of data assets and tasks to be executed on large parallel and distributed …

An empirical study of I/O separation for burst buffers in HPC systems

D Koo, J Lee, J Liu, EK Byun, JH Kwak… - Journal of Parallel and …, 2021‏ - Elsevier
To meet the exascale I/O requirements for the High-Performance Computing (HPC), a new
I/O subsystem, Burst Buffer, based on solid state drives (SSD), has been developed …

Fine-grained policy-driven I/O sharing for burst buffers

E Karrels, L Huang, Y Kan, I Arora, Y Wang… - Proceedings of the …, 2023‏ - dl.acm.org
A burst buffer is a common method to bridge the performance gap between the I/O needs of
modern supercomputing applications and the performance of the shared file system on large …