Tuning parallel data compression and i/o for large-scale earthquake simulation

H Tang, S Byna, NA Petersson… - 2021 ieee international …, 2021 - ieeexplore.ieee.org
Scientific applications, such as those simulating earthquakes, the origins of universe, etc.,
often produce massive amounts of data as high-performance computing (HPC) systems are …

Interpreting write performance of supercomputer I/O systems with regression models

B **e, Z Tan, P Carns, J Chase, K Harms… - 2021 IEEE …, 2021 - ieeexplore.ieee.org
This work seeks to advance the state of the art in HPC I/O performance analysis and
interpretation. In particular, we demonstrate effective techniques to:(1) model output …

Processing full-scale square kilometre array data on the summit supercomputer

R Wang, R Tobar, M Dolensky, T An… - … Conference for High …, 2020 - ieeexplore.ieee.org
This work presents a workflow for simulating and processing the full-scale low-frequency
telescope data of the Square Kilometre Array (SKA) Phase 1. The SKA project will enter the …

Sctuner: An autotuner addressing dynamic i/o needs on supercomputer i/o subsystems

H Tang, B **e, S Byna, P Carns… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
In high-performance computing (HPC), scientific applications often manage a massive
amount of data using I/O libraries. These libraries provide convenient data model …

Battle of the defaults: Extracting performance characteristics of HDF5 under production load

B **e, H Tang, S Byna, J Hanley… - 2021 IEEE/ACM 21st …, 2021 - ieeexplore.ieee.org
Popular parallel I/O libraries, such as HDF5, provide tuning parameters to obtain superior
performance. However, the selection of effective parameters on production systems is …

An empirical study of package dependencies and lifetimes in binder Python containers

T Shaffer, K Chard, D Thain - 2021 IEEE 17th International …, 2021 - ieeexplore.ieee.org
Containers are widely used in scientific applications as they provide greater precision and
flexibility in controlling nearly every aspect of the software environment. They can also be …

Applying machine learning to understand write performance of large-scale parallel filesystems

B **e, Z Tan, P Carns, J Chase, K Harms… - 2019 IEEE/ACM …, 2019 - ieeexplore.ieee.org
In high-performance computing (HPC), I/O performance prediction offers the potential to
improve the efficiency of scientific computing. In particular, accurate prediction can make …

User-based I/O Profiling for Leadership Scale HPC Workloads

AH Yazdani, AK Paul, AM Karimi, F Wang… - Proceedings of the 26th …, 2025 - dl.acm.org
I/O constitutes a significant portion of most of the application run-time. Spawning many such
applications concurrently on an HPC system leads to severe I/O contention. Thus …

[KNIHA][B] Proactive Storage Management for High-Throughput Scientific Workflows

T Shaffer - 2022 - search.proquest.com
Effectively supporting modern large-scale and data-centric scientific workflows moving into
the exascale era requires a change in the way researchers interact with the system to better …

Interpreting Write Performance of Supercomputer I/O Systems with Machine Intelligence

B **e, Z Tan, P Carns, J Chase, K Harms, J Lofstead… - 2021 - osti.gov
This work seeks to advance the state of the art in HPC I/O performance analysis and
interpretation. In particular, we demonstrate effective techniques to:(1) model output …