A checkpoint of research on parallel i/o for high-performance computing
We present a comprehensive survey on parallel I/O in the high-performance computing
(HPC) context. This is an important field for HPC because of the historic gap between …
(HPC) context. This is an important field for HPC because of the historic gap between …
Data elevator: Low-contention data movement in hierarchical storage system
Hierarchical storage subsystems that include multiple layers of burst buffers (BB) and disk-
based parallel file systems (PFS), are becoming an essential part of HPC systems to …
based parallel file systems (PFS), are becoming an essential part of HPC systems to …
Explicit data correlations-directed metadata prefetching method in distributed file systems
Metadata performance in distributed file systems (DFS) is critical, due to the following
trends:(a) the growing size of modern storage systems is expected to exceed billions of files …
trends:(a) the growing size of modern storage systems is expected to exceed billions of files …
Pattern-driven parallel I/O tuning
The contemporary parallel I/O software stack is complex due to a large number of
configurations for tuning I/O performance. Without a proper configuration, I/O becomes a …
configurations for tuning I/O performance. Without a proper configuration, I/O becomes a …
DASSA: Parallel DAS data storage and analysis for subsurface event detection
Recently developed distributed acoustic sensing (DAS) technologies convert fiber-optic
cables into large arrays of subsurface sensors, enabling a variety of applications including …
cables into large arrays of subsurface sensors, enabling a variety of applications including …
Capturing periodic I/O using frequency techniques
Many HPC applications perform their I/O in bursts that follow a periodic pattern. This allows
for making predictions as to when a burst occurs. System providers can take advantage of …
for making predictions as to when a burst occurs. System providers can take advantage of …
Adaptive broadcast protocols to support power conservant retrieval by mobile users
Mobile computing has the potential for managing information globally. Data management
issues in mobile computing have received some attention in recent times, and the design of …
issues in mobile computing have received some attention in recent times, and the design of …
Detecting i/o access patterns of hpc workloads at runtime
In this paper, we seek to guide optimization and tuning strategies by identifying the
application's I/O access pattern. We evaluate three machine learning techniques to …
application's I/O access pattern. We evaluate three machine learning techniques to …
On server-side file access pattern matching
In this paper, we propose a pattern matching approach for server-side access pattern
detection for the HPC I/O stack. More specifically, our proposal concerns file-level accesses …
detection for the HPC I/O stack. More specifically, our proposal concerns file-level accesses …
Usage pattern-driven dynamic data layout reorganization
As scientific simulations and experiments move toward extremely large scales and generate
massive amounts of data, the data access performance of analytic applications becomes …
massive amounts of data, the data access performance of analytic applications becomes …