Trio: Burst buffer based i/o orchestration
The growing computing power on leadership HPC systems is often accompanied by ever-
escalating failure rates. Checkpointing is a common defensive mechanism used by scientific …
escalating failure rates. Checkpointing is a common defensive mechanism used by scientific …
[PDF][PDF] H5spark: bridging the i/o gap between spark and scientific data formats on hpc systems
The Spark framework has been tremendously powerful for performing Big Data analytics in
distributed data centers. However, using Spark to analyze large-scale scientific data on HPC …
distributed data centers. However, using Spark to analyze large-scale scientific data on HPC …
Towards Highly Compatible I/O-Aware Workflow Scheduling on HPC Systems
Y Dai, R Wang, Y Dong, K Lu - SC24: International Conference …, 2024 - ieeexplore.ieee.org
Scientific workflows on High-Performance Computing (HPC) consist of multiple data
processing and computing tasks with dependencies. Efficiently scheduling computing …
processing and computing tasks with dependencies. Efficiently scheduling computing …
Hierarchical consistent hashing for heterogeneous object-based storage
Distributed storage systems play an increasingly critical role in data centers to meet the ever-
increasing data growth demand. Heterogeneous storage systems, with the coexistence of …
increasing data growth demand. Heterogeneous storage systems, with the coexistence of …
On the use of smartphones for detecting obstructive sleep apnea
Obstructive Sleep Apnea (OSA) is a common sleep disorder which is characterized by
recurrent blockage of the upper airway, often resulting in oxygen desaturation. Attended …
recurrent blockage of the upper airway, often resulting in oxygen desaturation. Attended …
Hierarchical collective i/o scheduling for high-performance computing
The non-contiguous access pattern of many scientific applications results in a large number
of I/O requests, which can seriously limit the data-access performance. Collective I/O has …
of I/O requests, which can seriously limit the data-access performance. Collective I/O has …
Exploiting internal parallelism for address translation in solid-state drives
Solid-state Drives (SSDs) have changed the landscape of storage systems and present a
promising storage solution for data-intensive applications due to their low latency, high …
promising storage solution for data-intensive applications due to their low latency, high …
Parallel-DFTL: A flash translation layer that exploits internal parallelism in solid state drives
Solid State Drives (SSDs) using flash memory storage technology present a promising
storage solution for data-intensive applications due to their low latency, high bandwidth, and …
storage solution for data-intensive applications due to their low latency, high bandwidth, and …
FILCIO: Application Agnostic I/O Aggregation to Scale Scientific Workflows
Scientific workflows often consist of black-box stand-alone programs that each write to one
or more files, resulting in significant I/O operations. When strung together, each stage of the …
or more files, resulting in significant I/O operations. When strung together, each stage of the …
Fast numerical evaluation for symbolic expressions in Java
The symbolic-numeric computation has been extensively developed in scientific computing
for experimenting mathematics in numerical programs, like in optimization problems and …
for experimenting mathematics in numerical programs, like in optimization problems and …