An early evaluation of intel's optane dc persistent memory module and its impact on high-performance scientific applications
Memory and I/O performance bottlenecks in supercomputing simulations are two key
challenges that must be addressed on the road to Exascale. The new byte-addressable …
challenges that must be addressed on the road to Exascale. The new byte-addressable …
Survey of storage systems for high-performance computing
In current supercomputers, storage is typically provided by parallel distributed file systems
for hot data and tape archives for cold data. These file systems are often compatible with …
for hot data and tape archives for cold data. These file systems are often compatible with …
DAOS as HPC Storage: a View From Numerical Weather Prediction
N Manubens, T Quintino, SD Smart… - 2023 IEEE …, 2023 - ieeexplore.ieee.org
Object storage solutions potentially address long-standing performance issues with POSIX
file systems for certain I/O workloads, and new storage technologies offer promising …
file systems for certain I/O workloads, and new storage technologies offer promising …
Multi-year simulations at kilometre scale with the Integrated Forecasting System coupled to FESOM2. 5 and NEMOv3. 4
We report on the first multi-year kilometre-scale global coupled simulations using ECMWF's
Integrated Forecasting System (IFS) coupled to both the NEMO and FESOM ocean–sea ice …
Integrated Forecasting System (IFS) coupled to both the NEMO and FESOM ocean–sea ice …
A high-performance distributed object-store for exascale numerical weather prediction and climate
SD Smart, T Quintino, B Raoult - … of the Platform for Advanced Scientific …, 2019 - dl.acm.org
Numerical Weather Prediction (NWP) and Climate simulations sit at the intersection between
classically understood High Performance Computing (HPC) and Big Data/High Performance …
classically understood High Performance Computing (HPC) and Big Data/High Performance …
DAOS as HPC Storage: Exploring Interfaces
A Jackson, N Manubens - 2023 IEEE International Conference …, 2023 - ieeexplore.ieee.org
Reading and writing data to and from data storage has long been a bottleneck for high
performance computing (HPC). The hardware used for data storage exhibits performance …
performance computing (HPC). The hardware used for data storage exhibits performance …
Performance Comparison of DAOS and Lustre for Object Data Storage Approaches
N Manubens, SD Smart, T Quintino… - 2022 IEEE/ACM …, 2022 - ieeexplore.ieee.org
High-performance object stores are an emerging technology which offers an alternative
solution in the field of HPC storage, with potential to address long-standing scalability issues …
solution in the field of HPC storage, with potential to address long-standing scalability issues …
Usage scenarios for byte-addressable persistent memory in high-performance and data intensive computing
M Weiland, B Homölle - Journal of Computer Science and Technology, 2021 - Springer
Byte-addressable persistent memory (B-APM) presents a new opportunity to bridge the
performance gap between main memory and storage. In this paper, we present the usage …
performance gap between main memory and storage. In this paper, we present the usage …
Reducing the Impact of I/O Contention in Numerical Weather Prediction Workflows at Scale Using DAOS
N Manubens, SD Smart, E Danovaro… - Proceedings of the …, 2024 - dl.acm.org
Operational Numerical Weather Prediction (NWP) workflows are highly data-intensive. Data
volumes have increased by many orders of magnitude over the last 40 years, and are …
volumes have increased by many orders of magnitude over the last 40 years, and are …
IO-SEA: Storage I/O and Data Management for Exascale Architectures
D Medeiros, EB Gregory, P Couvee, J Hawkes… - Proceedings of the 21st …, 2024 - dl.acm.org
The new emerging scientific workloads to be executed in the upcoming exascale
supercomputers face major challenges in terms of storage, given their extreme volume of …
supercomputers face major challenges in terms of storage, given their extreme volume of …