Multifacets of lossy compression for scientific data in the Joint-Laboratory of Extreme Scale Computing

F Cappello, M Acosta, E Agullo, H Anzt… - Future Generation …, 2025 - Elsevier
Abstract The Joint Laboratory on Extreme-Scale Computing (JLESC) was initiated at the
same time lossy compression for scientific data became an important topic for the scientific …

SZ3: A modular framework for composing prediction-based error-bounded lossy compressors

X Liang, K Zhao, S Di, S Li… - … Transactions on Big …, 2022 - ieeexplore.ieee.org
Today's scientific simulations require a significant reduction of data volume because of
extremely large amounts of data they produce and the limited I/O bandwidth and storage …

A survey on checkpointing strategies: Should we always checkpoint à la Young/Daly?

L Bautista-Gomez, A Benoit, S Di, T Herault… - Future Generation …, 2024 - Elsevier
Abstract The Young/Daly formula provides an approximation of the optimal checkpointing
period for a parallel application executing on a supercomputing platform. It was originally …

Cusz: An efficient gpu-based error-bounded lossy compression framework for scientific data

J Tian, S Di, K Zhao, C Rivera, MH Fulp… - Proceedings of the …, 2020 - dl.acm.org
Error-bounded lossy compression is a state-of-the-art data reduction technique for HPC
applications because it not only significantly reduces storage overhead but also can retain …

Linking scientific instruments and computation: Patterns, technologies, and experiences

R Vescovi, R Chard, ND Saint, B Blaiszik, J Pruyne… - Patterns, 2022 - cell.com
Powerful detectors at modern experimental facilities routinely collect data at multiple GB/s.
Online analysis methods are needed to enable the collection of only interesting subsets of …

Significantly improving lossy compression for HPC datasets with second-order prediction and parameter optimization

K Zhao, S Di, X Liang, S Li, D Tao, Z Chen… - Proceedings of the 29th …, 2020 - dl.acm.org
Today's extreme-scale high-performance computing (HPC) applications are producing
volumes of data too large to save or transfer because of limited storage space and I/O …

Dynamic quality metric oriented error bounded lossy compression for scientific datasets

J Liu, S Di, K Zhao, X Liang, Z Chen… - … Conference for High …, 2022 - ieeexplore.ieee.org
With ever-increasing execution scale of the high performance computing (HPC)
applications, vast amount of data are being produced by scientific research every day. Error …

Exploring autoencoder-based error-bounded compression for scientific data

J Liu, S Di, K Zhao, S **, D Tao, X Liang… - 2021 IEEE …, 2021 - ieeexplore.ieee.org
Error-bounded lossy compression is becoming an indispensable technique for the success
of today's scientific projects with vast volumes of data produced during the simulations or …

FAZ: A flexible auto-tuned modular error-bounded compression framework for scientific data

J Liu, S Di, K Zhao, X Liang, Z Chen… - Proceedings of the 37th …, 2023 - dl.acm.org
Error-bounded lossy compression has been effective to resolve the big scientific data issue
because it has a great potential to significantly reduce the data volume while allowing users …

Concealing compression-accelerated i/o for hpc applications through in situ task scheduling

S **, S Di, F Vivien, D Wang, Y Robert, D Tao… - Proceedings of the …, 2024 - dl.acm.org
Lossy compression and asynchronous I/O are two of the most effective solutions for reducing
storage overhead and enhancing I/O performance in large-scale high-performance …