Multifacets of lossy compression for scientific data in the Joint-Laboratory of Extreme Scale Computing

F Cappello, M Acosta, E Agullo, H Anzt… - Future Generation …, 2025 - Elsevier
Abstract The Joint Laboratory on Extreme-Scale Computing (JLESC) was initiated at the
same time lossy compression for scientific data became an important topic for the scientific …

Optimizing error-bounded lossy compression for scientific data by dynamic spline interpolation

K Zhao, S Di, M Dmitriev, TLD Tonellot… - 2021 IEEE 37th …, 2021 - ieeexplore.ieee.org
Today's scientific simulations are producing vast volumes of data that cannot be stored and
transferred efficiently because of limited storage capacity, parallel I/O bandwidth, and …

SZ3: A modular framework for composing prediction-based error-bounded lossy compressors

X Liang, K Zhao, S Di, S Li… - … Transactions on Big …, 2022 - ieeexplore.ieee.org
Today's scientific simulations require a significant reduction of data volume because of
extremely large amounts of data they produce and the limited I/O bandwidth and storage …

Dynamic quality metric oriented error bounded lossy compression for scientific datasets

J Liu, S Di, K Zhao, X Liang, Z Chen… - … Conference for High …, 2022 - ieeexplore.ieee.org
With ever-increasing execution scale of the high performance computing (HPC)
applications, vast amount of data are being produced by scientific research every day. Error …

FAZ: A flexible auto-tuned modular error-bounded compression framework for scientific data

J Liu, S Di, K Zhao, X Liang, Z Chen… - Proceedings of the 37th …, 2023 - dl.acm.org
Error-bounded lossy compression has been effective to resolve the big scientific data issue
because it has a great potential to significantly reduce the data volume while allowing users …

Mdz: An efficient error-bounded lossy compressor for molecular dynamics

K Zhao, S Di, D Perez, X Liang, Z Chen… - 2022 IEEE 38th …, 2022 - ieeexplore.ieee.org
Molecular dynamics (MD) has been widely used in today's scientific research across
multiple domains including materials science, biochemistry, biophysics, and structural …

Toward quantity-of-interest preserving lossy compression for scientific data

P Jiao, S Di, H Guo, K Zhao, J Tian, D Tao… - Proceedings of the …, 2022 - dl.acm.org
Today's scientific simulations and instruments are producing a large amount of data, leading
to difficulties in storing, transmitting, and analyzing these data. While error-controlled lossy …

[HTML][HTML] MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoring

Q Gong, J Chen, B Whitney, X Liang, V Reshniak… - SoftwareX, 2023 - Elsevier
We describe MGARD, a software providing MultiGrid Adaptive Reduction for floating-point
scientific data on structured and unstructured grids. With exceptional data compression …

High-performance Effective Scientific Error-bounded Lossy Compression with Auto-tuned Multi-component Interpolation

J Liu, S Di, K Zhao, X Liang, S **, Z Jian… - Proceedings of the …, 2024 - dl.acm.org
Error-bounded lossy compression has been identified as a promising solution for
significantly reducing scientific data volumes upon users' requirements on data distortion …

Gwlz: A group-wise learning-based lossy compression framework for scientific data

W Jia, S **, J Wang, W Niu, D Tao, M Yin - … of the 14th Workshop on AI …, 2024 - dl.acm.org
The rapid expansion of computational capabilities and the evergrowing scale of modern
HPC systems present formidable challenges in managing exascale scientific data. Faced …