Multifacets of lossy compression for scientific data in the Joint-Laboratory of Extreme Scale Computing

F Cappello, M Acosta, E Agullo, H Anzt… - Future Generation …, 2025 - Elsevier
Abstract The Joint Laboratory on Extreme-Scale Computing (JLESC) was initiated at the
same time lossy compression for scientific data became an important topic for the scientific …

SZ3: A modular framework for composing prediction-based error-bounded lossy compressors

X Liang, K Zhao, S Di, S Li… - … Transactions on Big …, 2022 - ieeexplore.ieee.org
Today's scientific simulations require a significant reduction of data volume because of
extremely large amounts of data they produce and the limited I/O bandwidth and storage …

Priority-based parameter propagation for distributed DNN training

A Jayarajan, J Wei, G Gibson… - Proceedings of …, 2019 - proceedings.mlsys.org
Data parallel training is widely used for scaling distributed deep neural network (DNN)
training. However, the performance benefits are often limited by the communication-heavy …

Full-state quantum circuit simulation by using data compression

XC Wu, S Di, EM Dasgupta, F Cappello… - Proceedings of the …, 2019 - dl.acm.org
Quantum circuit simulations are critical for evaluating quantum algorithms and machines.
However, the number of state amplitudes required for full simulation increases exponentially …

High-ratio lossy compression: Exploring the autoencoder to compress scientific data

T Liu, J Wang, Q Liu, S Alibhai, T Lu… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Scientific simulations on high-performance computing (HPC) systems can generate large
amounts of floating-point data per run. To mitigate the data storage bottleneck and lower the …

Cusz: An efficient gpu-based error-bounded lossy compression framework for scientific data

J Tian, S Di, K Zhao, C Rivera, MH Fulp… - Proceedings of the …, 2020 - dl.acm.org
Error-bounded lossy compression is a state-of-the-art data reduction technique for HPC
applications because it not only significantly reduces storage overhead but also can retain …

Significantly improving lossy compression for HPC datasets with second-order prediction and parameter optimization

K Zhao, S Di, X Liang, S Li, D Tao, Z Chen… - Proceedings of the 29th …, 2020 - dl.acm.org
Today's extreme-scale high-performance computing (HPC) applications are producing
volumes of data too large to save or transfer because of limited storage space and I/O …

Understanding and modeling lossy compression schemes on HPC scientific data

T Lu, Q Liu, X He, H Luo, E Suchyta… - 2018 IEEE …, 2018 - ieeexplore.ieee.org
Scientific simulations generate large amounts of floating-point data, which are often not very
compressible using the traditional reduction schemes, such as deduplication or lossless …

A structured and scalable mechanism for test access to embedded reusable cores

EJ Marinissen, R Arendsen, G Bos… - … 1998 (IEEE Cat. No …, 1998 - ieeexplore.ieee.org
The main objective of core-based IC design is improvement of design efficiency and time-to-
market. In order to prevent test development from becoming the bottleneck in the entire …

Data reduction techniques for simulation, visualization and data analysis

S Li, N Marsaglia, C Garth, J Woodring… - Computer graphics …, 2018 - Wiley Online Library
Data reduction is increasingly being applied to scientific data for numerical simulations,
scientific visualizations and data analyses. It is most often used to lower I/O and storage …