cuszp: An ultra-fast gpu error-bounded lossy compression framework with optimized end-to-end performance

Y Huang, S Di, X Yu, G Li, F Cappello - Proceedings of the International …, 2023 - dl.acm.org
Modern scientific applications and supercomputing systems are generating large amounts of
data in various fields, leading to critical challenges in data storage footprints and …

A survey on error-bounded lossy compression for scientific datasets

S Di, J Liu, K Zhao, X Liang, R Underwood… - arxiv preprint arxiv …, 2024 - arxiv.org
Error-bounded lossy compression has been effective in significantly reducing the data
storage/transfer burden while preserving the reconstructed data fidelity very well. Many error …

Fz-gpu: A fast and high-ratio lossy compressor for scientific computing applications on gpus

B Zhang, J Tian, S Di, X Yu, Y Feng, X Liang… - Proceedings of the …, 2023 - dl.acm.org
Today's large-scale scientific applications running on high-performance computing (HPC)
systems generate vast data volumes. Thus, data compression is becoming a critical …

Concealing compression-accelerated i/o for hpc applications through in situ task scheduling

S **, S Di, F Vivien, D Wang, Y Robert, D Tao… - Proceedings of the …, 2024 - dl.acm.org
Lossy compression and asynchronous I/O are two of the most effective solutions for reducing
storage overhead and enhancing I/O performance in large-scale high-performance …

A general framework for progressive data compression and retrieval

VAP Magri, P Lindstrom - IEEE Transactions on Visualization …, 2023 - ieeexplore.ieee.org
In scientific simulations, observations, and experiments, the transfer of data to and from disk
and across networks has become a major bottleneck for data analysis and visualization …

cuSZp2: A GPU Lossy Compressor with Extreme Throughput and Optimized Compression Ratio

Y Huang, S Di, G Li, F Cappello - … : International Conference for …, 2024 - ieeexplore.ieee.org
Existing GPU lossy compressors suffer from expensive data movement overheads,
inefficient memory access patterns, and high synchronization latency, resulting in limited …

Maintaining trust in reduction: Preserving the accuracy of quantities of interest for lossy compression

Q Gong, X Liang, B Whitney, JY Choi, J Chen… - Smoky Mountains …, 2021 - Springer
As the growth of data sizes continues to outpace computational resources, there is a
pressing need for data reduction techniques that can significantly reduce the amount of data …

Optimizing huffman decoding for error-bounded lossy compression on gpus

C Rivera, S Di, J Tian, X Yu, D Tao… - 2022 IEEE …, 2022 - ieeexplore.ieee.org
More and more HPC applications require fast and effective compression techniques to
handle large volumes of data in storage and transmission. Not only do these applications …

Efficient data compression for 3D sparse tpc via bicephalous convolutional autoencoder

Y Huang, Y Ren, S Yoo, J Huang - 2021 20th IEEE …, 2021 - ieeexplore.ieee.org
Real-time data collection and analysis in large experimental facilities present a great
challenge across multiple domains, including high energy physics, nuclear physics, and …

Region-adaptive, error-controlled scientific data compression using multilevel decomposition

Q Gong, B Whitney, C Zhang, X Liang… - Proceedings of the 34th …, 2022 - dl.acm.org
The increase of computer processing speed is significantly outpacing improvements in
network and storage bandwidth, leading to the big data challenge in modern science, where …