Multifacets of lossy compression for scientific data in the Joint-Laboratory of Extreme Scale Computing
Abstract The Joint Laboratory on Extreme-Scale Computing (JLESC) was initiated at the
same time lossy compression for scientific data became an important topic for the scientific …
same time lossy compression for scientific data became an important topic for the scientific …
SZ3: A modular framework for composing prediction-based error-bounded lossy compressors
Today's scientific simulations require a significant reduction of data volume because of
extremely large amounts of data they produce and the limited I/O bandwidth and storage …
extremely large amounts of data they produce and the limited I/O bandwidth and storage …
A survey on checkpointing strategies: Should we always checkpoint à la Young/Daly?
Abstract The Young/Daly formula provides an approximation of the optimal checkpointing
period for a parallel application executing on a supercomputing platform. It was originally …
period for a parallel application executing on a supercomputing platform. It was originally …
Cusz: An efficient gpu-based error-bounded lossy compression framework for scientific data
Error-bounded lossy compression is a state-of-the-art data reduction technique for HPC
applications because it not only significantly reduces storage overhead but also can retain …
applications because it not only significantly reduces storage overhead but also can retain …
Linking scientific instruments and computation: Patterns, technologies, and experiences
Powerful detectors at modern experimental facilities routinely collect data at multiple GB/s.
Online analysis methods are needed to enable the collection of only interesting subsets of …
Online analysis methods are needed to enable the collection of only interesting subsets of …
Significantly improving lossy compression for HPC datasets with second-order prediction and parameter optimization
Today's extreme-scale high-performance computing (HPC) applications are producing
volumes of data too large to save or transfer because of limited storage space and I/O …
volumes of data too large to save or transfer because of limited storage space and I/O …
Dynamic quality metric oriented error bounded lossy compression for scientific datasets
With ever-increasing execution scale of the high performance computing (HPC)
applications, vast amount of data are being produced by scientific research every day. Error …
applications, vast amount of data are being produced by scientific research every day. Error …
Exploring autoencoder-based error-bounded compression for scientific data
Error-bounded lossy compression is becoming an indispensable technique for the success
of today's scientific projects with vast volumes of data produced during the simulations or …
of today's scientific projects with vast volumes of data produced during the simulations or …
FAZ: A flexible auto-tuned modular error-bounded compression framework for scientific data
Error-bounded lossy compression has been effective to resolve the big scientific data issue
because it has a great potential to significantly reduce the data volume while allowing users …
because it has a great potential to significantly reduce the data volume while allowing users …
Concealing compression-accelerated i/o for hpc applications through in situ task scheduling
Lossy compression and asynchronous I/O are two of the most effective solutions for reducing
storage overhead and enhancing I/O performance in large-scale high-performance …
storage overhead and enhancing I/O performance in large-scale high-performance …