2018/05/17 by Dingwen Tao, Sheng Di, Tao, Dingwen +7
Computer Science · #Advanced Data Compression Techniques #Algorithms and Data Compression #Distributed #FOS: Computer and information sciences #Information Theory (cs.IT) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
paper · pdf · doi:10.48550/arxiv.1805.07384
openalex publication_date 2018/05/17 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01
Error-controlled lossy compression has been studied for years because of extremely large volumes of data being produced by today's scientific simulations. None of existing lossy compressors, however, allow users to fix the peak signal-to-noise ratio (PSNR) during compression, although PSNR has been considered as one of the most significant indicators to assess compression quality. In this paper, we propose a novel technique providing a fixed-PSNR lossy compression for scientific data sets. We implement our proposed method based on the SZ lossy compression framework and release the code as an open-source toolkit. We evaluate our fixed-PSNR compressor on three real-world high-performance computing data sets. Experiments show that our solution has a high accuracy in controlling PSNR, with an average deviation of 0.1 ~ 5.0 dB on the tested data sets.