TAC: Optimizing Error-Bounded Lossy Compression for Three-Dimensional Adaptive Mesh Refinement Simulations
Daoce Wang, Jesus Pulido, Pascal Grosset, Sian Jin, Jiannan Tian, James P. Ahrens, Dingwen Tao
Abstract
Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one of the most effective solutions to the above problem. However, little work has been done to improve error-bounded lossy compression for Adaptive Mesh Refinement (AMR) simulation data. Unlike the previous work that only leverages 1D compression, in this work, we propose to leverage high-dimensional (e.g., 3D) compression for each refinement level of AMR data. To remove the data redundancy across different levels, we propose three pre-process strategies and adaptively use them based on the data characteristics. Experiments on seven AMR datasets from a real-world large-scale AMR simulation demonstrate that our proposed approach can improve the compression ratio by up to 3.3X under the same data distortion, compared to the state-of-the-art method. In addition, we leverage the flexibility of our approach to tune the error bound for each level, which achieves much lower data distortion on two application-specific metrics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fc1abd4b-4523-4dd7-a5bf-fb147af340baCited by top-tier papers5
- cuSZ-i: High-Ratio Scientific Lossy Compression on GPUs with Optimized Multi-Level InterpolationJinyang Liu, Jiannan Tian, Shixun Wu, Sheng Di et al.SC 2024 · 17 citations
- AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement ApplicationsDaoce Wang, Jesus Pulido, Pascal Grosset, Jiannan Tian et al.SC 2023 · 15 citations
- A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and VisualizationDaoce Wang, Pascal Grosset, Jesus Pulido, Tushar M. Athawale et al.SC 2024 · 8 citations
- STZ: A High Quality and High Speed Streaming Lossy Compression Framework for Scientific DataDaoce Wang, Pascal Grosset, Jesus Pulido, Jiannan Tian et al.SC 2025 · 2 citations
- Error-bounded Point Cloud Compression Using Truncated Octahedron QuantizationYouyuan Liu, Longtao Zhang, Ruoyu Li, Bo Jiang et al.VLDB 2026
Builds on5
- Optimizing Error-Bounded Lossy Compression for Scientific Data by Dynamic Spline InterpolationKai Zhao, Sheng Di, Maxim Dmitriev, Thierry-Laurent D. Tonellot et al.ICDE 2021 · 151 citations
- Significantly Improving Lossy Compression for HPC Datasets with Second-Order Prediction and Parameter OptimizationKai Zhao, Sheng Di, Xin Liang, Sihuan Li et al.HPDC 2020 · 77 citations
- Error-controlled, progressive, and adaptable retrieval of scientific data with multilevel decompositionXin Liang, Qian Gong, Jieyang Chen, Ben Whitney et al.SC 2021 · 27 citations
- Foresight: analysis that matters for data reductionPascal Grosset, Christopher M. Biwer, Jesus Pulido, Arvind T. Mohan et al.SC 2020 · 23 citations
- Adaptive Configuration of In Situ Lossy Compression for Cosmology Simulations via Fine-Grained Rate-Quality ModelingSian Jin, Jesus Pulido, Pascal Grosset, Jiannan Tian et al.HPDC 2021 · 19 citations
Related papers
- Dynamic Quality Metric Oriented Error Bounded Lossy Compression for Scientific DatasetsJinyang Liu, Sheng Di, Kai Zhao, Xin Liang et al.SC 2022 · 33 citations
- MDZ: An Efficient Error-bounded Lossy Compressor for Molecular DynamicsKai Zhao, Sheng Di, Danny Perez, Xin Liang et al.ICDE 2022 · 21 citations
- IPComp: Interpolation Based Progressive Lossy Compression for Scientific ApplicationsZhuoxun Yang, Sheng Di, Longtao Zhang, Ruoyu Li et al.HPDC 2025 · 7 citations
- A Feature-Driven Fixed-Ratio Lossy Compression Framework for Real-World Scientific DatasetsMd Hasanur Rahman, Sheng Di, Kai Zhao, Robert Underwood et al.ICDE 2023 · 14 citations
- Improving Prediction-Based Lossy Compression Dramatically via Ratio-Quality ModelingSian Jin, Sheng Di, Jiannan Tian, Suren Byna et al.ICDE 2022 · 26 citations
