SC2024Top-tier venue
A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and Visualization
Daoce Wang, Pascal Grosset, Jesus Pulido, Tushar M. Athawale, Jiannan Tian, Kai Zhao, Zarija Lukic, Axel Huebl, Zhe Wang, James P. Ahrens, Dingwen Tao
Abstract
Multi-resolution methods such as Adaptive Mesh Refinement (AMR) can enhance storage efficiency for HPC applications generating vast volumes of data. However, their applicability is limited and cannot be universally deployed across all applications. Furthermore, integrating lossy compression with multi-resolution techniques to further boost storage efficiency encounters significant barriers. To this end, we introduce an innovative workflow that facilitates high-quality multi-resolution data compression for both uniform and AMR simulations. Initially, to extend the usability of multi-resolution techniques, our workflow employs a compression-oriented Region of Interest (ROI) extraction method, transforming uniform data into a multi-resolution format. Subsequently, to bridge the gap between multi-resolution techniques and lossy compressors, we optimize three distinct compressors, ensuring their optimal performance on multi-resolution data. These optimizations can improve the compression ratio of SOTA approaches by up to under the same data quality loss. Lastly, we incorporate an advanced uncertainty visualization method into our workflow to understand the potential impacts of lossy compression. Experimental evaluation demonstrates that our workflow achieves significant compression quality improvements.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cb6fcd14-4f85-4b1f-9016-f7a3aa9d3658Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Optimizing Error-Bounded Lossy Compression for Scientific Data by Dynamic Spline InterpolationKai Zhao, Sheng Di, Maxim Dmitriev, Thierry-Laurent D. Tonellot et al.ICDE 2021 · 151 citations
- Significantly Improving Lossy Compression for HPC Datasets with Second-Order Prediction and Parameter OptimizationKai Zhao, Sheng Di, Xin Liang, Sihuan Li et al.HPDC 2020 · 77 citations
- Dynamic Quality Metric Oriented Error Bounded Lossy Compression for Scientific DatasetsJinyang Liu, Sheng Di, Kai Zhao, Xin Liang et al.SC 2022 · 33 citations
- Direct Volume Rendering with Nonparametric Models of UncertaintyTushar M. Athawale, Bo Ma, Elham Sakhaee, Chris R. Johnson et al.IEEE VIS 2020 · 31 citations
- Improving Prediction-Based Lossy Compression Dramatically via Ratio-Quality ModelingSian Jin, Sheng Di, Jiannan Tian, Suren Byna et al.ICDE 2022 · 26 citations
Related papers
- TAC: Optimizing Error-Bounded Lossy Compression for Three-Dimensional Adaptive Mesh Refinement SimulationsDaoce Wang, Jesus Pulido, Pascal Grosset, Sian Jin et al.HPDC 2022 · 13 citations
- AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement ApplicationsDaoce Wang, Jesus Pulido, Pascal Grosset, Jiannan Tian et al.SC 2023 · 15 citations
- Adaptive Configuration of In Situ Lossy Compression for Cosmology Simulations via Fine-Grained Rate-Quality ModelingSian Jin, Jesus Pulido, Pascal Grosset, Jiannan Tian et al.HPDC 2021 · 19 citations
- LCP: Enhancing Scientific Data Management with Lossy Compression for ParticlesLongtao Zhang, Ruoyu Li, Congrong Ren, Sheng Di et al.SIGMOD 2025 · 6 citations
- Eureka: Enabling Fine-Grained Access and Range Queries on Compressed Scientific Data via Data-Index Co-CompressionNing Yan, Sheng Di, Kai Zhao, Lipeng WanVLDB 2026
