DiffNR: Diffusion-Enhanced Neural Representation Optimization for Sparse-View 3D Tomographic Reconstruction
Shiyan Su, Ruyi Zha, Danli Shi, Hongdong Li, Xuelian Cheng
摘要
Neural representations (NRs), such as neural fields and 3D Gaussians, effectively model volumetric data in computed tomography (CT) but suffer from severe artifacts under sparse-view settings. To address this, we propose DiffNR, a novel framework that enhances NR optimization with diffusion priors. At its core is SliceFixer, a single-step diffusion model designed to correct artifacts in degraded slices. We integrate specialized conditioning layers into the network and develop tailored data curation strategies to support model finetuning. During reconstruction, SliceFixer periodically generates pseudo-reference volumes, providing auxiliary 3D perceptual supervision to fix underconstrained regions. Compared to prior methods that embed CT solvers into time-consuming iterative denoising, our repair-and-augment strategy avoids frequent diffusion model queries, leading to better runtime performance. Extensive experiments show that DiffNR improves PSNR by 3.99 dB on average, generalizes well across domains, and maintains efficient optimization.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper15
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware DiffusionJiatao Gu, Alex Trevithick, Kai-En Lin, Joshua M. Susskind 等ICML 2023 · 被引用 224 次
相关 Paper
- DiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography ReconstructionBowen Song, Jason Hu, Zhaoxu Luo, Jeffrey A. Fessler 等NeurIPS 2024 · 被引用 20 次
- Unsupervised Self-Prior Embedding Neural Representation for Iterative Sparse-View CT ReconstructionXuanyu Tian, Lixuan Chen, Qing Wu, Chenhe Du 等AAAI 2025 · 被引用 4 次
- HAD: Hallucination-Aware Diffusion Priors for 3D ReconstructionXi Liu, Weiwei Sun, Zhou Ren, Chris Broaddus 等CVPR 2026 · 被引用 1 次
- Sparse-to-Complete: From Sparse Image Captures to Complete 3D ScenesYiyang Shen, Yin Yang, Kun Zhou, Tianjia ShaoSIGGRAPH 2026
- Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion FieldsAlbert W. Reed, Hyojin Kim, Rushil Anirudh, K. Aditya Mohan 等ICCV 2021 · 被引用 110 次
