DiffNR: Diffusion-Enhanced Neural Representation Optimization for Sparse-View 3D Tomographic Reconstruction
Shiyan Su, Ruyi Zha, Danli Shi, Hongdong Li, Xuelian Cheng
Abstract
Neural representations (NRs), such as neural fields and 3D Gaussians, effectively model volumetric data in computed tomography (CT) but suffer from severe artifacts under sparse-view settings. To address this, we propose DiffNR, a novel framework that enhances NR optimization with diffusion priors. At its core is SliceFixer, a single-step diffusion model designed to correct artifacts in degraded slices. We integrate specialized conditioning layers into the network and develop tailored data curation strategies to support model finetuning. During reconstruction, SliceFixer periodically generates pseudo-reference volumes, providing auxiliary 3D perceptual supervision to fix underconstrained regions. Compared to prior methods that embed CT solvers into time-consuming iterative denoising, our repair-and-augment strategy avoids frequent diffusion model queries, leading to better runtime performance. Extensive experiments show that DiffNR improves PSNR by 3.99 dB on average, generalizes well across domains, and maintains efficient optimization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d2fbc985-6fab-4002-8ad6-4a4cda467493Builds on15
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware DiffusionJiatao Gu, Alex Trevithick, Kai-En Lin, Joshua M. Susskind et al.ICML 2023 · 224 citations
Related papers
- DiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography ReconstructionBowen Song, Jason Hu, Zhaoxu Luo, Jeffrey A. Fessler et al.NeurIPS 2024 · 20 citations
- Unsupervised Self-Prior Embedding Neural Representation for Iterative Sparse-View CT ReconstructionXuanyu Tian, Lixuan Chen, Qing Wu, Chenhe Du et al.AAAI 2025 · 4 citations
- HAD: Hallucination-Aware Diffusion Priors for 3D ReconstructionXi Liu, Weiwei Sun, Zhou Ren, Chris Broaddus et al.CVPR 2026 · 1 citation
- Sparse-to-Complete: From Sparse Image Captures to Complete 3D ScenesYiyang Shen, Yin Yang, Kun Zhou, Tianjia ShaoSIGGRAPH 2026
- Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion FieldsAlbert W. Reed, Hyojin Kim, Rushil Anirudh, K. Aditya Mohan et al.ICCV 2021 · 110 citations
