Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion Fields
Albert W. Reed, Hyojin Kim, Rushil Anirudh, K. Aditya Mohan, Kyle Champley, Jingu Kang, Suren Jayasuriya
Abstract
Reconstructing dynamic, time-varying scenes with computed tomography (4D-CT) is a challenging and ill-posed problem common to industrial and medical settings. Existing 4D-CT reconstructions are designed for sparse sampling schemes that require fast CT scanners to capture multiple, rapid revolutions around the scene in order to generate high quality results. However, if the scene is moving too fast, then the sampling occurs along a limited view and is difficult to reconstruct due to spatiotemporal ambiguities. In this work, we design a reconstruction pipeline using implicit neural representations coupled with a novel parametric motion field warping to perform limited view 4D-CT reconstruction of rapidly deforming scenes. Importantly, we utilize a differentiable analysis-bysynthesis approach to compare with captured x-ray sinogram data in a self-supervised fashion. Thus, our resulting optimization method requires no training data to reconstruct the scene. We demonstrate that our proposed system robustly reconstructs scenes containing deformable and periodic motion and validate against state-of-the-art baselines. Further, we demonstrate an ability to reconstruct continuous spatiotemporal representations of our scenes and upsample them to arbitrary volumes and frame rates post-optimization. This research opens a new avenue for implicit neural representations in computed tomography reconstruction in general. Code is available at https://github.com/awreed/DynamicCTReconstruction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f7bfbbea-3dc0-4838-8d4c-4aff14523d1bCited by top-tier papers18
- Implicit Neural Representation for Cooperative Low-light Image EnhancementShuzhou Yang, Moxuan Ding, Yanmin Wu, Zihan Li et al.ICCV 2023 · 224 citations
- Residual Multiplicative Filter Networks for Multiscale ReconstructionShayan Shekarforoush, David B. Lindell, David J. Fleet, Marcus A. BrubakerNeurIPS 2022 · 36 citations
- Unsupervised Polychromatic Neural Representation for CT Metal Artifact ReductionQing Wu, Lixuan Chen, Ce Wang, Hongjiang Wei et al.NeurIPS 2023 · 31 citations
- Continuous Field Reconstruction from Sparse Observations with Implicit Neural NetworksXihaier Luo, Wei Xu, Balu Nadiga, Yihui Ren et al.ICLR 2024 · 23 citations
- Neural Volumetric Reconstruction for Coherent Synthetic Aperture SonarAlbert W. Reed, Juhyeon Kim, Thomas E. Blanford, Adithya Pediredla et al.SIGGRAPH 2023 · 23 citations
Builds on4
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Soft Rasterizer: A Differentiable Renderer for Image-Based 3D ReasoningShichen Liu, Weikai Chen, Tianye Li, Hao LiICCV 2019 · 789 citations
- Equivariant Neural RenderingEmilien Dupont, Miguel Bautista Martin, Alex Colburn, Aditya Sankar et al.ICML 2020 · 69 citations
- Adversarial Generation of Continuous ImagesIvan Skorokhodov, Savva Ignatyev, Mohamed ElhoseinyCVPR 2021
Related papers
- Spatiotemporal-Aware Neural Fields for Dynamic CT ReconstructionQingyang Zhou, Yunfan Ye, Zhiping CaiAAAI 2025 · 3 citations
- Neural Lumigraph RenderingPetr Kellnhofer, Lars Jebe, Andrew Jones, Ryan Spicer et al.CVPR 2021
- VolMoVis: Real-Time Volume Generation and Motion Visualization with Dynamic Tomographic ReconstructionGaofeng Deng, Arie E. KaufmanIEEE VIS 2025
- Unsupervised Self-Prior Embedding Neural Representation for Iterative Sparse-View CT ReconstructionXuanyu Tian, Lixuan Chen, Qing Wu, Chenhe Du et al.AAAI 2025 · 4 citations
- 4D Myocardium Reconstruction with Decoupled Motion and Shape ModelXiaohan Yuan, Cong Liu, Yangang WangICCV 2023 · 10 citations
