Neural Interferometry: Image Reconstruction from Astronomical Interferometers Using Transformer-Conditioned Neural Fields
Benjamin Wu, Chao Liu, Benjamin Eckart, Jan Kautz
Abstract
Astronomical interferometry enables a collection of telescopes to achieve angular resolutions comparable to that of a single, much larger telescope. This is achieved by combining simultaneous observations from pairs of telescopes such that the signal is mathematically equivalent to sampling the Fourier domain of the object. However, reconstructing images from such sparse sampling is a challenging and ill-posed problem, with current methods requiring precise tuning of parameters and manual, iterative cleaning by experts. We present a novel deep learning approach in which the representation in the Fourier domain of an astronomical source is learned implicitly using a neural field representation. Data-driven priors can be added through a transformer encoder. Results on synthetically observed galaxies show that transformer-conditioned neural fields can successfully reconstruct astronomical observations even when the number of visibilities is very sparse.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- VisRec: A Semi-Supervised Approach to Visibility Data Reconstruction in Radio AstronomyRuoqi Wang, Haitao Wang, Qiong Luo, Feng Wang et al.AAAI 2025 · 2 citations
- PolarRec: Improving Radio Interferometric Data Reconstruction Using Polar CoordinatesRuoqi Wang, Zhuoyang Chen, Jiayi Zhu, Qiong Luo et al.CVPR 2024 · 1 citation
Builds on11
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Zero-Shot Text-to-Image GenerationAditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray et al.ICML 2021 · 6,356 citations
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
Related papers
- Continuous Field Reconstruction from Sparse Observations with Implicit Neural NetworksXihaier Luo, Wei Xu, Balu Nadiga, Yihui Ren et al.ICLR 2024 · 23 citations
- 3DILG: Irregular Latent Grids for 3D Generative ModelingBiao Zhang, Matthias Nießner, Peter WonkaNeurIPS 2022 · 118 citations
- Transformer Meets Boundary Value Inverse ProblemsRuchi Guo, Shuhao Cao, Long ChenICLR 2023 · 9 citations
- Physical Degradation Model-Guided Interferometric Hyperspectral Reconstruction with Unfolding TransformerYuansheng Li, Yunhao Zou, Linwei Chen, Ying FuICCV 2025
- When deep denoising meets iterative phase retrievalYaotian Wang, Xiaohang Sun, Jason W. FleischerICML 2020 · 22 citations
