Dark3R: Learning Structure from Motion in the Dark
Andrew Y. Guo, Anagh Malik, SaiKiran Kumar Tedla, Yutong Dai, Yiqian Qin, Zach Salehe, Benjamin Attal, Sotiris Nousias, Kiriakos N. Kutulakos, David B. Lindell
Abstract
We introduce Dark3R, a framework for structure from motion in the dark that operates directly on raw images with signal-to-noise ratios (SNRs) below dB -- a regime where conventional feature- and learning-based methods break down. Our key insight is to adapt large-scale 3D foundation models to extreme low-light conditions through a teacher--student distillation process, enabling robust feature matching and camera pose estimation in low light. Dark3R requires no 3D supervision; it is trained solely on noisy--clean raw image pairs, which can be either captured directly or synthesized using a simple Poisson--Gaussian noise model applied to well-exposed raw images. To train and evaluate our approach, we introduce a new, exposure-bracketed dataset that includes 42,000 multi-view raw images with ground-truth 3D annotations, and we demonstrate that Dark3R achieves state-of-the-art structure from motion in the low-SNR regime. Further, we demonstrate state-of-the-art novel view synthesis in the dark using Dark3R's predicted poses and a coarse-to-fine radiance field optimization procedure.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext edf20533-1e6f-40f1-ae68-db933c179236Builds on27
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self DistillationLinfeng Zhang, Jiebo Song, Anni Gao, Jingwei Chen et al.ICCV 2019 · 1,069 citations
- BARF: Bundle-Adjusting Neural Radiance FieldsChen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, Simon LuceyICCV 2021 · 867 citations
- Depth-supervised NeRF: Fewer Views and Faster Training for FreeKangle Deng, Andrew Liu, Jun-Yan Zhu, Deva RamananCVPR 2022 · 756 citations
Related papers
- Distill Knowledge From NRSfM for Weakly Supervised 3D Pose LearningChaoyang Wang, Chen Kong, Simon LuceyICCV 2019 · 52 citations
- Bright-NeRF: Brightening Neural Radiance Field with Color Restoration from Low-Light RAW ImagesMin Wang, Xin Huang, Guoqing Zhou, Qifeng Guo et al.AAAI 2025 · 1 citation
- Optical Flow in the DarkYinqiang Zheng, Mingfang Zhang, Feng LuCVPR 2020
- 2-Shots in the Dark: Low-Light Denoising with Minimal Data AcquisitionLiying Lu, Raphaël Achddou, Sabine SüsstrunkCVPR 2026 · 2 citations
- DepthDark: Robust Monocular Depth Estimation for Low-Light EnvironmentsLongjian Zeng, Zunjie Zhu, Rongfeng Lu, Ming Lu et al.ACM MM 2025 · 2 citations
