Dark3R: Learning Structure from Motion in the Dark
Andrew Y. Guo, Anagh Malik, SaiKiran Kumar Tedla, Yutong Dai, Yiqian Qin, Zach Salehe, Benjamin Attal, Sotiris Nousias, Kiriakos N. Kutulakos, David B. Lindell
摘要
We introduce Dark3R, a framework for structure from motion in the dark that operates directly on raw images with signal-to-noise ratios (SNRs) below dB -- a regime where conventional feature- and learning-based methods break down. Our key insight is to adapt large-scale 3D foundation models to extreme low-light conditions through a teacher--student distillation process, enabling robust feature matching and camera pose estimation in low light. Dark3R requires no 3D supervision; it is trained solely on noisy--clean raw image pairs, which can be either captured directly or synthesized using a simple Poisson--Gaussian noise model applied to well-exposed raw images. To train and evaluate our approach, we introduce a new, exposure-bracketed dataset that includes 42,000 multi-view raw images with ground-truth 3D annotations, and we demonstrate that Dark3R achieves state-of-the-art structure from motion in the low-SNR regime. Further, we demonstrate state-of-the-art novel view synthesis in the dark using Dark3R's predicted poses and a coarse-to-fine radiance field optimization procedure.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper27
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self DistillationLinfeng Zhang, Jiebo Song, Anni Gao, Jingwei Chen 等ICCV 2019 · 被引用 1,069 次
- BARF: Bundle-Adjusting Neural Radiance FieldsChen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, Simon LuceyICCV 2021 · 被引用 867 次
- Depth-supervised NeRF: Fewer Views and Faster Training for FreeKangle Deng, Andrew Liu, Jun-Yan Zhu, Deva RamananCVPR 2022 · 被引用 756 次
相关 Paper
- Distill Knowledge From NRSfM for Weakly Supervised 3D Pose LearningChaoyang Wang, Chen Kong, Simon LuceyICCV 2019 · 被引用 52 次
- Bright-NeRF: Brightening Neural Radiance Field with Color Restoration from Low-Light RAW ImagesMin Wang, Xin Huang, Guoqing Zhou, Qifeng Guo 等AAAI 2025 · 被引用 1 次
- Optical Flow in the DarkYinqiang Zheng, Mingfang Zhang, Feng LuCVPR 2020
- 2-Shots in the Dark: Low-Light Denoising with Minimal Data AcquisitionLiying Lu, Raphaël Achddou, Sabine SüsstrunkCVPR 2026 · 被引用 2 次
- DepthDark: Robust Monocular Depth Estimation for Low-Light EnvironmentsLongjian Zeng, Zunjie Zhu, Rongfeng Lu, Ming Lu 等ACM MM 2025 · 被引用 2 次
