RF4D: Neural Radar Fields for Novel View Synthesis in Outdoor Dynamic Scenes
Jiarui Zhang, Zhihao Li, Chong Wang, Bihan Wen
Abstract
Neural fields (NFs) have achieved remarkable success in scene reconstruction and novel view synthesis. However, existing NF approaches that rely on RGB or LiDAR inputs often struggle under adverse weather conditions, limiting their robustness in real-world outdoor environments such as autonomous driving. In contrast, millimeter-wave radar is inherently resilient to environmental variations, yet its integration with NFs remains largely underexplored. Moreover, outdoor driving scenes frequently involve dynamic objects, making spatiotemporal modeling crucial for temporally consistent novel view synthesis. To address these challenges, we present RF4D, a radar-based neural field framework tailored for novel view synthesis in outdoor dynamic scenes. RF4D explicitly incorporates temporal information into its representation, enabling more accurate modeling of object motion. A dedicated scene flow module further predicts motion offsets between adjacent frames, enforcing temporal occupancy coherence during dynamic scene reconstruction. Moreover, we propose a radar-specific power rendering formulation grounded in radar sensing physics, improving both synthesis accuracy and interpretability. Extensive experiments on public radar datasets demonstrate that RF4D substantially outperforms existing methods in radar measurement synthesis and occupancy estimation accuracy, with particularly strong gains in dynamic outdoor environments. Code is available at https://zhan0618.github.io/RF4D.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b9150730-4000-46a0-882e-ea555b5cc911Cited by top-tier papers2
- M4Human: A Large-Scale Multimodal mmWave Radar Benchmark for Human Mesh ReconstructionJunqiao Fan, Yunjiao Zhou, Yizhuo Yang, Xinyuan Cui et al.CVPR 2026 · 11 citations
- Seeing through boxes: Non-Line-of-Sight 3D Reconstruction from Radar SignalsJiachen Lu, Hailan Shanbhag, Haitham Al HassaniehCVPR 2026 · 1 citation
Builds on34
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz et al.ICCV 2021 · 1,442 citations
- PlenOctrees for Real-time Rendering of Neural Radiance FieldsAlex Yu, Ruilong Li, Matthew Tancik, Hao Li et al.ICCV 2021 · 1,284 citations
- Neural 3D Video Synthesis from Multi-view VideoTianye Li, Mira Slavcheva, Michael Zollhöfer, Simon Green et al.CVPR 2022 · 324 citations
- ContextGS : Compact 3D Gaussian Splatting with Anchor Level Context ModelYufei Wang, Zhihao Li, Lanqing Guo, Wenhan Yang et al.NeurIPS 2024 · 145 citations
Related papers
- Radar Fields: Frequency-Space Neural Scene Representations for FMCW RadarDavid Borts, Erich Liang, Tim Broedermann, Andrea Ramazzina et al.SIGGRAPH 2024 · 20 citations
- LiDAR4D: Dynamic Neural Fields for Novel Space-Time View LiDAR SynthesisZehan Zheng, Fan Lu, Weiyi Xue, Guang Chen et al.CVPR 2024 · 14 citations
- Neural LiDAR Fields for Novel View SynthesisShengyu Huang, Zan Gojcic, Zian Wang, Francis Williams et al.ICCV 2023 · 80 citations
- Towards Robust 3D Object Detection with LiDAR and 4D Radar Fusion in Various Weather ConditionsYujeong Chae, Hyeonseong Kim, Kuk-Jin YoonCVPR 2024
- RaLiFlow: Scene Flow Estimation with 4D Radar and LiDAR Point CloudsJingyun Fu, Zhiyu Xiang, Na ZhaoAAAI 2026
