mmWaveFlow: Unified Enhancement and Generation of mmWave Human Point Clouds
Chang Su, Beihong Jin, Qiwen Shi, Zhi Wang
Abstract
Millimeter-wave (mmWave) point clouds have attracted increasing interest in human sensing due to their robustness, privacy preservation, and low cost. However, their practical adoption is hindered by the inherent sparsity of data and the lack of large-scale annotated dataset. We revisit generative modeling and propose a unified flow-matching framework mmWaveFlow that unifies enhancement and generation of mmWave point clouds by learning an invertible transport between dense and sparse point clouds. We leverage paired data and a Cross-modal Latent Alignment module to enforce semantic alignment and bridge the modality gap. We find that condition-free flow matching is more vulnerable to latent path crossings, which impair transport. Therefore, we propose Origin-Aware Flow Matching (OA-Flow) by conditioning transport on the path origin to mitigate ambiguity in bidirectional transport. Results of experiments across multiple datasets demonstrate the effectiveness of mmWaveFlow for mmWave human point clouds generation and enhancement. We also observe consistent gains in downstream tasks, highlighting the promise of our framework for human sensing. Codes are available at https://github.com/suchang-99/mmWaveFlow.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on28
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari et al.ICML 2024 · 3,620 citations
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine et al.NeurIPS 2020 · 2,261 citations
Related papers
- Human Parsing with Joint Learning for Dynamic mmWave Radar Point CloudShuai Wang, Dongjiang Cao, Ruofeng Liu, Wenchao Jiang et al.UbiComp 2023 · 34 citations
- MI-Mesh: 3D Human Mesh Construction by Fusing Image and Millimeter WaveHan Ding, Zhenbin Chen, Cui Zhao, Fei Wang et al.UbiComp 2023 · 29 citations
- SoftFlow: Probabilistic Framework for Normalizing Flow on ManifoldsHyeongju Kim, Hyeonseung Lee, Woo Hyun Kang, Joun Yeop Lee et al.NeurIPS 2020 · 149 citations
- Towards Generalized mmWave-based Human Pose Estimation through Signal AugmentationHongfei Xue, Qiming Cao, Chenglin Miao, Yan Ju et al.MobiCom 2023 · 69 citations
- One Snapshot is All You Need: A Generalized Method for mmWave Signal GenerationTeng Huang, Han Ding, Wenxin Sun, Cui Zhao et al.INFOCOM 2025 · 6 citations
