mmWaveFlow: Unified Enhancement and Generation of mmWave Human Point Clouds
Chang Su, Beihong Jin, Qiwen Shi, Zhi Wang
摘要
Millimeter-wave (mmWave) point clouds have attracted increasing interest in human sensing due to their robustness, privacy preservation, and low cost. However, their practical adoption is hindered by the inherent sparsity of data and the lack of large-scale annotated dataset. We revisit generative modeling and propose a unified flow-matching framework mmWaveFlow that unifies enhancement and generation of mmWave point clouds by learning an invertible transport between dense and sparse point clouds. We leverage paired data and a Cross-modal Latent Alignment module to enforce semantic alignment and bridge the modality gap. We find that condition-free flow matching is more vulnerable to latent path crossings, which impair transport. Therefore, we propose Origin-Aware Flow Matching (OA-Flow) by conditioning transport on the path origin to mitigate ambiguity in bidirectional transport. Results of experiments across multiple datasets demonstrate the effectiveness of mmWaveFlow for mmWave human point clouds generation and enhancement. We also observe consistent gains in downstream tasks, highlighting the promise of our framework for human sensing. Codes are available at https://github.com/suchang-99/mmWaveFlow.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper28
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari 等ICML 2024 · 被引用 3,620 次
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine 等NeurIPS 2020 · 被引用 2,261 次
相关 Paper
- Human Parsing with Joint Learning for Dynamic mmWave Radar Point CloudShuai Wang, Dongjiang Cao, Ruofeng Liu, Wenchao Jiang 等UbiComp 2023 · 被引用 34 次
- MI-Mesh: 3D Human Mesh Construction by Fusing Image and Millimeter WaveHan Ding, Zhenbin Chen, Cui Zhao, Fei Wang 等UbiComp 2023 · 被引用 29 次
- SoftFlow: Probabilistic Framework for Normalizing Flow on ManifoldsHyeongju Kim, Hyeonseung Lee, Woo Hyun Kang, Joun Yeop Lee 等NeurIPS 2020 · 被引用 149 次
- Towards Generalized mmWave-based Human Pose Estimation through Signal AugmentationHongfei Xue, Qiming Cao, Chenglin Miao, Yan Ju 等MobiCom 2023 · 被引用 69 次
- One Snapshot is All You Need: A Generalized Method for mmWave Signal GenerationTeng Huang, Han Ding, Wenxin Sun, Cui Zhao 等INFOCOM 2025 · 被引用 6 次
