Motron: Multimodal Probabilistic Human Motion Forecasting
Tim Salzmann, Marco Pavone, Markus Ryll
摘要
Autonomous systems and humans are increasingly sharing the same space. Robots work side by side or even hand in hand with humans to balance each other's limitations. Such cooperative interactions are ever more sophisticated. Thus, the ability to reason not just about a human's center of gravity position, but also its granular motion is an important prerequisite for human-robot interaction. Though, many algorithms ignore the multimodal nature of humans or neglect uncertainty in their motion forecasts. We present Motron, a multimodal, probabilistic, graph-structured model, that captures human's multimodality using probabilistic methods while being able to output deterministic maximum-likelihood motions and corresponding confidence values for each mode. Our model aims to be tightly integrated with the robotic planning-control-interaction loop; outputting physically feasible human motions and being computationally efficient. We demonstrate the performance of our model on several challenging real-world motion forecasting datasets, outperforming a wide array of generative/variational methods while providing state-of-the-art single-output motions if required. Both using significantly less computational power than state-of-the art algorithms.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper19
- BeLFusion: Latent Diffusion for Behavior-Driven Human Motion PredictionGermán Barquero, Sergio Escalera, Cristina PalmeroICCV 2023 · 被引用 107 次
- HumanMAC: Masked Motion Completion for Human Motion PredictionLing-Hao Chen, Jiawei Zhang, Yewen Li, Yiren Pang 等ICCV 2023 · 被引用 106 次
- SINC: Spatial Composition of 3D Human Motions for Simultaneous Action GenerationNikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül VarolICCV 2023 · 被引用 69 次
- Auxiliary Tasks Benefit 3D Skeleton-based Human Motion PredictionChenxin Xu, Robby T. Tan, Yuhong Tan, Siheng Chen 等ICCV 2023 · 被引用 35 次
- MoML: Online Meta Adaptation for 3D Human Motion PredictionXiaoning Sun, Huaijiang Sun, Bin Li, Dong Wei 等CVPR 2024 · 被引用 5 次
它引用的顶会 Paper7
- AMASS: Archive of Motion Capture As Surface ShapesNaureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll 等ICCV 2019 · 被引用 1,784 次
- Learning Trajectory Dependencies for Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu Salzmann, Hongdong LiICCV 2019 · 被引用 534 次
- The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal GraphsBoris Ivanovic, Marco PavoneICCV 2019 · 被引用 473 次
- Deep Orientation Uncertainty Learning based on a Bingham LossIgor Gilitschenski, Roshni Sahoo, Wilko Schwarting, Alexander Amini 等ICLR 2020 · 被引用 75 次
- Contextually Plausible and Diverse 3D Human Motion PredictionSadegh Aliakbarian, Fatemeh Sadat Saleh, Lars Petersson, Stephen Gould 等ICCV 2021 · 被引用 44 次
相关 Paper
- Multimodal Interaction-Aware Trajectory Prediction in Crowded SpaceXiaodan Shi, Xiaowei Shao, Zipei Fan, Renhe Jiang 等AAAI 2020 · 被引用 32 次
- Multi-Agent Long-Term 3D Human Pose Forecasting via Interaction-Aware Trajectory ConditioningJaewoo Jeong, Daehee Park, Kuk-Jin YoonCVPR 2024
- HUMOF: Human Motion Forecasting in Interactive Social ScenesCaiyi Sun, Yujing Sun, Xiao Han, Zemin Yang 等ICLR 2026 · 被引用 2 次
- MotionMap: Representing Multimodality in Human Pose ForecastingReyhaneh HosseiniNejad, Megh Shukla, Saeed Saadatnejad, Mathieu Salzmann 等CVPR 2025
- GRIN: Generative Relation and Intention Network for Multi-agent Trajectory PredictionLongyuan Li, Jian Yao, Li K. Wenliang, Tong He 等NeurIPS 2021 · 被引用 51 次
