Motron: Multimodal Probabilistic Human Motion Forecasting
Tim Salzmann, Marco Pavone, Markus Ryll
Abstract
Autonomous systems and humans are increasingly sharing the same space. Robots work side by side or even hand in hand with humans to balance each other's limitations. Such cooperative interactions are ever more sophisticated. Thus, the ability to reason not just about a human's center of gravity position, but also its granular motion is an important prerequisite for human-robot interaction. Though, many algorithms ignore the multimodal nature of humans or neglect uncertainty in their motion forecasts. We present Motron, a multimodal, probabilistic, graph-structured model, that captures human's multimodality using probabilistic methods while being able to output deterministic maximum-likelihood motions and corresponding confidence values for each mode. Our model aims to be tightly integrated with the robotic planning-control-interaction loop; outputting physically feasible human motions and being computationally efficient. We demonstrate the performance of our model on several challenging real-world motion forecasting datasets, outperforming a wide array of generative/variational methods while providing state-of-the-art single-output motions if required. Both using significantly less computational power than state-of-the art algorithms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e6cd70a7-8b18-4668-be37-5e2ca768c197Cited by top-tier papers19
- BeLFusion: Latent Diffusion for Behavior-Driven Human Motion PredictionGermán Barquero, Sergio Escalera, Cristina PalmeroICCV 2023 · 107 citations
- HumanMAC: Masked Motion Completion for Human Motion PredictionLing-Hao Chen, Jiawei Zhang, Yewen Li, Yiren Pang et al.ICCV 2023 · 106 citations
- SINC: Spatial Composition of 3D Human Motions for Simultaneous Action GenerationNikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül VarolICCV 2023 · 69 citations
- Auxiliary Tasks Benefit 3D Skeleton-based Human Motion PredictionChenxin Xu, Robby T. Tan, Yuhong Tan, Siheng Chen et al.ICCV 2023 · 35 citations
- MoML: Online Meta Adaptation for 3D Human Motion PredictionXiaoning Sun, Huaijiang Sun, Bin Li, Dong Wei et al.CVPR 2024 · 5 citations
Builds on7
- AMASS: Archive of Motion Capture As Surface ShapesNaureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll et al.ICCV 2019 · 1,784 citations
- Learning Trajectory Dependencies for Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu Salzmann, Hongdong LiICCV 2019 · 534 citations
- The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal GraphsBoris Ivanovic, Marco PavoneICCV 2019 · 473 citations
- Deep Orientation Uncertainty Learning based on a Bingham LossIgor Gilitschenski, Roshni Sahoo, Wilko Schwarting, Alexander Amini et al.ICLR 2020 · 75 citations
- Contextually Plausible and Diverse 3D Human Motion PredictionSadegh Aliakbarian, Fatemeh Sadat Saleh, Lars Petersson, Stephen Gould et al.ICCV 2021 · 44 citations
Related papers
- Multimodal Interaction-Aware Trajectory Prediction in Crowded SpaceXiaodan Shi, Xiaowei Shao, Zipei Fan, Renhe Jiang et al.AAAI 2020 · 32 citations
- Multi-Agent Long-Term 3D Human Pose Forecasting via Interaction-Aware Trajectory ConditioningJaewoo Jeong, Daehee Park, Kuk-Jin YoonCVPR 2024
- HUMOF: Human Motion Forecasting in Interactive Social ScenesCaiyi Sun, Yujing Sun, Xiao Han, Zemin Yang et al.ICLR 2026 · 2 citations
- MotionMap: Representing Multimodality in Human Pose ForecastingReyhaneh HosseiniNejad, Megh Shukla, Saeed Saadatnejad, Mathieu Salzmann et al.CVPR 2025
- GRIN: Generative Relation and Intention Network for Multi-agent Trajectory PredictionLongyuan Li, Jian Yao, Li K. Wenliang, Tong He et al.NeurIPS 2021 · 51 citations
