Rethinking Human Motion Prediction with Symplectic Integral
Haipeng Chen, Kedi Lyu, Zhenguang Liu, Yifang Yin, Xun Yang, Yingda Lyu
摘要
Long-term and accurate forecasting is the long-standing pursuit of the human motion prediction task. Existing methods typically suffer from dramatic degradation in prediction accuracy with increasing prediction horizon. It comes down to two reasons: 1) Insufficient numerical stability caused by unforeseen high noise and complex feature relationships in the data, and 2) Inadequate modeling stability caused by unreasonable step sizes and undesirable parameter updates in the prediction. In this paper, we design a novel and symplectic integral-inspired framework named symplectic integral neural network (SINN), which engages symplectic trajectories to optimize the pose representation and employs a stable symplectic operator to alternately model the dynamic context. Specifically, we design a Symplectic Representation Encoder that performs on enhanced human pose representation to obtain trajectories on the symplectic manifold, ensuring numerical stability based on Hamiltonian mechanics and symplectic spatial splitting algorithm. We further present the Symplectic Temporal Aggregation module, which splits the long-term prediction into multiple accurate short-term predictions generated by a symplectic operator to secure modeling stability. Moreover, our approach is model-agnostic and can be efficiently integrated with different physical dynamics models. The experimental results demonstrate that our method achieves the new stateof-the-art, outperforming existing methods by 20.1% on Hu-man3.6M, 16.7% on CUM Mocap, and 10.2% on 3DPW.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper11
- Learning Trajectory Dependencies for Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu Salzmann, Hongdong LiICCV 2019 · 被引用 534 次
- Deconfounded Video Moment Retrieval with Causal InterventionXun Yang, Fuli Feng, Wei Ji, Meng Wang 等SIGIR 2021 · 被引用 198 次
- Aggregated Multi-GANs for Controlled 3D Human Motion PredictionZhenguang Liu, Kedi Lyu, Shuang Wu, Haipeng Chen 等AAAI 2021 · 被引用 64 次
- Motion Prediction using Trajectory CuesZhenguang Liu, Pengxiang Su, Shuang Wu, Xuanjing Shen 等ICCV 2021 · 被引用 63 次
- Motion Prediction via Joint Dependency Modeling in Phase SpacePengxiang Su, Zhenguang Liu, Shuang Wu, Lei Zhu 等ACM MM 2021 · 被引用 22 次
相关 Paper
- Symplectic Recurrent Neural NetworksZhengdao Chen, Jianyu Zhang, Martín Arjovsky, Léon BottouICLR 2020 · 被引用 261 次
- Learning Human Motion Prediction via Stochastic Differential EquationsKedi Lyu, Zhenguang Liu, Shuang Wu, Haipeng Chen 等ACM MM 2021 · 被引用 14 次
- Future Motion Dynamic Modeling via Hybrid Supervision for Multi-Person Motion Prediction Uncertainty ReductionYan Zhuang, Yanlu Cai, Weizhong Zhang, Cheng JinACM MM 2024 · 被引用 3 次
- Sparse Symplectically Integrated Neural NetworksDaniel M. DiPietro, Shiying Xiong, Bo ZhuNeurIPS 2020 · 被引用 39 次
- Nonseparable Symplectic Neural NetworksShiying Xiong, Yunjin Tong, Xingzhe He, Shuqi Yang 等ICLR 2021 · 被引用 47 次
