Controlled SDEs for Long-Horizon Motion Generation under Latent Decision Uncertainty
Han Zhang, Nenggan Zheng
Abstract
Long-horizon motion prediction under external commands is challenged by latent decision uncertainty, where the internal states governing future behavior are unobservable and evolve stochastically over time. This issue is particularly pronounced in biological agents, whose motion trajectories reflect decision-making processes rooted in underlying cognitive states. To address these challenges, we propose CogSDE, a formulation of a controlled stochastic differential equation (SDE) for modeling instruction-driven latent decision dynamics. The drift term in the SDE incorporates a dual-channel control modulation mechanism, enabling external commands to modulate the evolution of latent states. The diffusion term employs a state-dependent operator to model intrinsic uncertainty in latent decision dynamics. Furthermore, we establish dissipativity-based mean-square boundedness for the latent decision dynamics. Experiments demonstrate that CogSDE consistently improves predictive accuracy in long-horizon motion generation. Importantly, predicted trajectories remain well aligned with control commands over extended horizons, a property widely recognized as challenging in long-horizon motion prediction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on20
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
- Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris et al.UIST 2023 · 1,882 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
Related papers
- Diffused Task-Agnostic Milestone PlannerMineui Hong, Minjae Kang, Songhwai OhNeurIPS 2023 · 15 citations
- Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-MakingFan Feng, Selena Ge, Minghao Fu, Zijian Li et al.ICLR 2026 · 3 citations
- Entropic Desired Dynamics for Intrinsic ControlSteven Hansen, Guillaume Desjardins, Kate Baumli, David Warde-Farley et al.NeurIPS 2021 · 9 citations
- Neural Markov Controlled SDE: Stochastic Optimization for Continuous-Time DataSung Woo Park, Kyungjae Lee, Junseok KwonICLR 2022 · 35 citations
- Predictive Coding for Locally-Linear ControlRui Shu, Tung Nguyen, Yinlam Chow, Tuan Pham et al.ICML 2020 · 28 citations
