Acting as Inverse Inverse Planning
Kartik Chandra, Tzu-Mao Li, Joshua B. Tenenbaum, Jonathan Ragan-Kelley
Abstract
An animator is tasked with depicting that this baby wants the cupcake, not the candy.
If she simply mimics a rational agent, she would move the baby south (along the shortest path)…
…but that motion is highly ambiguous! In fact, it "looks" more like the baby wants the candy.
What if she instead considers what motion best conveys the baby's desires to an audience?
By modeling the audience's experience, our system can automatically suggest crawling west instead.
In which direction should she make the baby start crawling?
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4b6e84d6-79b8-4645-b934-3d974df4e85cCited by top-tier papers3
- Inferring the Future by Imagining the PastKartik Chandra, Tony Chen, Tzu-Mao Li, Jonathan Ragan-Kelley et al.NeurIPS 2023 · 7 citations
- A Domain-Specific Probabilistic Programming Language for Reasoning about Reasoning (Or: A Memo on memo)Kartik Chandra, Tony Chen, Joshua B. Tenenbaum, Jonathan Ragan-KelleyOOPSLA 2025 · 2 citations
- CoSToM: Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language ModelsMengfan Li, Xuanhua Shi, Yang DengACL 2026
Builds on5
- Accelerated Policy Learning with Parallel Differentiable SimulationJie Xu, Viktor Makoviychuk, Yashraj Narang, Fabio Ramos et al.ICLR 2022 · 141 citations
- Online Bayesian Goal Inference for Boundedly Rational Planning AgentsTan Zhi-Xuan, Jordyn L. Mann, Tom Silver, Josh Tenenbaum et al.NeurIPS 2020 · 122 citations
- Control strategies for physically simulated characters performing two-player competitive sportsJungdam Won, Deepak Gopinath, Jessica K. HodginsSIGGRAPH 2021 · 73 citations
- PHASE: PHysically-grounded Abstract Social Events for Machine Social PerceptionAviv Netanyahu, Tianmin Shu, Boris Katz, Andrei Barbu et al.AAAI 2021 · 44 citations
- Designing Perceptual Puzzles by Differentiating Probabilistic ProgramsKartik Chandra, Tzu-Mao Li, Joshua B. Tenenbaum, Jonathan Ragan-KelleySIGGRAPH 2022 · 17 citations
Related papers
- Neural Reasoning about Agents' Goals, Preferences, and ActionsMatteo Bortoletto, Lei Shi, Andreas BullingAAAI 2024 · 8 citations
- Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of othersKanishk Gandhi, Gala Stojnic, Brenden M. Lake, Moira R. DillonNeurIPS 2021 · 59 citations
- S3: Speech, Script and Scene driven Head and Eye AnimationYifang Pan, Rishabh Agrawal, Karan SinghSIGGRAPH 2024 · 11 citations
- Designing actuation systems for animatronic figures via globally optimal discrete searchSimon Huber, Roi Poranne, Stelian CorosSIGGRAPH 2021 · 4 citations
- BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby StepsWang Zhu, Hexiang Hu, Jiacheng Chen, Zhiwei Deng et al.ACL 2020 · 62 citations
