CraftAssist Instruction Parsing: Semantic Parsing for a Voxel-World Assistant
Kavya Srinet, Yacine Jernite, Jonathan Gray, Arthur Szlam
2020Year
7Citations
1Top-tier citations
Abstract
We propose a semantic parsing dataset focused on instruction-driven communication with an agent in the game Minecraft 1 . The dataset consists of 7K human utterances and their corresponding parses. Given proper world state, the parses can be interpreted and executed in game. We report the performance of baseline models, and analyze their successes and failures.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e2a258a9-7dbe-49fc-b225-9424391df920Cited by top-tier papers1
Ask how each one uses itRelated papers
- MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative TasksCristian-Paul Bara, Sky CH-Wang, Joyce ChaiEMNLP 2021 · 28 citations
- Learning to execute instructions in a Minecraft dialoguePrashant Jayannavar, Anjali Narayan-Chen, Julia HockenmaierACL 2020 · 22 citations
- Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned PolicyZaijing Li, Yuquan Xie, Rui Shao, Gongwei Chen et al.CVPR 2025
- Speak to your Parser: Interactive Text-to-SQL with Natural Language FeedbackAhmed Elgohary, Saghar Hosseini, Ahmed Hassan AwadallahACL 2020 · 13 citations
- OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following AgentsZihao Wang, Shaofei Cai, Zhancun Mu, Haowei Lin et al.NeurIPS 2024 · 37 citations
