Identifying Physical Object Use in Sentences
Tianyu Jiang, Ellen Riloff
Abstract
Commonsense knowledge about the typical functions of physical objects allows people to make inferences during sentence understanding. For example, we infer that "Sam enjoyed the book" means that Sam enjoyed reading the book, even though the action is implicit. Prior research has focused on learning the prototypical functions of physical objects in order to enable inferences about implicit actions. But many sentences refer to objects even when they are not used (e.g., "The book fell"). We argue that NLP systems need to recognize whether an object is being used before inferring how the object is used. We define a new task called Object Use Classification that determines whether a physical object mentioned in a sentence was used or likely will be used. We introduce a new dataset for this task and present a classification model that exploits data augmentation methods and FrameNet when fine-tuning a pre-trained language model. We also show that object use classification combined with knowledge about the prototypical functions of objects has the potential to yield very good inferences about implicit and anticipated actions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7e0f791e-6ab3-4da5-b9d8-47c41081699eCited by top-tier papers2
- Evaluating the Impact of Verbal Multiword Expressions on Machine TranslationLinfeng Liu, Saptarshi Ghosh, Tianyu JiangACL 2026 · 2 citations
- GuessingGame: Measuring the Informativeness of Open-Ended Questions in Large Language ModelsDylan Hutson, Daniel Vennemeyer, Aneesh Deshmukh, Justin Zhan et al.EMNLP 2025
Builds on5
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
- Multitask Prompted Training Enables Zero-Shot Task GeneralizationVictor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach et al.ICLR 2022 · 1,976 citations
- Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit KnowledgeAlon Talmor, Oyvind Tafjord, Peter Clark, Yoav Goldberg et al.NeurIPS 2020 · 119 citations
- Learning Prototypical Functions for Physical ArtifactsTianyu Jiang, Ellen RiloffACL 2021
Related papers
- Seeing the Unseen: Visual Common Sense for Semantic PlacementRam Ramrakhya, Aniruddha Kembhavi, Dhruv Batra, Zsolt Kira et al.CVPR 2024 · 3 citations
- PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D WorldRowan Zellers, Ari Holtzman, Matthew E. Peters, Roozbeh Mottaghi et al.ACL 2021
- Functionality Discovery and Prediction of Physical ObjectsLei Ji, Botian Shi, Xianglin Guo, Xilin ChenAAAI 2020 · 2 citations
- Hierarchical Relational InferenceAleksandar Stanic, Sjoerd van Steenkiste, Jürgen SchmidhuberAAAI 2021 · 17 citations
- PIQA: Reasoning about Physical Commonsense in Natural LanguageYonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao et al.AAAI 2020 · 2,916 citations
