EMNLP Findings2022
MICO: A Multi-alternative Contrastive Learning Framework for Commonsense Knowledge Representation
Ying Su, Zihao Wang, Tianqing Fang, Hongming Zhang, Yangqiu Song, Tong Zhang
Abstract
Commonsense reasoning tasks such as commonsense knowledge graph completion and commonsense question answering require powerful representation learning. In this paper, we propose to learn commonsense knowledge representation by MICO, a Multi-alternative con-trastIve learning framework on COmmonsense knowledge graphs (MICO). MICO generates the commonsense knowledge representation by contextual interaction between entity nodes and relations with multi-alternative contrastive learning. In MICO, the head and tail entities in an (h, r, t) knowledge triple are converted to two relation-aware sequence pairs (a premise and an alternative) in the form of natural language. Semantic representations generated by MICO can benefit the following two tasks by simply comparing the distance score between the representations: 1) zero-shot commonsense question answering task; 2) inductive commonsense knowledge graph completion task. Extensive experiments show the effectiveness of our method.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
3 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs cites PIQA: Reasoning about Physical Commonsense in Natural Language
- Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs cites (Comet-) Atomic 2020: On Symbolic and Neural Commonsense Knowledge Graphs
- (Comet-) Atomic 2020: On Symbolic and Neural Commonsense Knowledge Graphs cites PIQA: Reasoning about Physical Commonsense in Natural Language
- CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning cites PIQA: Reasoning about Physical Commonsense in Natural Language
- CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning cites Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs
- CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning cites (Comet-) Atomic 2020: On Symbolic and Neural Commonsense Knowledge Graphs
- CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning cites CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning
- CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning cites PIQA: Reasoning about Physical Commonsense in Natural Language
- GreaseLM: Graph REASoning Enhanced Language Models cites Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answering
- GreaseLM: Graph REASoning Enhanced Language Models cites (Comet-) Atomic 2020: On Symbolic and Neural Commonsense Knowledge Graphs
Cited by top-tier papers3
- CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense ReasoningWeiqi Wang, Tianqing Fang, Baixuan Xu, Chun Yi Louis Bo et al.ACL 2023 · 13 citations
- CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense ReasoningWeiqi Wang, Tianqing Fang, Chunyang Li, Haochen Shi et al.ACL 2024 · 10 citations
- Complex Reasoning over Logical Queries on Commonsense Knowledge GraphsTianqing Fang, Zeming Chen, Yangqiu Song, Antoine BosselutACL 2024 · 5 citations
Builds on17
- PIQA: Reasoning about Physical Commonsense in Natural LanguageYonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao et al.AAAI 2020 · 2,916 citations
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- (Comet-) Atomic 2020: On Symbolic and Neural Commonsense Knowledge GraphsJena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da et al.AAAI 2021 · 458 citations
- GreaseLM: Graph REASoning Enhanced Language ModelsXikun Zhang, Antoine Bosselut, Michihiro Yasunaga, Hongyu Ren et al.ICLR 2022 · 285 citations
- Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question AnsweringShangwen Lv, Daya Guo, Jingjing Xu, Duyu Tang et al.AAAI 2020 · 224 citations
Related papers
- KE-GCL: Knowledge Enhanced Graph Contrastive Learning for Commonsense Question AnsweringLihui Zhang, Ruifan LiEMNLP Findings 2022 · 7 citations
- CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question AnsweringWeiqi Wang, Tianqing Fang, Wenxuan Ding, Baixuan Xu et al.EMNLP Findings 2023 · 19 citations
- Commonsense Knowledge Graph Completion Via Contrastive Pretraining and Node ClusteringSiwei Wu, Xiangqing Shen, Rui XiaACL Findings 2023 · 7 citations
- Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question AnsweringKaixin Ma, Filip Ilievski, Jonathan Francis, Yonatan Bisk et al.AAAI 2021 · 100 citations
- VISTA: Visual-Textual Knowledge Graph Representation LearningJaejun Lee, Chanyoung Chung, Hochang Lee, Sungho Jo et al.EMNLP Findings 2023 · 58 citations
