Facilitating Contrastive Learning of Discourse Relational Senses by Exploiting the Hierarchy of Sense Relations
Wanqiu Long, Bonnie Webber
Abstract
Implicit discourse relation recognition is a challenging task that involves identifying the sense or senses that hold between two adjacent spans of text, in the absense of an explicit connective between them. In both PDTB-2 (Prasad et al., 2008) and PDTB-3 (Webber et al., 2019), discourse relational senses are organized into a three-level hierarchy ranging from four broad top-level senses, to more specific senses below them. Most previous work on implicitf discourse relation recognition have used the sense hierarchy simply to indicate what sense labels were available. Here we do more -incorporating the sense hierarchy into the recognition process itself and using it to select the negative examples used in contrastive learning. With no additional effort, the approach achieves stateof-the-art performance on the task. Our code is released in https://github.com/wanqiulong 0923/Contrastive_IDRR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Annotation-Inspired Implicit Discourse Relation Classification with Auxiliary Discourse Connective GenerationWei Liu, Michael StrubeACL 2023 · 9 citations
- Prompt-based Logical Semantics Enhancement for Implicit Discourse Relation RecognitionChenxu Wang, Ping Jian, Mu HuangEMNLP 2023 · 3 citations
- Improving Implicit Discourse Relation Recognition with Natural Language Explanations from LLMsHeng Wang, Changxing WuAAAI 2026
- TGEA: An Error-Annotated Dataset and Benchmark Tasks for TextGeneration from Pretrained Language ModelsJie He, Bo Peng, Yi Liao, Qun Liu et al.ACL 2021
Builds on13
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text ClassificationVarsha Suresh, Desmond C. OngEMNLP 2021 · 71 citations
- Pairwise Supervised Contrastive Learning of Sentence RepresentationsDejiao Zhang, Shang-Wen Li, Wei Xiao, Henghui Zhu et al.EMNLP 2021 · 43 citations
Related papers
- A Label Dependence-Aware Sequence Generation Model for Multi-Level Implicit Discourse Relation RecognitionChangxing Wu, Liuwen Cao, Yubin Ge, Yang Liu et al.AAAI 2022 · 38 citations
- Not Just Classification: Recognizing Implicit Discourse Relation on Joint Modeling of Classification and GenerationFeng Jiang, Yaxin Fan, Xiaomin Chu, Peifeng Li et al.EMNLP 2021 · 14 citations
- TransS-Driven Joint Learning Architecture for Implicit Discourse Relation RecognitionRuifang He, Jian Wang, Fengyu Guo, Yugui HanACL 2020 · 30 citations
- Connective Prediction for Implicit Discourse Relation Recognition via Knowledge DistillationHongyi Wu, Hao Zhou, Man Lan, Yuanbin Wu et al.ACL 2023 · 7 citations
- Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation RecognitionHaodong Zhao, Ruifang He, Mengnan Xiao, Jing XuACL 2023 · 7 citations
