Label Confidence Weighted Learning for Target-level Sentence Simplification
Xin Ying Qiu, Jingshen Zhang
Abstract
Multi-level sentence simplification generates simplified sentences with varying language proficiency levels. We propose Label Confidence Weighted Learning (LCWL), a novel approach that incorporates a label confidence weighting scheme in the training loss of the encoderdecoder model, setting it apart from existing confidence-weighting methods primarily designed for classification. Experimentation on English grade-level simplification dataset shows that LCWL outperforms state-of-the-art unsupervised baselines. Fine-tuning the LCWL model on in-domain data and combining with Symmetric Cross Entropy (SCE) consistently delivers better simplifications compared to strong supervised methods. Our results highlight the effectiveness of label confidence weighting techniques for text simplification tasks with encoderdecoder architectures.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7d1c9e13-6e52-4841-a710-d2d051778d2cCited by top-tier papers1
Ask how each one uses itBuilds on6
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- Symmetric Cross Entropy for Robust Learning With Noisy LabelsYisen Wang, Xingjun Ma, Zaiyi Chen, Yuan Luo et al.ICCV 2019 · 1,125 citations
- Neural CRF Model for Sentence Alignment in Text SimplificationChao Jiang, Mounica Maddela, Wuwei Lan, Yang Zhong et al.ACL 2020 · 103 citations
- LENS: A Learnable Evaluation Metric for Text SimplificationMounica Maddela, Yao Dou, David Heineman, Wei XuACL 2023 · 21 citations
- Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSADavid Heineman, Yao Dou, Mounica Maddela, Wei XuEMNLP 2023 · 5 citations
Related papers
- Semi-Supervised Text Simplification with Back-Translation and Asymmetric Denoising AutoencodersYanbin Zhao, Lu Chen, Zhi Chen, Kai YuAAAI 2020 · 39 citations
- CEFR-Based Sentence Difficulty Annotation and AssessmentYuki Arase, Satoru Uchida, Tomoyuki KajiwaraEMNLP 2022 · 17 citations
- Zero-Shot Crosslingual Sentence SimplificationJonathan Mallinson, Rico Sennrich, Mirella LapataEMNLP 2020 · 20 citations
- A New Dataset and Empirical Study for Sentence Simplification in ChineseShiping Yang, Renliang Sun, Xiaojun WanACL 2023 · 4 citations
- Domain Adaptation in Multilingual and Multi-Domain Monolingual Settings for Complex Word IdentificationGeorge-Eduard Zaharia, Razvan-Alexandru Smadu, Dumitru-Clementin Cercel, Mihai DascaluACL 2022 · 4 citations
