EMNLP Findings2021
Cross-Lingual Leveled Reading Based on Language-Invariant Features
Abstract
Leveled reading (LR) aims to automatically classify texts according to different reading capabilities and provide appropriate reading materials to readers. However, most state-of-theart LR methods rely on the availability of copious annotated resources, which prevents their adaptation to low-resource languages like Chinese. In our work, to tackle Chinese LR, we explore to perform different language transfer methods on English-Chinese LR. Specifically, we focus on adversarial training and cross-lingual pre-training method to transfer the LR knowledge learned from annotated data in the rich-resource English language to Chinese. For evaluation, we introduce the agebased standard to align datasets with different leveling standards, and conduct experiments in both zero-shot and few-shot settings. Experiments show that the cross-lingual pre-training method can capture language-invariant features more effectively than adversarial training. We also conduct analysis to propose further improvement in cross-lingual LR.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers1
Related papers
- From Good to Best: Two-Stage Training for Cross-Lingual Machine Reading ComprehensionNuo Chen, Linjun Shou, Ming Gong, Jian PeiAAAI 2022 · 18 citations
- Translation-Based Matching Adversarial Network for Cross-Lingual Natural Language InferenceKunxun Qi, Jianfeng DuAAAI 2020 · 6 citations
- Improving Zero-Shot Cross-Lingual Transfer Learning via Robust TrainingKuan-Hao Huang, Wasi Uddin Ahmad, Nanyun Peng, Kai-Wei ChangEMNLP 2021 · 29 citations
- Cross-Lingual Pre-Training Based Transfer for Zero-Shot Neural Machine TranslationBaijun Ji, Zhirui Zhang, Xiangyu Duan, Min Zhang et al.AAAI 2020 · 67 citations
- Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language InferenceHai Hu, He Zhou, Zuoyu Tian, Yiwen Zhang et al.ACL Findings 2021 · 10 citations
