Commonsense Knowledge Augmentation for Low-Resource Languages via Adversarial Learning
Bosung Kim, Juae Kim, Youngjoong Ko, Jungyun Seo
Abstract
Commonsense reasoning is one of the ultimate goals of artificial intelligence research because it simulates the human thinking process. However, most commonsense reasoning studies have focused on English because available commonsense knowledge for low-resource languages is scarce due to high construction costs. Translation is one of the typical methods for augmenting data for low-resource languages; however, translation entails ambiguity problems, where one word can be translated into multiple words due to polysemes and homonyms. Previous studies have suggested methods to measure the validity of translated multiple triples by using additional metadata and manually labeled data. However, such handcrafted datasets are not available for many low-resource languages. In this paper, we propose a knowledge augmentation method using adversarial networks that does not require any labeled data. Our adversarial networks can transfer knowledge learned from a resource-rich language to low-resource languages and thus measure the validity score of translated triples even without labeled data. We designed experiments to demonstrate that high-scoring triples obtained by the proposed model can be considered augmented knowledge. The experimental results show that our proposed method for a low-resource language, Korean, achieved 93.7% precision@1 on a manually labeled benchmark. Furthermore, to verify our model for other low-resource languages, we introduced new test sets for knowledge validation in 16 different languages. Our adversarial model obtains strong results for all language test sets. We will release the augmented Korean knowledge and test sets for 16 languages.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Related papers
- G-DAug: Generative Data Augmentation for Commonsense ReasoningYiben Yang, Chaitanya Malaviya, Jared Fernandez, Swabha Swayamdipta et al.EMNLP Findings 2020 · 110 citations
- The Box is in the Pen: Evaluating Commonsense Reasoning in Neural Machine TranslationJie He, Tao Wang, Deyi Xiong, Qun LiuEMNLP Findings 2020 · 12 citations
- Enhancing Multilingual Language Model with Massive Multilingual Knowledge TriplesLinlin Liu, Xin Li, Ruidan He, Lidong Bing et al.EMNLP 2022 · 15 citations
- Exploring the Effectiveness of Multi-Lingual Commonsense Knowledge-Aware Open-Domain Dialogue Response GenerationSixing Wu, Jiong Yu, Tianshi Che, Yang Zhou et al.EMNLP Findings 2023 · 2 citations
- Two Parents, One Child: Dual Transfer for Low-Resource Neural Machine TranslationMeng Zhang, Liangyou Li, Qun LiuACL Findings 2021 · 3 citations
