Lune

EMNLP Findings2025

Can Code-Switched Texts Activate a Knowledge Switch in LLMs? A Case Study on English-Korean Code-Switching

Seoyeon Kim, Huiseo Kim, Chanjun Park, Jinyoung Yeo, Dongha Lee

摘要

Recent large language models (LLMs) demonstrate multilingual abilities, yet they are English-centric due to dominance of English in training corpora. The limited resource for low-resource languages remains a crucial challenge. Code-switching (CS), a phenomenon where multilingual speakers alternate between languages in a discourse, can convey subtle cultural and linguistic nuances that can be otherwise lost in translation and elicits languagespecific knowledge in human communications. In light of this, we investigate whether codeswitching can activate, or identify and leverage knowledge for reasoning when LLMs solve low-resource language tasks. To facilitate the research, we first present ENKOQA, a synthetic English-Korean CS question-answering dataset. We provide comprehensive analysis on a variety of multilingual LLMs by subdividing activation process into knowledge identification and knowledge leveraging. Our results demonstrate that compared to English text, CS can faithfully activate knowledge inside LLMs especially on language-specific domains, suggesting the potential of code-switching on low-resource language tasks.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 引用它的 2 篇顶会 Paper · 相关的 Paper

获取答案

免费开始,无需绑卡

引用它的顶会 Paper2

  1. OLA: Output Language Alignment in Code-Switched LLM InteractionsJuhyun Oh, Haneul Yoo, Faiz Ghifari Haznitrama, Alice OhACL 2026 · 1 次引用
  2. KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual ContextsTaebaek Hwang, Minseo Kim, Gisang Lee, Seonuk Kim 等EMNLP 2025

它引用的 Paper13

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma 等NeurIPS 2022 · 22,562 次引用
  2. tinyBenchmarks: evaluating LLMs with fewer examplesFelipe Maia Polo, Lucas Weber, Leshem Choshen, Yuekai Sun 等ICML 2024 · 212 次引用
  3. Synthetic Data Generation with Large Language Models for Text Classification: Potential and LimitationsZhuoyan Li, Hangxiao Zhu, Zhuoran Lu, Ming YinEMNLP 2023 · 102 次引用
  4. The State and Fate of Linguistic Diversity and Inclusion in the NLP WorldPratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali 等ACL 2020 · 40 次引用
  5. Multilingual Large Language Models Are Not (Yet) Code-SwitchersRuochen Zhang, Samuel Cahyawijaya, Jan Christian Blaise Cruz, Genta Indra Winata 等EMNLP 2023 · 19 次引用

相关 Paper

  1. Investigating and Scaling up Code-Switching for Multilingual Language Model Pre-TrainingZhijun Wang, Jiahuan Li, Hao Zhou, Rongxiang Weng 等ACL Findings 2025 · 3 次引用
  2. Code-Switching Curriculum Learning for Multilingual Transfer in LLMsHaneul Yoo, Cheonbok Park, Sangdoo Yun, Alice Oh 等ACL Findings 2025 · 4 次引用
  3. Progressive Sentiment Analysis for Code-Switched Text DataSudhanshu Ranjan, Dheeraj Mekala, Jingbo ShangEMNLP Findings 2022 · 2 次引用
  4. EMCEE: Improving Multilingual Capability of LLMs via Bridging Knowledge and Reasoning with Extracted Synthetic Multilingual ContextHamin Koo, Jaehyung KimACL 2026
  5. Switch Point biased Self-Training: Re-purposing Pretrained Models for Code-SwitchingParul Chopra, Sai Krishna Rallabandi, Alan W. Black, Khyathi Raghavi ChanduEMNLP Findings 2021 · 2 次引用
黄昏的海面,两侧是细线勾勒的悬崖