ALIGN: Word Association Learning for Cultural Alignment in Large Language Models
Chunhua Liu, Kabir Manandhar Shrestha, Sukai Huang
Abstract
Large language models (LLMs) exhibit cultural bias from over-represented viewpoints in training data, yet cultural alignment remains a challenge due to limited cultural knowledge and a lack of exploration into effective learning approaches. We introduce a cost-efficient and cognitively grounded method: fine-tuning LLMs on native speakers' word-association norms, leveraging cognitive psychology findings that such associations capture cultural knowledge. Using word association datasets from native speakers in the US (English) and China (Mandarin), we train Llama-3.1-8B and Qwen-2.5-7B via supervised fine-tuning and preference optimization. We evaluate models' cultural alignment through a two-tier evaluation framework that spans lexical associations and cultural value alignment using the World Values Survey. Results show significant improvements in lexical alignment (16-20% English, 43-165% Mandarin on Precision@5) and highlevel cultural value shifts. On a subset of 50 questions where US and Chinese respondents diverge most, fine-tuned Qwen nearly doubles its response alignment with Chinese values (13 → 25). Remarkably, our trained 7-8B models match or exceed vanilla 70B baselines, demonstrating that a few million of culture-grounded associations achieve value alignment without expensive retraining. Our work highlights both the promise and the need for future research grounded in human cognition in improving cultural alignment in AI models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 836ba757-637b-47d0-aa78-71b7922e37c8Builds on14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- QLoRA: Efficient Finetuning of Quantized LLMsTim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke ZettlemoyerNeurIPS 2023 · 5,863 citations
- LLMCarbon: Modeling the End-to-End Carbon Footprint of Large Language ModelsAhmad Faiz, Sotaro Kaneda, Ruhan Wang, Rita Chukwunyere Osi et al.ICLR 2024 · 129 citations
Related papers
- Can Persona-Prompted LLMs Emulate Subgroup Values? An Empirical Analysis of Generalisability and Fairness in Cultural AlignmentBryan Chen Zhengyu Tan, Zhengyuan Liu, Xiaoyuan Yi, Jing Yao et al.ACL 2026
- From Surveys to Narratives: Rethinking Cultural Value Adaptation in LLMsMuhammad Farid Adilazuarda, Chen Cecilia Liu, Iryna Gurevych, Alham Fikri AjiEMNLP 2025
- From Word to World: Evaluate and Mitigate Culture Bias in LLMs via Word Association TestXunlian Dai, Li Zhou, Benyou Wang, Haizhou LiEMNLP 2025 · 1 citation
- Cultural Learning-Based Culture Adaptation of Language ModelsChen Cecilia Liu, Anna Korhonen, Iryna GurevychACL 2025 · 14 citations
- A Game-Theoretica Negotiation Framework for Cross-Cultural ConsensusGuoxi Zhang, Jiawei Chen, Tianzhuo Yang, Jiaming Ji et al.ACL 2026
