Lune

ACL Findings2024

CIDAR: Culturally Relevant Instruction Dataset For Arabic

Zaid Alyafeai, Khalid Almubarak, Ahmed Ashraf, Deema Alnuhait, Saied Alshahrani, Gubran A. Q. Abdulrahman, Gamil Ahmed, Qais Gawah, Zead Saleh, Mustafa Ghaleb, Yousef Ali, Maged Saeed AlShaibani

Abstract

Instruction tuning has emerged as a prominent methodology for teaching Large Language Models (LLMs) to follow instructions. However, current instruction datasets predominantly cater to English or are derived from Englishdominated LLMs, leading to inherent biases toward Western culture. This bias negatively impacts non-English languages such as Arabic and the unique culture of the Arab region. This paper addresses this limitation by introducing CIDAR, the first open Arabic instruction-tuning dataset culturally aligned by native Arabic speakers. CIDAR contains 10,000 instruction and output pairs that represent the Arab region. We discuss the cultural relevance of CIDAR via the analysis and comparison to a few models fine-tuned on other datasets. Our experiments indicate that models fine-tuned on CIDAR achieve better cultural alignment compared to those fine-tuned on 30x more data. The dataset is available on HuggingFace https://huggingface.co/datasets/arbml/CIDAR.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

3 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Multitask Prompted Training Enables Zero-Shot Task Generalization cites Finetuned Language Models are Zero-Shot Learners
  • Finetuned Language Models are Zero-Shot Learners cites Multitask Prompted Training Enables Zero-Shot Task Generalization
  • QLoRA: Efficient Finetuning of Quantized LLMs cites Multitask Prompted Training Enables Zero-Shot Task Generalization
  • QLoRA: Efficient Finetuning of Quantized LLMs cites Finetuned Language Models are Zero-Shot Learners
  • QLoRA: Efficient Finetuning of Quantized LLMs cites Training language models to follow instructions with human feedback
  • TruthfulQA: Measuring How Models Mimic Human Falsehoods cites Training language models to follow instructions with human feedback
  • Training language models to follow instructions with human feedback cites TruthfulQA: Measuring How Models Mimic Human Falsehoods
  • CARE: Multilingual Human Preference Learning for Cultural Awareness cites TruthfulQA: Measuring How Models Mimic Human Falsehoods
  • CARE: Multilingual Human Preference Learning for Cultural Awareness cites Training language models to follow instructions with human feedback
  • Finetuned Language Models are Zero-Shot Learners cites Training language models to follow instructions with human feedback
  • Training language models to follow instructions with human feedback cites Finetuned Language Models are Zero-Shot Learners
  • Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakh cites Training language models to follow instructions with human feedback
  • Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMs cites Training language models to follow instructions with human feedback
  • Training language models to follow instructions with human feedback cites Multitask Prompted Training Enables Zero-Shot Task Generalization
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers3

  1. CARE: Multilingual Human Preference Learning for Cultural AwarenessGeyang Guo, Tarek Naous, Hiromi Wakaki, Yukiko Nishimura et al.EMNLP 2025
  2. Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in KazakhNurkhan Laiyk, Daniil Orel, Rituraj Joshi, Maiya Goloburda et al.ACL 2025
  3. Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMsFakhraddin Alwajih, Abdellah El Mekki, Samar Mohamed Magdy, AbdelRahim A. Elmadany et al.ACL 2025

Builds on17

  1. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  2. QLoRA: Efficient Finetuning of Quantized LLMsTim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke ZettlemoyerNeurIPS 2023 · 5,863 citations
  3. Finetuned Language Models are Zero-Shot LearnersJason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu et al.ICLR 2022 · 4,966 citations
  4. TruthfulQA: Measuring How Models Mimic Human FalsehoodsStephanie Lin, Jacob Hilton, Owain EvansACL 2022 · 3,228 citations
  5. Multitask Prompted Training Enables Zero-Shot Task GeneralizationVictor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach et al.ICLR 2022 · 1,976 citations

Related papers

  1. Having Beer after Prayer? Measuring Cultural Bias in Large Language ModelsTarek Naous, Michael J. Ryan, Alan Ritter, Wei XuACL 2024
  2. LongForm: Effective Instruction Tuning with Reverse InstructionsAbdullatif Köksal, Timo Schick, Anna Korhonen, Hinrich SchützeEMNLP Findings 2024 · 17 citations
  3. Pearl: A Multimodal Culturally-Aware Arabic Instruction DatasetFakhraddin Alwajih, Samar Mohamed Magdy, Abdellah El Mekki, Omer Nacar et al.EMNLP Findings 2025 · 4 citations
  4. Cross-Cultural Transfer of Commonsense Reasoning in LLMs: Evidence from the Arab WorldSaeed Almheiri, Rania Elbadry, Mena Attia, Chenxi Wang et al.EMNLP Findings 2025 · 1 citation
  5. Multilingual Instruction Tuning With Just a Pinch of MultilingualityUri Shaham, Jonathan Herzig, Roee Aharoni, Idan Szpektor et al.ACL Findings 2024 · 10 citations
Dusk over the sea between two cliffs drawn in fine vertical lines