ACL Findings2025
Are Dialects Better Prompters? A Case Study on Arabic Subjective Text Classification
Leila Moudjari, Farah Benamara
Abstract
This paper investigates the effect of dialectal prompting, variations in prompting script and model fine-tuning on subjective classification in Arabic dialects. To this end, we evaluate the performances of 12 widely used open source LLMs across four tasks and eight benchmark datasets. Our results reveal that specialized fine-tuned models with Arabic and Arabizi scripts dialectal prompts achieve the best results, which provides new findings on the finetuning of LLMs for low-resource languages.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on11
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- QLoRA: Efficient Finetuning of Quantized LLMsTim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke ZettlemoyerNeurIPS 2023 · 5,863 citations
- Text Classification via Large Language ModelsXiaofei Sun, Xiaoya Li, Jiwei Li, Fei Wu et al.EMNLP Findings 2023 · 218 citations
- MEGA: Multilingual Evaluation of Generative AIKabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng et al.EMNLP 2023 · 91 citations
- Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought PromptingHaoyang Huang, Tianyi Tang, Dongdong Zhang, Xin Zhao et al.EMNLP Findings 2023 · 76 citations
Related papers
- Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its DialectsGo Inoue, Salam Khalifa, Nizar HabashACL Findings 2022 · 23 citations
- MELABenchv1: Benchmarking Large Language Models against Smaller Fine-Tuned Models for Low-Resource Maltese NLPKurt Micallef, Claudia BorgACL Findings 2025 · 2 citations
- Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMsFakhraddin Alwajih, Abdellah El Mekki, Samar Mohamed Magdy, AbdelRahim A. Elmadany et al.ACL 2025
- Comparing Prompt-Based and Standard Fine-Tuning for Urdu Text ClassificationFaizad Ullah, Ubaid Azam, Ali Faheem, Faisal Kamiran et al.EMNLP Findings 2023 · 8 citations
- A Rigorous Evaluation of LLM Data Generation Strategies for Low-Resource LanguagesTatiana Anikina, Ján Cegin, Jakub Simko, Simon OstermannEMNLP 2025
