ACL Findings2025
Are Dialects Better Prompters? A Case Study on Arabic Subjective Text Classification
Leila Moudjari, Farah Benamara
摘要
This paper investigates the effect of dialectal prompting, variations in prompting script and model fine-tuning on subjective classification in Arabic dialects. To this end, we evaluate the performances of 12 widely used open source LLMs across four tasks and eight benchmark datasets. Our results reveal that specialized fine-tuned models with Arabic and Arabizi scripts dialectal prompts achieve the best results, which provides new findings on the finetuning of LLMs for low-resource languages.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper11
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 64,255 次引用
- QLoRA: Efficient Finetuning of Quantized LLMsTim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke ZettlemoyerNeurIPS 2023 · 5,863 次引用
- Text Classification via Large Language ModelsXiaofei Sun, Xiaoya Li, Jiwei Li, Fei Wu 等EMNLP Findings 2023 · 218 次引用
- MEGA: Multilingual Evaluation of Generative AIKabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng 等EMNLP 2023 · 91 次引用
- Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought PromptingHaoyang Huang, Tianyi Tang, Dongdong Zhang, Xin Zhao 等EMNLP Findings 2023 · 76 次引用
相关 Paper
- Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its DialectsGo Inoue, Salam Khalifa, Nizar HabashACL Findings 2022 · 23 次引用
- MELABenchv1: Benchmarking Large Language Models against Smaller Fine-Tuned Models for Low-Resource Maltese NLPKurt Micallef, Claudia BorgACL Findings 2025 · 2 次引用
- Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMsFakhraddin Alwajih, Abdellah El Mekki, Samar Mohamed Magdy, AbdelRahim A. Elmadany 等ACL 2025
- Comparing Prompt-Based and Standard Fine-Tuning for Urdu Text ClassificationFaizad Ullah, Ubaid Azam, Ali Faheem, Faisal Kamiran 等EMNLP Findings 2023 · 8 次引用
- A Rigorous Evaluation of LLM Data Generation Strategies for Low-Resource LanguagesTatiana Anikina, Ján Cegin, Jakub Simko, Simon OstermannEMNLP 2025
