EMNLP Findings2020
FQuAD: French Question Answering Dataset
Martin d'Hoffschmidt, Wacim Belblidia, Quentin Heinrich, Tom Brendlé, Maxime Vidal
Abstract
Recent advances in the field of language modeling have improved state-of-the-art results on many Natural Language Processing tasks. Among them, Reading Comprehension has made significant progress over the past few years. However, most results are reported in English since labeled resources available in other languages, such as French, remain scarce. In the present work, we introduce the French Question Answering Dataset (FQuAD). FQuAD is a French Native Reading Comprehension dataset of questions and answers on a set of Wikipedia articles that consists of 25,000+ samples for the 1.0 version and 60,000+ samples for the 1.1 version. We train a baseline model which achieves an F1 score of 92.2 and an exact match ratio of 82.1 on the test set. In an effort to track the progress of French Question Answering models we propose a leaderboard and we have made the 1.0 version of our dataset freely available at https://illuin-tech. github.io/FQuAD-explorer/.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 9 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers9
- The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language VariantsLucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe et al.ACL 2024 · 30 citations
- Generative Language Models for Paragraph-Level Question GenerationAsahi Ushio, Fernando Alva-Manchego, José Camacho-ColladosEMNLP 2022 · 30 citations
- English Machine Reading Comprehension Datasets: A SurveyDaria Dzendzik, Jennifer Foster, Carl VogelEMNLP 2021 · 8 citations
- EXAMS: A Multi-subject High School Examinations Dataset for Cross-lingual and Multilingual Question AnsweringMomchil Hardalov, Todor Mihaylov, Dimitrina Zlatkova, Yoan Dinkov et al.EMNLP 2020 · 7 citations
- Question-Answering in a Low-resourced Language: Benchmark Dataset and Models for TigrinyaFitsum Gaim, Wonsuk Yang, Hancheol Park, Jong ParkACL 2023 · 6 citations
Builds on2
Related papers
- A Statutory Article Retrieval Dataset in FrenchAntoine Louis, Gerasimos SpanakisACL 2022 · 59 citations
- BanglaRQA: A Benchmark Dataset for Under-resourced Bangla Language Reading Comprehension-based Question Answering with Diverse Question-Answer TypesSyed Mohammed Sartaj Ekram, Adham Arik Rahman, Md. Sajid Altaf, Mohammed Saidul Islam et al.EMNLP Findings 2022 · 11 citations
- CamemBERT: a Tasty French Language ModelLouis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont et al.ACL 2020 · 703 citations
- An Open Multilingual System for Scoring Readability of WikipediaMykola Trokhymovych, Indira Sen, Martin GerlachACL 2024
- VisualMRC: Machine Reading Comprehension on Document ImagesRyota Tanaka, Kyosuke Nishida, Sen YoshidaAAAI 2021 · 201 citations
