Lune

ACL Findings2024

A multi-level multi-label text classification dataset of 19th century Ottoman and Russian literary and critical texts

Gokcen Gokceoglu, Devrim Cavusoglu, Emre Akbas, Özen Nergis Dolcerocca

Abstract

This paper introduces a multi-level, multilabel text classification dataset comprising over 3000 documents. The dataset features literary and critical texts from 19th-century Ottoman Turkish and Russian. It is the first study to apply large language models (LLMs) to this dataset, sourced from prominent literary periodicals of the era. The texts have been meticulously organized and labeled. This was done according to a taxonomic framework that takes into account both their structural and semantic attributes. Articles are categorized and tagged with bibliometric metadata by human experts. We present baseline classification results using a classical bag-of-words (BoW) naive Bayes model and three modern LLMs: multilingual BERT, Falcon, and Llama-v2. We found that in certain cases, Bag of Words (BoW) outperforms Large Language Models (LLMs), emphasizing the need for additional research, especially in low-resource language settings. This dataset is expected to be a valuable resource for researchers in natural language processing and machine learning, especially for historical and low-resource languages. The dataset is publicly available 1 .

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on2

  1. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  2. LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations

Related papers

  1. “Vorbești Românește?” A Recipe to Train Powerful Romanian LLMs with English InstructionsMihai Masala, Denis C. Ilie-Ablachim, Alexandru Dima, Dragos-Georgian Corlatescu et al.EMNLP Findings 2024 · 13 citations
  2. Exploring Large Language Models for Detecting Mental DisordersGleb Kuzmin, Petr Strepetov, Maksim Stankevich, Natalya V. Chudova et al.EMNLP 2025
  3. AdabNER: Arabic Digital Archive Books with Nested Entity RecognitionAya Mourad, Mustafa JarrarACL 2026
  4. MalayMMLU: A Multitask Benchmark for the Low-Resource Malay LanguageSoon Chang Poh, Sze Jue Yang, Jeraelyn Ming Li Tan, Lawrence Chieng et al.EMNLP Findings 2024 · 5 citations
  5. Filling the Temporal Void: Recovering Missing Publication Years in the Project Gutenberg Corpus Using LLMsOmar Momen, Manuel Schaaf, Alexander MehlerACL Findings 2025
Dusk over the sea between two cliffs drawn in fine vertical lines