Lune

ACL Findings2025

Filling the Temporal Void: Recovering Missing Publication Years in the Project Gutenberg Corpus Using LLMs

Omar Momen, Manuel Schaaf, Alexander Mehler

Abstract

Analyzing texts spanning long periods of time is critical for researchers in historical linguistics and related disciplines. However, publicly available corpora suitable for such analyses are scarce. The Project Gutenberg (PG) corpus presents a significant yet underutilized opportunity in this context, due to the absence of accurate temporal metadata. We take advantage of language models and information retrieval to explore four sources of information -Open Web, Wikipedia, Open Library API, and PG books texts -to add missing temporal metadata to the PG corpus. Through 20 experiments employing state-of-the-art Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) methods, we estimate the production years of all PG books. We curate an enriched metadata repository for the PG corpus and propose a refined version for it, which includes 53 774 books with a total of 3.8 billion tokens in 11 languages, produced between 1600 and 2000. This work provides a new resource for computational linguistics and humanities studies focusing on diachronic analyses. The final dataset and all experiments data are publicly available 1 .

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on4

  1. Analysing Lexical Semantic Change with Contextualised Word RepresentationsMario Giulianelli, Marco Del Tredici, Raquel FernándezACL 2020 · 118 citations
  2. WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on WikipediaSina J. Semnani, Violet Z. Yao, Heidi C. Zhang, Monica S. LamEMNLP Findings 2023 · 44 citations
  3. TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language ModelsZheng Chu, Jingchang Chen, Qianglong Chen, Weijiang Yu et al.ACL 2024 · 12 citations
  4. Time-Aware Language Modeling for Historical Text DatingHan Ren, Hai Wang, Yajie Zhao, Yafeng RenEMNLP Findings 2023 · 4 citations

Related papers

  1. Remember This Event That Year? Assessing Temporal Information and Understanding in Large Language ModelsHimanshu Beniwal, Dishant Patel, Kowsik Nandagopan D, Hritik Ladia et al.EMNLP Findings 2024 · 2 citations
  2. Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining ResearchLuca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk et al.ACL 2024
  3. Deciphering the Impact of Pretraining Data on Large Language Models through Machine UnlearningYang Zhao, Li Du, Xiao Ding, Kai Xiong et al.ACL Findings 2024 · 5 citations
  4. A multi-level multi-label text classification dataset of 19th century Ottoman and Russian literary and critical textsGokcen Gokceoglu, Devrim Cavusoglu, Emre Akbas, Özen Nergis DolceroccaACL Findings 2024 · 1 citation
  5. Common Corpus: The Largest Collection of Ethical Data for LLM Pre-TrainingPierre-Carl Langlais, Pavel Chizhov, Catherine Arnett, Carlos Rosas Hinostroza et al.ICLR 2026 · 22 citations
Dusk over the sea between two cliffs drawn in fine vertical lines