ACL Findings2025
LLMTaxo: Leveraging Large Language Models for Constructing Taxonomy of Factual Claims from Social Media
Haiqi Zhang, Zhengyuan Zhu, Zeyu Zhang, Chengkai Li
Abstract
With the rapid expansion of content on social media platforms, analyzing and comprehending online discourse has become increasingly complex. This paper introduces LLMTaxo, a novel framework leveraging large language models for the automated construction of taxonomies of factual claims from social media by generating topics at multiple levels of granularity. The resulting hierarchical structure significantly reduces redundancy and improves information accessibility. We also propose dedicated taxonomy evaluation metrics to enable comprehensive assessment. Evaluations conducted on three diverse datasets demonstrate LLMTaxo's effectiveness in producing clear, coherent, and comprehensive taxonomies. Among the evaluated models, GPT-4o mini consistently outperforms others across most metrics. The framework's flexibility and low reliance on manual intervention underscore its potential for broad applicability.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on5
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Chatbot Arena: An Open Platform for Evaluating LLMs by Human PreferenceWei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos et al.ICML 2024 · 1,212 citations
- CoRel: Seed-Guided Topical Taxonomy Construction by Concept Learning and Relation TransferringJiaxin Huang, Yiqing Xie, Yu Meng, Yunyi Zhang et al.KDD 2020 · 27 citations
- Zero-Shot Multi-Label Topic Inference with Sentence Encoders and LLMsSouvika Sarkar, Dongji Feng, Shubhra Kanti Karmaker SantuEMNLP 2023 · 5 citations
- AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM AnnotatorsJingwei Ni, Minjing Shi, Dominik Stammbach, Mrinmaya Sachan et al.ACL 2024
Related papers
- End-to-End Ontology Learning with Large Language ModelsAndy Lo, Albert Q. Jiang, Wenda Li, Mateja JamnikNeurIPS 2024 · 33 citations
- Context-Aware Hierarchical Taxonomy Generation for Scientific Papers via LLM-Guided Multi-Aspect ClusteringKun Zhu, Lizi Liao, Yuxuan Gu, Lei Huang et al.EMNLP 2025 · 8 citations
- Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkersYuxia Wang, Revanth Gangi Reddy, Zain Muhammad Mujahid, Arnav Arora et al.EMNLP Findings 2024 · 25 citations
- TaxoAdapt: Aligning LLM-Based Multidimensional Taxonomy Construction to Evolving Research CorporaPriyanka Kargupta, Nan Zhang, Yunyi Zhang, Rui Zhang et al.ACL 2025
- Probing LLMs for Multilingual Discourse Generalization Through a Unified Label SetFlorian Eichin, Yang Janet Liu, Barbara Plank, Michael A. HedderichACL 2025
