EMNLP Findings2024
Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling
Daehoon Gwak, Junwoo Park, Minho Park, ChaeHun Park, Hyunchan Lee, Edward Choi, Jaegul Choo
Abstract
Predicting future international events from textual information, such as news articles, has tremendous potential for applications in global policy, strategic decision-making, and geopolitics. However, existing datasets available for this task are often limited in quality, hindering the progress of related research. In this paper, we introduce WORL-DREP (WORLD Relationship and Event Prediction), a novel dataset designed to address these limitations by leveraging the advanced reasoning capabilities of largelanguage models (LLMs). Our dataset features high-quality scoring labels generated through advanced prompt modeling and rigorously validated by domain experts in political science. We showcase the quality and utility of WORLDREP for real-world event prediction tasks, demonstrating its effectiveness through extensive experiments and analysis. Furthermore, we publicly release our dataset along with the full automation source code for data collection, labeling, and benchmarking, aiming to support and advance research in text-based event prediction. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Want To Reduce Labeling Cost? GPT-3 Can Help cites GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
- Want To Reduce Labeling Cost? GPT-3 Can Help cites Language Models are Few-Shot Learners
- GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation cites Language Models are Few-Shot Learners
Cited by top-tier papers1
Builds on15
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous VariablesYuxuan Wang, Haixu Wu, Jiaxiang Dong, Guo Qin et al.NeurIPS 2024 · 536 citations
- Want To Reduce Labeling Cost? GPT-3 Can HelpShuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu et al.EMNLP Findings 2021 · 177 citations
- GPT3Mix: Leveraging Large-scale Language Models for Text AugmentationKang Min Yoo, Dongju Park, Jaewook Kang, Sang-Woo Lee et al.EMNLP Findings 2021 · 151 citations
Related papers
- HQP: A Human-Annotated Dataset for Detecting Online PropagandaAbdurahman Maarouf, Dominik Bär, Dominique Geissler, Stefan FeuerriegelACL Findings 2024 · 7 citations
- Thinking Bidirectionally: A Reasoning and Self-Correction Approach for Text-Based Event Prediction with Large Language ModelsLiwei Qian, Hang Zhang, Yiheng Wu, Yanmin Li et al.WWW 2026
- ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text DataWoojeong Jin, Rahul Khanna, Suji Kim, Dong-Ho Lee et al.ACL 2021
- Back to the Future: Towards Explainable Temporal Reasoning with Large Language ModelsChenhan Yuan, Qianqian Xie, Jimin Huang, Sophia AnaniadouWWW 2024
- MIND: A Large-scale Dataset for News RecommendationFangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu et al.ACL 2020 · 454 citations
