ACL Findings2022
LEVEN: A Large-Scale Chinese Legal Event Detection Dataset
Feng Yao, Chaojun Xiao, Xiaozhi Wang, Zhiyuan Liu, Lei Hou, Cunchao Tu, Juanzi Li, Yun Liu, Weixing Shen, Maosong Sun
Abstract
Recognizing facts is the most fundamental step in making judgments, hence detecting events in the legal documents is important to legal case analysis tasks. However, existing Legal Event Detection (LED) datasets only concern incomprehensive event types and have limited annotated data, which restricts the development of LED methods and their downstream applications. To alleviate these issues, we present LEVEN, a large-scale Chinese LEgal eVENt detection dataset, with 8, 116 legal documents and 150, 977 humanannotated event mentions in 108 event types. Not only charge-related events, LEVEN also covers general events, which are critical for legal case understanding but neglected in existing LED datasets. To our knowledge, LEVEN is the largest LED dataset and has dozens of times the data scale of others, which shall significantly promote the training and evaluation of LED methods. The results of extensive experiments indicate that LED is challenging and needs further effort. Moreover, we simply utilize legal events as side information to promote downstream applications. The method achieves improvements of average 2.2 points precision in low-resource judgment prediction, and 1.5 points mean average precision in unsupervised case retrieval, which suggests the fundamentality of LED. The source code and dataset can be obtained from https: //github.com/thunlp/LEVEN.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 12 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers12
- LawBench: Benchmarking Legal Knowledge of Large Language ModelsZhiwei Fei, Xiaoyu Shen, Dawei Zhu, Fengzhe Zhou et al.EMNLP 2024 · 59 citations
- SeqGPT: An Out-of-the-Box Large Language Model for Open Domain Sequence UnderstandingTianyu Yu, Chengyue Jiang, Chao Lou, Shen Huang et al.AAAI 2024 · 30 citations
- CaseLink: Inductive Graph Learning for Legal Case RetrievalYanran Tang, Ruihong Qiu, Hongzhi Yin, Xue Li et al.SIGIR 2024 · 10 citations
- Unsupervised Legal Evidence Retrieval via Contrastive Learning with Approximate Aggregated PositiveFeng Yao, Jingyuan Zhang, Yating Zhang, Xiaozhong Liu et al.AAAI 2023 · 9 citations
- PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal PracticeYuzhen Shi, Huanghai Liu, Yiran Hu, Gaojie Song et al.ACL 2026 · 7 citations
Builds on9
- How Does NLP Benefit Legal System: A Summary of Legal Artificial IntelligenceHaoxi Zhong, Chaojun Xiao, Cunchao Tu, Tianyang Zhang et al.ACL 2020 · 316 citations
- JEC-QA: A Legal-Domain Question Answering DatasetHaoxi Zhong, Chaojun Xiao, Cunchao Tu, Tianyang Zhang et al.AAAI 2020 · 212 citations
- MAVEN: A Massive General Domain Event Detection DatasetXiaozhi Wang, Ziqi Wang, Xu Han, Wangyi Jiang et al.EMNLP 2020 · 143 citations
- ContractNLI: A Dataset for Document-level Natural Language Inference for ContractsYuta Koreeda, Christopher D. ManningEMNLP Findings 2021 · 80 citations
- On the Ethical Limits of Natural Language Processing on Legal TextDimitrios Tsarapatsanis, Nikolaos AletrasACL Findings 2021 · 29 citations
Related papers
- LegalCore: A Dataset for Event Coreference Resolution in Legal DocumentsKangda Wei, Xi Shi, Jonathan Tong, Sai Ramana Reddy et al.ACL Findings 2025 · 1 citation
- Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate PairsCheng Gao, Chaojun Xiao, Zhenghao Liu, Huimin Chen et al.EMNLP 2024 · 1 citation
- Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title DatasetHaolin Deng, Yanan Zhang, Yangfan Zhang, Wangyang Ying et al.EMNLP 2022 · 8 citations
- DocEE-zh: A Fine-grained Benchmark for Chinese Document-level Event ExtractionMinghui Liu, Meihan Tong, Yangda Peng, Lei Hou et al.EMNLP Findings 2024 · 2 citations
- HacRED: A Large-Scale Relation Extraction Dataset Toward Hard Cases in Practical ApplicationsQiao Cheng, Juntao Liu, Xiaoye Qu, Jin Zhao et al.ACL Findings 2021 · 47 citations
