LawyerPAN: A Proficiency Assessment Network for Trial Lawyers
Yanqing An, Qi Liu, Han Wu, Kai Zhang, Linan Yue, Mingyue Cheng, Hongke Zhao, Enhong Chen
Abstract
Assessing the proficiency of trial lawyers in different legal fields is of significant importance since a qualified lawyer or lawyer team can strive for his clients' best rights while ensuring the fairness of litigations. However, proficiency assessment for lawyers is very challenging due to many technical and domain challenges, such as the lack of unified evaluation standards, and the complex interactions between lawyers and cases in real legal systems. To this end, we propose a novel proficiency assessment network for trial lawyers (LawyerPAN) to quantify lawyer proficiency through online litigation records. Specifically, we first leverage the theories in psychological measurement for mapping the proficiency of lawyers in each field into a unified real number space. Meanwhile, the characteristics of cases (i.e., case difficulty and discrimination) are well modeled to ensure fairness when assessing lawyers in different cases and fields. Then, we model the interactions between lawyers and cases from two perspectives: the anticipatory perspective aims to measure the personal proficiency of anticipated strategy, and the adversarial perspective seeks to depict the gap of lawyers' proficiency between both sides (i.e., plaintiffs and defendants). Finally, we conduct extensive experiments on real-world data, and the results show the effectiveness and interpretability of our approaches on assessing the proficiency of trial lawyers.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- NeurJudge: A Circumstance-aware Neural Framework for Legal Judgment Prediction cites Iteratively Questioning and Answering for Interpretable Legal Judgment Prediction
- DARE: Disentanglement-Augmented Rationale Extraction cites NeurJudge: A Circumstance-aware Neural Framework for Legal Judgment Prediction
- How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligence cites Iteratively Questioning and Answering for Interpretable Legal Judgment Prediction
Cited by top-tier papers1
Builds on4
- Neural Cognitive Diagnosis for Intelligent Education SystemsFei Wang, Qi Liu, Enhong Chen, Zhenya Huang et al.AAAI 2020 · 329 citations
- How Does NLP Benefit Legal System: A Summary of Legal Artificial IntelligenceHaoxi Zhong, Chaojun Xiao, Cunchao Tu, Tianyang Zhang et al.ACL 2020 · 316 citations
- Iteratively Questioning and Answering for Interpretable Legal Judgment PredictionHaoxi Zhong, Yuzhong Wang, Cunchao Tu, Tianyang Zhang et al.AAAI 2020 · 133 citations
- NeurJudge: A Circumstance-aware Neural Framework for Legal Judgment PredictionLinan Yue, Qi Liu, Binbin Jin, Han Wu et al.SIGIR 2021 · 83 citations
Related papers
- Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome ClassificationShanshan Xu, T. Y. S. S. Santosh, Oana Ichim, Barbara Plank et al.ACL 2024
- JurisBench: A Deep Benchmark for Assessing Large Language Models in Professional Legal PracticeZiang Chen, Guannan Li, Fanlin Ji, Yipeng Kang et al.ACL 2026
- PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal PracticeYuzhen Shi, Huanghai Liu, Yiran Hu, Gaojie Song et al.ACL 2026 · 7 citations
- Attorneys and AI: How Lawyers Use Artificial Intelligence and Analyze Its ImpactsEddie A. Gomez Schieber, Nathaniel Kite, Matthew I. Hall, Christian Turner et al.CSCW 2025 · 1 citation
- GreekBarBench: A Challenging Benchmark for Free-Text Legal Reasoning and CitationsOdysseas S. Chlapanis, Dimitris Galanis, Nikolaos Aletras, Ion AndroutsopoulosEMNLP Findings 2025 · 3 citations
