LePREC: Reasoning as Classification over Structured Factors for Assessing Relevance of Legal Issues
Fanyu Wang, Xiaoxi Kang, Paul Burgess, Aashish Srivastava, Chetan Arora, Adnan Trakic, Lay-Ki Soon, Md Khalid Hossain, Lizhen Qu
摘要
More than half of the global population struggles to meet their civil justice needs due to limited legal resources. While Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, significant challenges remain even at the foundational step of legal issue identification. To investigate LLMs' capabilities in this task, we constructed a dataset from 769 real-world Malaysian Contract Act court cases, using GPT-4o to extract facts and generate candidate legal issues, annotated by senior legal experts, which reveals a critical limitation: while LLMs generate diverse issue candidates, their precision remains inadequate (GPT-4o achieves only 62%). To address this gap, we propose LEPREC (Legal Professional-inspired Reasoning Elicitation and Classification), a neuro-symbolic framework combining neural generation with structured statistical reasoning. LEPREC consists of: (1) a neural component leverages LLMs to transform legal descriptions into question-answer pairs representing diverse analytical factors, and (2) a symbolic component applies sparse linear models over these discrete features, learning explicit algebraic weights that identify the most informative reasoning factors. Unlike end-to-end neural approaches, LEPREC achieves interpretability through transparent feature weighting while maintaining data efficiency through correlationbased statistical classification. Experiments show a 30-40% improvement over advanced LLM baselines, including GPT-4o and Claude, confirming that correlation-based factor-issue analysis offers a more data-efficient solution for relevance decisions.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context LearningBill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, Nouha Dziri 等ICLR 2024 · 被引用 299 次
- Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language ModelsSeungone Kim, Juyoung Suk, Shayne Longpre, Bill Yuchen Lin 等EMNLP 2024 · 被引用 38 次
- Generative Verifiers: Reward Modeling as Next-Token PredictionLunjun Zhang, Arian Hosseini, Hritik Bansal, Mehran Kazemi 等ICLR 2025
- Focus On This, Not That! Steering LLMs with Adaptive Feature SpecificationTom A. Lamb, Adam Davies, Alasdair Paren, Philip Torr 等ICML 2025
相关 Paper
- LLM+AL: Bridging Large Language Models and Action Languages for Complex Reasoning About ActionsAdam Ishay, Joohyung LeeAAAI 2025 · 被引用 12 次
- Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model CollaborationYiquan Wu, Siying Zhou, Yifei Liu, Weiming Lu 等EMNLP 2023 · 被引用 37 次
- LexChain: Modeling Legal Reasoning Chains for Chinese Tort Case AnalysisHuiyuan Xie, Chenyang Li, Huining Zhu, Chubin Zhang 等AAAI 2026 · 被引用 2 次
- Large Language Models are Interpretable LearnersRuochen Wang, Si Si, Felix X. Yu, Dorothea Wiesmann Rothuizen 等ICLR 2025
- Can LLM Aid in Solving Constraints with Inductive Definitions?Weizhi Feng, Shidong Shen, Jiaxiang Liu, Taolue Chen 等FM 2026
