Lune

ACL Findings2024

Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courts

Shubham Kumar Nigam, Anurag Sharma, Danush Khanna, Noel Shallum, Kripabandhu Ghosh, Arnab Bhattacharya

Abstract

In the era of Large Language Models (LLMs), predicting judicial outcomes poses significant challenges due to the complexity of legal proceedings and the scarcity of expertannotated datasets. Addressing this, we introduce Prediction with Explanation (PredEx), the largest expert-annotated dataset for legal judgment prediction and explanation in the Indian context, featuring over 15,000 annotations. This groundbreaking corpus significantly enhances the training and evaluation of AI models in legal analysis, with innovations including the application of instruction tuning to LLMs. This method has markedly improved the predictive accuracy and explanatory depth of these models for legal judgments. We employed various transformer-based models, tailored for both general and Indian legal contexts. Through rigorous lexical, semantic, and expert assessments, our models effectively leverage PredEx to provide precise predictions and meaningful explanations, establishing it as a valuable benchmark for both the legal profession and the NLP community.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on6

  1. BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
  2. Distinguish Confusing Law Articles for Legal Judgment PredictionNuo Xu, Pinghui Wang, Long Chen, Li Pan et al.ACL 2020 · 150 citations
  3. Iteratively Questioning and Answering for Interpretable Legal Judgment PredictionHaoxi Zhong, Yuzhong Wang, Cunchao Tu, Tianyang Zhang et al.AAAI 2020 · 133 citations
  4. HLDC: Hindi Legal Documents CorpusArnav Kapoor, Mudit Dhawan, Anmol Goel, T. H. Arjun et al.ACL Findings 2022 · 30 citations
  5. LLMs - the Good, the Bad or the Indispensable?: A Use Case on Legal Statute Prediction and Legal Judgment Prediction on Indian Court CasesShaurya Vats, Atharva Zope, Somsubhra De, Anurag Sharma et al.EMNLP Findings 2023 · 20 citations

Related papers

  1. ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and ExplanationVijit Malik, Rishabh Sanjay, Shubham Kumar Nigam, Kripabandhu Ghosh et al.ACL 2021
  2. Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model CollaborationYiquan Wu, Siying Zhou, Yifei Liu, Weiming Lu et al.EMNLP 2023 · 37 citations
  3. ProJudge: A Multi-Modal Multi-Discipline Benchmark and Instruction-Tuning Dataset for Mllm-Based Process JudgesJiaxin Ai, Pengfei Zhou, Zhaopan Xu, Ming Li et al.ICCV 2025 · 9 citations
  4. Information Extraction from Legal Wills: How Well Does GPT-4 Do?Alice Saebom Kwak, Cheonkam Jeong, Gaetano Forte, Derek E. Bambauer et al.EMNLP Findings 2023 · 11 citations
  5. KoBLEX: Open Legal Question Answering with Multi-hop ReasoningJihyung Lee, Daehui Kim, Seonjeong Hwang, Hyounghun Kim et al.EMNLP 2025
Dusk over the sea between two cliffs drawn in fine vertical lines