Lune

ACL2024Top-tier venue

Leveraging Large Language Models for Learning Complex Legal Concepts through Storytelling

Hang Jiang, Xiajie Zhang, Robert Mahari, Daniel T. Kessler, Eric Ma, Tal August, Irene Li, Alex Pentland, Yoon Kim, Deb K. Roy, Jad Kabbara

2024Year
12Citations
9Top-tier citations

Abstract

Making legal knowledge accessible to nonexperts is crucial for enhancing general legal literacy and encouraging civic participation in democracy. However, legal documents are often challenging to understand for people without legal backgrounds. In this paper, we present a novel application of large language models (LLMs) in legal education to help non-experts learn intricate legal concepts through storytelling, an effective pedagogical tool in conveying complex and abstract concepts. We also introduce a new dataset LEGALSTORIES, which consists of 294 complex legal doctrines, each accompanied by a story and a set of multiplechoice questions generated by LLMs. To construct the dataset, we experiment with various LLMs to generate legal stories explaining these concepts. Furthermore, we use an expert-in-theloop approach to iteratively design multiplechoice questions. Then, we evaluate the effectiveness of storytelling with LLMs through randomized controlled trials (RCTs) with legal novices on 10 samples from the dataset. We find that LLM-generated stories enhance comprehension of legal concepts and interest in law among non-native speakers compared to only definitions. Moreover, stories consistently help participants relate legal concepts to their lives. Finally, we find that learning with stories shows a higher retention rate for non-native speakers in the follow-up assessment. Our work has strong implications for using LLMs in promoting teaching and learning in the legal field and beyond.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext ac06362c-8caa-413b-a493-5d538487172c

Cited by top-tier papers9

Ask how each one uses it

Builds on8

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines