Automating Accountability Mechanisms in the Judiciary System using Large Language Models
Name
shastri-ishana-meng-eecs-2024-thesis.pdf
Description
Thesis PDF
Size
3.85 MB
Format
Adobe PDF
Checksum (MD5)
7fe333fa61e2efb06aa440a130bead65
Author(s)
Shastri, Ishana
Advisor(s)
Wilson, Ashia
Date Issued
May 2024
Publisher
Massachusetts Institute of Technology
Abstract
Holding the judicial system accountable often demands extensive effort from auditors who must meticulously sift through numerous disorganized legal case files to detect patterns of bias and systemic errors. For example, the high-profile investigation into the Curtis Flowers case took nine reporters a full year to assemble evidence about the prosecutor’s history of selecting racially-biased juries. Large Language Models (LLMs) have the potential to automate and scale these accountability pipelines, especially given their demonstrated capabilities in both structured and unstructured document retrieval tasks. We present the first work elaborating on the opportunities and challenges of using LLMs to provide accountability in two legal domains: bias in jury selection for criminal trials and housing eviction cases. We find that while LLMs are well-suited for information extraction from eviction forms that have more structure, court transcripts present a unique challenge due to disfluencies in transcribed speech.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright retained by author(s)
Persistent DSpace Link
