A general approach for predicting the behavior of the Supreme Court of the United States
Top Cited Papers
Open Access
- 12 April 2017
- journal article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 12 (4), e0174698
- https://doi.org/10.1371/journal.pone.0174698
Abstract
Building on developments in machine learning and prior work in the science of judicial prediction, we construct a model designed to predict the behavior of the Supreme Court of the United States in a generalized, out-of-sample context. To do so, we develop a time-evolving random forest classifier that leverages unique feature engineering to predict more than 240,000 justice votes and 28,000 cases outcomes over nearly two centuries (1816-2015). Using only data available prior to decision, our model outperforms null (baseline) models at both the justice and case level under both parametric and non-parametric tests. Over nearly two centuries, we achieve 70.2% accuracy at the case outcome level and 71.9% at the justice vote level. More recently, over the past century, we outperform an in-sample optimized null model by nearly 5%. Our performance is consistent with, and improves on the general level of prediction demonstrated by prior work; however, our model is distinctive because it can be applied out-of-sample to the entire past and future of the Court, not a single term. Our results represent an important advance for the science of quantitative legal prediction and portend a range of other potential applications.Keywords
This publication has 30 references indexed in Scilit:
- Standing the Test of Time: The Breadth of Majority Coalitions and the fate of U.S. Supreme Court PrecedentsJournal of Legal Analysis, 2012
- The Measure of a MAC: A Machine-Learning Protocol for Analyzing Force Majeure Clauses in M&A AgreementsJournal of Institutional and Theoretical Economics, 2012
- Justice Blocks and Predictability of U.S. Supreme Court VotesPLOS ONE, 2011
- Did a Switch in Time Save Nine?Journal of Legal Analysis, 2010
- Does Legal Doctrine Matter? Unpacking Law and Policy Preferences on the U.S. Supreme CourtAmerican Political Science Review, 2008
- Competing Approaches to Predicting Supreme Court Decision MakingPerspectives on Politics, 2004
- On-Line Learning in Neural NetworksJournal of the American Statistical Association, 2000
- Of Time and Consensual Norms in the Supreme CourtAmerican Journal of Political Science, 1998
- Separation-of-Powers Games in the Positive Theory of Congress and CourtsAmerican Political Science Review, 1997
- Ideological Values and the Votes of U.S. Supreme Court Justices RevisitedThe Journal of Politics, 1995