Fair prediction with disparate impact: A study of bias in recidivism\n prediction instruments
2016/10/24 by Alexandra Chouldechova, Chouldechova, Alexandra · 45 citations
Business, Management and Accounting · Environmental Science · #Regulation and Compliance Studies #Wildlife Conservation and Criminology Analyses
paper · pdf · doi:10.48550/arxiv.1610.07524
Abstract
Recidivism prediction instruments provide decision makers with an assessment\nof the likelihood that a criminal defendant will reoffend at a future point in\ntime. While such instruments are gaining increasing popularity across the\ncountry, their use is attracting tremendous controversy. Much of the\ncontroversy concerns potential discriminatory bias in the risk assessments that\nare produced. This paper discusses a fairness criterion originating in the\nfield of educational and psychological testing that has recently been applied\nto assess the fairness of recidivism prediction instruments. We demonstrate how\nadherence to the criterion may lead to considerable disparate impact when\nrecidivism prevalence differs across groups.\n
Cited by
- The Fair Lending Model: How the Longest-Running Algorithmic Fairness Programs Work in Practice
- Auditing Significance, Metric Choice, and Demographic Fairness in Medical AI Challenges
- Emergent Bias and Fairness in Multi-Agent Decision Systems
- A Gray Literature Study on Fairness Requirements in AI-enabled Software Engineering
- On the Unreasonable Effectiveness of Last-layer Retraining
- Optimal Fairness under Local Differential Privacy
- The Probabilistic Foundations of Surveillance Failure: From False Alerts to Structural Bias
- Achieving Fairness Without Harm via Selective Demographic Experts
- Why Public Service AI Governance Frameworks Risk Failing in the Age of General-Purpose AI: Lessons from Policing
- The Human Utility Factor: A Computable Welfare Metric That Reframes AI Governance as a Constrained Optimisation Problem
- A study of fairness issues in predictive algorithms- example of bias in crime prediction software
- Robustness and trustworthiness in AI: a no-go result from formal epistemology
- Discrimination, intelligence artificielle et decisions algorithmiques
- Reflections from Research Roundtables at the Conference on Health, Inference, and Learning (CHIL) 2025
- Machine Learning and Public Health: Identifying and Mitigating Algorithmic Bias through a Systematic Review
- Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challenge
- Discrimination, artificial intelligence, and algorithmic decision-making
- FairContrast: Enhancing Fairness through Contrastive learning and Customized Augmenting Methods on Tabular Data
- Counterfactually Fair Conformal Prediction
- Estimating Fair Graphs from Graph-Stationary Data
- Partial Identification Approach to Counterfactual Fairness Assessment
- Fair Classification by Direct Intervention on Operating Characteristics
- OT-FairBoost: Optimal Transport-Guided Gradient Boosting for Fairness Regularization on Tabular Data
- A Multi-Objective Evaluation Framework for Analyzing Utility-Fairness Trade-Offs in Machine Learning Systems
- Breaking the Cycle of Incarceration With Targeted Mental Health Outreach: A Case Study in Machine Learning for Public Policy
- Sy-FAR: Symmetry-based Fair Adversarial Robustness
- An Information-Theoretic Framework for Credit Risk Modeling: Unifying Industry Practice with Statistical Theory for Fair and Interpretable Scorecards
- Audits Under Resource, Data, and Access Constraints: Scaling Laws For Less Discriminatory Alternatives
- Sequential Cohort Selection
- Applications and Challenges of Fairness APIs in Machine Learning Software
- Kernel-based Equalized Odds: A Quantification of Accuracy-Fairness Trade-off in Fair Representation Learning
- Bridging Research Gaps Between Academic Research and Legal Investigations of Algorithmic Discrimination
- Addressing Bias in VLMs for Glaucoma Detection Without Protected Attribute Supervision
- Algorithmic Fairness amid Social Determinants: Reflection, Characterization, and Approach
- The Fair Game: Auditing & Debiasing AI Algorithms Over Time
- I Think, Therefore I Am Under-Qualified? A Benchmark for Evaluating Linguistic Shibboleth Detection in LLM Hiring Evaluations
- Co-Producing AI: Toward an Augmented, Participatory Lifecycle
- Guiding LLM Decision-Making with Fairness Reward Models
- Fair CCA for Fair Representation Learning: An ADNI Study
- Secondary Bounded Rationality: A Theory of How Algorithms Reproduce Structural Inequality in AI Hiring
- Fair-FLIP: Fair Deepfake Detection with Fairness-Oriented Final Layer Input Prioritising
- Toward Valid Measurement Of (Un)fairness For Generative AI: A Proposal For Systematization Through The Lens Of Fair Equality of Chances
- Monitoring of Static Fairness
- Classifying Hate: Legal and Ethical Evaluations of ML-Assisted Hate Crime Classification and Estimation in Sweden
- Critical Appraisal of Fairness Metrics in Clinical Predictive AI
Related