Challenging the appearance of machine intelligence: Cognitive bias in LLMs and Best Practices for Adoption

2023/04/03 by Alaina N. Talboy, Talboy, Alaina N., Elizabeth Fuller +1 · 1 citation
Computer Science · Social Sciences · #Ethics and Social Impacts of AI #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC)

paper · pdf · doi:10.48550/arxiv.2304.01358

openalex publication_date 2023/04/03 · openalex created_date 2023/04/07 · openalex updated_date 2026/07/28

Abstract

Assessments of algorithmic bias in large language models (LLMs) are generally catered to uncovering systemic discrimination based on protected characteristics such as sex and ethnicity. However, there are over 180 documented cognitive biases that pervade human reasoning and decision making that are routinely ignored when discussing the ethical complexities of AI. We demonstrate the presence of these cognitive biases in LLMs and discuss the implications of using biased reasoning under the guise of expertise. We call for stronger education, risk management, and continued research as widespread adoption of this technology increases. Finally, we close with a set of best practices for when and how to employ this technology as widespread adoption continues to grow.

Cited by

• Quantifying uncert-AI-nty: Testing the accuracy of LLMs’ confidence judgments

Related

• Language Models Embody and Amplify Human Cognitive Distortions: What Is to Be Done?
• Heuristics and Biases in AI Decision-Making: Implications for Responsible AGI
• Cognitive Bias in Decision-Making with LLMs
• Fine-Grained Bias Detection in LLM: Enhancing detection mechanisms for nuanced biases
• Bias is a Math Problem, AI Bias is a Technical Problem: 10-year Literature Review of AI/LLM Bias Research Reveals Narrow [Gender-Centric] Conceptions of 'Bias', and Academia-Industry Gap