vix.ing · top · new · best · stats · spec

A Black Swan Hypothesis: The Role of Human Irrationality in AI Safety

2024/07/25 by Hyunin Lee, Lee, Hyunin, David Abel +4 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multi-Agent Systems and Negotiation

paper · pdf · doi:10.48550/arxiv.2407.18422

openalex publication_date 2024/07/25 · openalex created_date 2024/09/30 · openalex updated_date 2026/07/28

Abstract

Black swan events are statistically rare occurrences that carry extremely high risks. A typical view of defining black swan events is heavily assumed to originate from an unpredictable time-varying environments; however, the community lacks a comprehensive definition of black swan events. To this end, this paper challenges that the standard view is incomplete and claims that high-risk, statistically rare events can also occur in unchanging environments due to human misperception of their value and likelihood, which we call as spatial black swan event. We first carefully categorize black swan events, focusing on spatial black swan events, and mathematically formalize the definition of black swan events. We hope these definitions can pave the way for the development of algorithms to prevent such events by rationally correcting human perception.

Cited by

Related