2020/05/12 by Jae‐Yeon Kim, Jae Yeon Kim, Carlos Ortiz +8 · 1 voice · 2 citations
Computer Science · Psychology · Social Sciences · #Bullying, Victimization, and Aggression #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Social Media and Politics #Social and Information Networks (cs.SI) #cs.CL #cs.SI
paper · pdf · doi:10.48550/arxiv.2005.05921
openalex publication_date 2020/05/12 · arxiv published 2020/05/12 · arxiv updated 2020/05/28 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Algorithms are widely applied to detect hate speech and abusive language in social media. We investigated whether the human-annotated data used to train these algorithms are biased. We utilized a publicly available annotated Twitter dataset (Founta et al. 2018) and classified the racial, gender, and party identification dimensions of 99,996 tweets. The results showed that African American tweets were up to 3.7 times more likely to be labeled as abusive, and African American male tweets were up to 77% more likely to be labeled as hateful compared to the others. These patterns were statistically significant and robust even when party identification was added as a control variable. This study provides the first systematic evidence on intersectional bias in datasets of hate speech and abusive language.