Detecting Natural Language Biases with Prompt-based Learning

2023/09/11 by Md Abdul Aowal, Aowal, Md Abdul, Maliha T Islam +5
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection

paper · pdf · doi:10.48550/arxiv.2309.05227

openalex publication_date 2023/09/11 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In this project, we want to explore the newly emerging field of prompt engineering and apply it to the downstream task of detecting LM biases. More concretely, we explore how to design prompts that can indicate 4 different types of biases: (1) gender, (2) race, (3) sexual orientation, and (4) religion-based. Within our project, we experiment with different manually crafted prompts that can draw out the subtle biases that may be present in the language model. We apply these prompts to multiple variations of popular and well-recognized models: BERT, RoBERTa, and T5 to evaluate their biases. We provide a comparative analysis of these models and assess them using a two-fold method: use human judgment to decide whether model predictions are biased and utilize model-level judgment (through further prompts) to understand if a model can self-diagnose the biases of its own prediction.

Related

• Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Models
• Fine-Grained Bias Detection in LLM: Enhancing detection mechanisms for nuanced biases
• Can Instruction Fine-Tuned Language Models Identify Social Bias through Prompting?
• "Im not Racist but...": Discovering Bias in the Internal Knowledge of Large Language Models
• Addressing Stereotypes in Large Language Models: A Critical Examination and Mitigation