2025/04/02 by Massimiliano Luca, Ciro Beneduce, Luca, Massimiliano +5 · 1 citation
Computer Science · Social Sciences · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Authorship Attribution and Profiling #Computation and Language (cs.CL) #Computers and Society (cs.CY) #Ethics and Social Impacts of AI #FOS: Computer and information sciences
paper · pdf · doi:10.48550/arxiv.2504.01951
openalex publication_date 2025/04/02 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
With the wide and cross-domain adoption of Large Language Models, it becomes crucial to assess to which extent the statistical correlations in training data, which underlie their impressive performance, hide subtle and potentially troubling biases. Gender bias in LLMs has been widely investigated from the perspectives of works, hobbies, and emotions typically associated with a specific gender. In this study, we introduce a novel perspective. We investigate whether LLMs can predict an individual's gender based solely on online shopping histories and whether these predictions are influenced by gender biases and stereotypes. Using a dataset of historical online purchases from users in the United States, we evaluate the ability of six LLMs to classify gender and we then analyze their reasoning and products-gender co-occurrences. Results indicate that while models can infer gender with moderate accuracy, their decisions are often rooted in stereotypical associations between product categories and gender. Furthermore, explicit instructions to avoid bias reduce the certainty of model predictions, but do not eliminate stereotypical patterns. Our findings highlight the persistent nature of gender biases in LLMs and emphasize the need for robust bias-mitigation strategies.