SMHD: A Large-Scale Resource for Exploring Online Language Usage for Multiple Mental Health Conditions

2018/06/13 by Arman Cohan, Bart Desmet, Cohan, Arman +9 · 12 citations
Computer Science · Psychology · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Mental Health via Writing #Misinformation and Its Impacts #Sentiment Analysis and Opinion Mining #Topic Modeling

paper · pdf · doi:10.48550/arxiv.1806.05258

openalex publication_date 2018/06/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01

Abstract

Mental health is a significant and growing public health concern. As language usage can be leveraged to obtain crucial insights into mental health conditions, there is a need for large-scale, labeled, mental health-related datasets of users who have been diagnosed with one or more of such conditions. In this paper, we investigate the creation of high-precision patterns to identify self-reported diagnoses of nine different mental health conditions, and obtain high-quality labeled data without the need for manual labelling. We introduce the SMHD (Self-reported Mental Health Diagnoses) dataset and make it available. SMHD is a novel large dataset of social media posts from users with one or multiple mental health conditions along with matched control users. We examine distinctions in users' language, as measured by linguistic and psychological variables. We further explore text classification methods to identify individuals with mental conditions through their language.

Cited by

• MindSET: Advancing Mental Health Benchmarking through Large-Scale Social Media Data
• CARMA: Comprehensive Automatically-annotated Reddit Mental Health Dataset for Arabic
• From Medical Records to Diagnostic Dialogues: A Clinical-Grounded Approach and Dataset for Psychiatric Comorbidity
• LMILAtt: A Deep Learning Model for Depression Detection from Social Media Users Enhanced by Multi-Instance Learning Based on Attention Mechanism
• ReDepress: A Cognitive Framework for Detecting Depression Relapse from Social Media
• Mental Multi-class Classification on Social Media: Benchmarking Transformer Architectures against LSTM Models
• EthicsMH: A Pilot Benchmark for Ethical Reasoning in Mental Health AI
• A Gold Standard Dataset and Evaluation Framework for Depression Detection and Explanation in Social Media using LLMs
• Multi-Label Classification with Generative AI Models in Healthcare: A Case Study of Suicidality and Risk Factors
• Beyond Architectures: Evaluating the Role of Contextual Embeddings in Detecting Bipolar Disorder on Social Media
• Advancing Mental Disorder Detection: A Comparative Evaluation of Transformer and LSTM Architectures on Social Media
• Holistix: A Dataset for Holistic Wellness Dimensions Analysis in Mental Health Narratives

Related

• A Survey on Multilingual Mental Disorders Detection from Social Media Data
• Automated Multi-Label Annotation for Mental Health Illnesses Using Large Language Models
• Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis
• A Simple and Flexible Modeling for Mental Disorder Detection by Learning from Clinical Questionnaires
• MindSET: Advancing Mental Health Benchmarking through Large-Scale Social Media Data