vix.ing · top · new · best · stats · spec

Exploring Hybrid and Ensemble Models for Multiclass Prediction of Mental Health Status on Social Media

2022/12/19 by Sourabh Zanwar, Zanwar, Sourabh, Daniel Wiechmann +5
Computer Science · Psychology · #Computation and Language (cs.CL) #Digital Mental Health Interventions #FOS: Computer and information sciences #Mental Health via Writing #Sentiment Analysis and Opinion Mining

paper · pdf · doi:10.48550/arxiv.2212.09839

openalex publication_date 2022/12/19 · openalex created_date 2023/01/04 · openalex updated_date 2026/07/28

Abstract

In recent years, there has been a surge of interest in research on automatic mental health detection (MHD) from social media data leveraging advances in natural language processing and machine learning techniques. While significant progress has been achieved in this interdisciplinary research area, the vast majority of work has treated MHD as a binary classification task. The multiclass classification setup is, however, essential if we are to uncover the subtle differences among the statistical patterns of language use associated with particular mental health conditions. Here, we report on experiments aimed at predicting six conditions (anxiety, attention deficit hyperactivity disorder, bipolar disorder, post-traumatic stress disorder, depression, and psychological stress) from Reddit social media posts. We explore and compare the performance of hybrid and ensemble models leveraging transformer-based architectures (BERT and RoBERTa) and BiLSTM neural networks trained on within-text distributions of a diverse set of linguistic features. This set encompasses measures of syntactic complexity, lexical sophistication and diversity, readability, and register-specific ngram frequencies, as well as sentiment and emotion lexicons. In addition, we conduct feature ablation experiments to investigate which types of features are most indicative of particular mental health conditions.

Related