vix.ing · top · new · best · stats · spec

From Conversation to Automation: Leveraging LLMs for Problem-Solving Therapy Analysis

2025/01/10 by Elham Aghakhani, Aghakhani, Elham, Lu Wang +9
Health Professions · Psychology · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Families in Therapy and Culture #Problem Solving Skills Development #Resilience and Mental Health

paper · pdf · doi:10.48550/arxiv.2501.06101

openalex publication_date 2025/01/10 · openalex created_date 2025/01/14 · openalex updated_date 2026/07/28

Abstract

Problem-solving therapy (PST) is a structured psychological approach that helps individuals manage stress and resolve personal issues by guiding them through problem identification, solution brainstorming, decision-making, and outcome evaluation. As mental health care increasingly adopts technologies like chatbots and large language models (LLMs), it is important to thoroughly understand how each session of PST is conducted before attempting to automate it. We developed a comprehensive framework for PST annotation using established PST Core Strategies and a set of novel Facilitative Strategies to analyze a corpus of real-world therapy transcripts to determine which strategies are most prevalent. Using various LLMs and transformer-based models, we found that GPT-4o outperformed all models, achieving the highest accuracy (0.76) in identifying all strategies. To gain deeper insights, we examined how strategies are applied by analyzing Therapeutic Dynamics (autonomy, self-disclosure, and metaphor), and linguistic patterns within our labeled data. Our research highlights LLMs' potential to automate therapy dialogue analysis, offering a scalable tool for mental health interventions. Our framework enhances PST by improving accessibility, effectiveness, and personalized support for therapists.

Related