Cheap Ways of Extracting Clinical Markers from Texts

2024/03/17 by Anastasia Sandu, Sandu, Anastasia, Teodor Mihailescu +3
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2403.11227

openalex publication_date 2024/03/17 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper describes the work of the UniBuc Archaeology team for CLPsych's 2024 Shared Task, which involved finding evidence within the text supporting the assigned suicide risk level. Two types of evidence were required: highlights (extracting relevant spans within the text) and summaries (aggregating evidence into a synthesis). Our work focuses on evaluating Large Language Models (LLM) as opposed to an alternative method that is much more memory and resource efficient. The first approach employs a good old-fashioned machine learning (GOML) pipeline consisting of a tf-idf vectorizer with a logistic regression classifier, whose representative features are used to extract relevant highlights. The second, more resource intensive, uses an LLM for generating the summaries and is guided by chain-of-thought to provide sequences of text indicating clinical markers.

Related

• Evidence-Driven Marker Extraction for Social Media Suicide Risk Detection
• Integrating Supervised Extractive and Generative Language Models for Suicide Risk Evidence Summarization
• Uncovering Intervention Opportunities for Suicide Prevention with Language Model Assistants
• Evaluating Open-Weight Large Language Models for Structured Data Extraction from Narrative Medical Reports Across Multiple Use Cases and Languages
• Automating Thematic Review of Prevention of Future Deaths Reports: Replicating the ONS Child Suicide Study using Large Language Models