TRACE: Transformer-based Risk Assessment for Clinical Evaluation

2024/11/13 by Dionysis Christopoulos, Sotiris Spanos, Christopoulos, Dionysis +5 · 1 citation
Health Professions · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Quality and Safety in Healthcare

paper · pdf · doi:10.48550/arxiv.2411.08701

openalex publication_date 2024/11/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We present TRACE (Transformer-based Risk Assessment for Clinical Evaluation), a novel method for clinical risk assessment based on clinical data, leveraging the self-attention mechanism for enhanced feature interaction and result interpretation. Our approach is able to handle different data modalities, including continuous, categorical and multiple-choice (checkbox) attributes. The proposed architecture features a shared representation of the clinical data obtained by integrating specialized embeddings of each data modality, enabling the detection of high-risk individuals using Transformer encoder layers. To assess the effectiveness of the proposed method, a strong baseline based on non-negative multi-layer perceptrons (MLPs) is introduced. The proposed method outperforms various baselines widely used in the domain of clinical risk assessment, while effectively handling missing values. In terms of explainability, our Transformer-based method offers easily interpretable results via attention weights, further enhancing the clinicians' decision-making process.

Cited by

• Skin Lesion Phenotyping via Nested Multi-modal Contrastive Learning

Related

• Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making
• BiPETE: A Bi-Positional Embedding Transformer Encoder for Risk Assessment of Alcohol and Substance Use Disorder with Electronic Health Records
• Deep Learning Approach for Clinical Risk Identification Using Transformer Modeling of Heterogeneous EHR Data
• Transformer-based unsupervised patient representation learning based on medical claims for risk stratification and analysis
• Toward Automated Regulatory Decision-Making: Trustworthy Medical Device Risk Classification with Multimodal Transformers and Self-Training