A Survey of Spanish Clinical Language Models

2023/08/04 by Guillem García Subies, Subies, Guillem García, Álvaro Barbero Jiménez +3
Computer Science · Health Professions · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Interpreting and Communication in Healthcare #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification

paper · pdf · doi:10.48550/arxiv.2308.02199

openalex publication_date 2023/08/04 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01

Abstract

This survey focuses in encoder Language Models for solving tasks in the clinical domain in the Spanish language. We review the contributions of 17 corpora focused mainly in clinical tasks, then list the most relevant Spanish Language Models and Spanish Clinical Language models. We perform a thorough comparison of these models by benchmarking them over a curated subset of the available corpora, in order to find the best-performing ones; in total more than 3000 models were fine-tuned for this study. All the tested corpora and the best models are made publically available in an accessible way, so that the results can be reproduced by independent teams or challenged in the future when new Spanish Clinical Language models are created.

Related

• Biomedical and Clinical Language Models for Spanish: On the Benefits of\n Domain-Specific Pretraining in a Mid-Resource Scenario
• EriBERTa: A Bilingual Pre-Trained Language Model for Clinical Natural Language Processing
• Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain
• ClinText-SP and RigoBERTa Clinical: a new set of open resources for Spanish Clinical NLP
• Spanish Legalese Language Model and Corpora