Overview of CHIP 2025 Shared Task 2: Discharge Medication Recommendation for Metabolic Diseases Based on Chinese Electronic Health Records

2025/11/09 by Li, Juntao, Yuan, Haobin, Luo, Ling +8
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences

paper · doi:10.48550/arxiv.2511.06230

Abstract

Discharge medication recommendation plays a critical role in ensuring treatment continuity, preventing readmission, and improving long-term management for patients with chronic metabolic diseases. This paper present an overview of the CHIP 2025 Shared Task 2 competition, which aimed to develop state-of-the-art approaches for automatically recommending appro-priate discharge medications using real-world Chinese EHR data. For this task, we constructed CDrugRed, a high-quality dataset consisting of 5,894 de-identified hospitalization records from 3,190 patients in China. This task is challenging due to multi-label nature of medication recommendation, het-erogeneous clinical text, and patient-specific variability in treatment plans. A total of 526 teams registered, with 167 and 95 teams submitting valid results to the Phase A and Phase B leaderboards, respectively. The top-performing team achieved the highest overall performance on the final test set, with a Jaccard score of 0.5102, F1 score of 0.6267, demonstrating the potential of advanced large language model (LLM)-based ensemble systems. These re-sults highlight both the promise and remaining challenges of applying LLMs to medication recommendation in Chinese EHRs. The post-evaluation phase remains open at https://tianchi.aliyun.com/competition/entrance/532411/.

Citations

• Chinese Discharge Drug Recommendation in Metabolic Diseases with Large Language Models
• Baichuan-M2: Scaling Medical Capability with Large Verifier System
• Qwen3 Technical Report
• Citrus: Leveraging Expert Cognitive Pathways in a Medical Language Model for Advanced Medical Decision Support
• DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning
• HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs
• ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools
• TCMBench: A Comprehensive Benchmark for Evaluating Large Language Models in Traditional Chinese Medicine
• Leave No Patient Behind: Enhancing Medication Recommendation for Rare Disease Patients
• HuatuoGPT-II, One-stage Training for Medical Adaption of LLMs
• Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Dataset
• DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Task
• GPT-4 Technical Report
• DialMed: A Dataset for Dialogue-based Medication Recommendation
• SafeDrug: Dual Molecular Graph Encoders for Recommending Effective and Safe Drug Combinations
• PRAG: Paninian Retrieval-Augmented Generation for Safety-Critical Medical Question Answering
• PubMedQA: A Dataset for Biomedical Research Question Answering
• GAMENet: Graph Augmented MEmory Networks for Recommending Medication Combination

Related

• Chinese Discharge Drug Recommendation in Metabolic Diseases with Large Language Models
• CMB: A Comprehensive Medical Benchmark in Chinese
• MedBench: A Comprehensive, Standardized, and Reliable Benchmarking System for Evaluating Chinese Medical Large Language Models
• ChiMed 2.0: Advancing Chinese Medical Dataset in Facilitating Large Language Modeling
• EHR-Based Mobile and Web Platform for Chronic Disease Risk Prediction Using Large Language Multimodal Models