vix.ing · top · new · best · stats · spec

CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalities

2023/03/27 by Konstantinos Kontras, Christos Chatzichristos, Kontras, Konstantinos +7 · 3 citations
Computer Science · Engineering · Neuroscience · #Artificial Intelligence (cs.AI) #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Non-Invasive Vital Sign Monitoring #Signal Processing (eess.SP) #Time Series Analysis and Forecasting #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2304.06485

openalex publication_date 2023/03/27 · openalex created_date 2023/04/15 · openalex updated_date 2026/07/28

Abstract

Sleep abnormalities can have severe health consequences. Automated sleep staging, i.e. labelling the sequence of sleep stages from the patient's physiological recordings, could simplify the diagnostic process. Previous work on automated sleep staging has achieved great results, mainly relying on the EEG signal. However, often multiple sources of information are available beyond EEG. This can be particularly beneficial when the EEG recordings are noisy or even missing completely. In this paper, we propose CoRe-Sleep, a Coordinated Representation multimodal fusion network that is particularly focused on improving the robustness of signal analysis on imperfect data. We demonstrate how appropriately handling multimodal information can be the key to achieving such robustness. CoRe-Sleep tolerates noisy or missing modalities segments, allowing training on incomplete data. Additionally, it shows state-of-the-art performance when testing on both multimodal and unimodal data using a single model on SHHS-1, the largest publicly available study that includes sleep stage labels. The results indicate that training the model on multimodal data does positively influence performance when tested on unimodal data. This work aims at bridging the gap between automated analysis tools and their clinical utility.

Cited by

Related