Deep learning with convolutional neural networks for EEG decoding and visualization

2017/03/15 by Robin Tibor Schirrmeister, Jost Tobias Springenberg, Lukas D. J. Fiederer +7 · 1 voice · 3,584 citations
Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #Algorithm #Artificial intelligence #Computer science #Convolutional neural network #Decoding methods #Deep learning #EEG and Brain-Computer Interfaces #Electroencephalography #Machine learning #Neural dynamics and brain function #Normalization (sociology) #Pattern recognition (psychology) #Visualization #cs.LG #cs.NE

paper · pdf · open access · doi:10.1002/hbm.23730

published in Human Brain Mapping 38(11), 5391-5420 (Wiley) · A revised manuscript (with the new title) has been accepted at Human Brain Mapping, see http://onlinelibrary.wiley.com/doi/10.1002/hbm.23730/full

openalex publication_date 2017/08/07 · arxiv created 2018/06/08 · arxiv updated 2018/06/11 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05

Abstract

PLEASE READ AND CITE THE REVISED VERSION at Human Brain Mapping: http://onlinelibrary.wiley.com/doi/10.1002/hbm.23730/full Code available here: https://github.com/robintibor/braindecode

Cited by

• Supervised Contrastive Learning-Based Domain Generalization Network for Cross-Subject Motor Decoding
• A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists
• GREEN: A lightweight architecture using learnable wavelets and Riemannian geometry for biomarker exploration with EEG signals
• Universal BCI Personalization: One API for Frozen EEG Trunks and Foundation Models
• Quantifying Event-Related (De)Synchronization Variability for Brain-Computer Interface: A Unified and Interpretable Framework
• Transition-Related Potentials as Markers of Narrative Comprehension in Continuous EEG
• Visual Semantic Decoding of Electrocorticography from Video Stimuli using End-to-End Deep Learning
• Brain-Aligned Multi-Stream Video Transformers with Sparse Self-Selection
• Differentiable Logic Gate Networks for Low-Latency EEG Classification on Edge Devices
• BrainPilot: Automating Brain Discovery with Agentic Research
• Dendrite: A Real-Time Python Application for Online Brain-Computer Interface Research and Development
• What EEG Foundation Models Encode: Dataset Identity and a Negative-Control Suite for Clinical Benchmarks
• Visual Motion Imagery Classification with Deep Neural Network based on\n Functional Connectivity
• Deep Convolutional Neural Network for Automated Detection of Mind Wandering using EEG Signals
• EnK: Encoding time-information in convolution
• PaperNet: Efficient Temporal Convolutions and Channel Residual Attention for EEG Epilepsy Detection
• ATCNet-CIAM for Multi-Session Motor Imagery EEG Signal Classification
• Bayesian Complete-Pooling in Cross-Subject Classification for Motor Imagery Electroencephalogram
• Subject-Level Heterogeneity in EEG Motor Imagery Decoding: A Large-Scale Benchmark and Portfolio-Based Reduction of the Search Space
• Predicting the Outcome of rTMS Depression Therapy using EEG Signals and CNN
• SwitchBraidNet: Quantisation-Aware Lightweight Architecture for Hybrid Brain-Computer Interface
• A Composable Channel-Adaptive Architecture for Seizure Classification
• EEG-D3: A Solution to the Hidden Overfitting Problem of Deep Learning Models
• NeuroSketch: An Effective Framework for Neural Decoding via Systematic Architectural Optimization
• Decoding Motor Behavior Using Deep Learning and Reservoir Computing
• ECGDetect: Detecting Ischemia via Deep Learning
• Mind-to-Face: Neural-Driven Photorealistic Avatar Synthesis via EEG Decoding
• Rethinking Generalized BCIs: Benchmarking 340,000+ Unique Algorithmic Configurations for EEG Mental Command Decoding
• Gradual Relation Network: Decoding Intuitive Upper Extremity Movement Imaginations Based on Few-Shot EEG Learning
• Calibration-Free EEG-based Driver Drowsiness Detection with Online Test-Time Adaptation
• Deep Learning Architectures for Code-Modulated Visual Evoked Potentials Detection
• Gated Uncertainty-Aware Runtime Dual Invariants for Neural Signal-Controlled Robotics
• Geometry-Aware Deep Congruence Networks for Manifold Learning in Cross-Subject Motor Imagery
• Prototype-Guided Non-Exemplar Continual Learning for Cross-subject EEG Decoding
• Cross-individual Recognition of Emotions by a Dynamic Entropy based on Pattern Learning with EEG features
• MultiDiffNet: A Multi-Objective Diffusion Framework for Generalizable Brain Decoding
• ManifoldFormer: Geometric Deep Learning for Neural Dynamics on Riemannian Manifolds
• LGGNet: Learning from Local-Global-Graph Representations for Brain-Computer Interface
• Uncertainty-Resilient Multimodal Learning via Consistency-Guided Cross-Modal Transfer
• Deep Invertible Networks for EEG-based brain-signal decoding
• MutualGraphNet: A novel model for motor imagery classification
• Informed Bootstrap Augmentation Improves EEG Decoding
• Subject-Independent Imagined Speech Detection via Cross-Subject Generalization and Calibration
• Lightweight Diffusion-based Framework for Online Imagined Speech Decoding in Aphasia
• Confidence-Aware Neural Decoding of Overt Speech from EEG: Toward Robust Brain-Computer Interfaces
• Meta-cognitive Multi-scale Hierarchical Reasoning for Motor Imagery Decoding
• Adversarial Spatio-Temporal Attention Networks for Epileptic Seizure Forecasting
• Learning Topology-Driven Multi-Subspace Fusion for Grassmannian Deep Network
• Balancing Interpretability and Performance in Motor Imagery EEG Classification: A Comparative Study of ANFIS-FBCSP-PSO and EEGNet
• Consciousness-ECG Transformer for Conscious State Estimation System with Real-Time Monitoring
• Functional connectivity guided deep neural network for decoding high-level visual imagery
• Functional Connectome Fingerprinting Using Convolutional and Dictionary Learning
• Decoding Movement Imagination and Execution from EEG Signals using BCI-Transfer Learning Method based on Relation Network
• Transformer-based Spatial-Temporal Feature Learning for EEG Decoding
• Classification of Upper Limb Movements \newline Using Convolutional Neural Network \newline with 3D Inception Block
• Uncovering the structure of clinical EEG signals with self-supervised learning
• Applying Transfer Learning To Deep Learned Models For EEG Analysis
• FBCNet: A Multi-view Convolutional Neural Network for Brain-Computer Interface
• Decoding speech perception from non-invasive brain recordings
• Adaptive EEG-based stroke diagnosis with a GRU-TCN classifier and deep Q-learning thresholding
• From Subconscious to Insight: Decoding the Incubation Process in Creative Problem Solving
• Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion
• Adaptive Split-MMD Training for Small-Sample Cross-Dataset P300 EEG Classification
• REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects
• Spatio-Temporal Attention Network for Epileptic Seizure Prediction
• Elementary, My Dear Watson: Non-Invasive Neural Keyword Spotting in the LibriBrain Dataset
• Ultra Efficient Transfer Learning with Meta Update for Cross Subject EEG Classification
• RatioWaveNet: A Learnable RDWT Front-End for Robust and Interpretable EEG Motor-Imagery Classification
• Beyond Hearing: Learning Task-Agnostic ExG Representations from Earphones via Physiology-Informed Tokenization
• TSception: A Deep Learning Framework for Emotion Detection Using EEG
• Cortical-SSM: A Deep State Space Model for EEG and ECoG Motor Imagery Decoding
• Local regression on path spaces with signature metrics
• SGDR: Stochastic Gradient Descent with Warm Restarts
• NeuroRVQ: Multi-Scale Biosignal Tokenization for Generative Foundation Models
• Use of covariance matrix images for electroencephalography signal classification for multiclass motor imagery‐based brain computer interface
• HEAR: An EEG Foundation Model with Heterogeneous Electrode Adaptive Representation
• Effects of pupil size as manipulated through ipRGC activation on visual processing
• Bidirectional Time-Frequency Pyramid Network for Enhanced Robust EEG Classification
• Investigating the Impact of Rational Dilated Wavelet Transform on Motor Imagery EEG Decoding with Deep Learning Models
• Mitigating Subject Dependency in EEG Decoding with Subject-Specific Low-Rank Adapters
• Low-Latency Neural Inference on an Edge Device for Real-Time Handwriting Recognition from EEG Signals
• ELASTIQ: EEG-Language Alignment with Semantic Task Instruction and Querying
• Testing machine learning algorithms to evaluate fluctuating and cognitive profiles in Parkinson’s disease by motion sensors and EEG data
• ECHO: Toward Contextual Seq2Seq Paradigms in Large EEG Models
• BrainPro: Towards Large-scale Brain State-aware EEG Representation Learning
• Does EEG Foundation Models Transfer to Speech? A Benchmark on Overt and Imagined Speech Decoding
• Closing the Loop in Neuromodulation: A Review of Machine Learning Approaches for EEG-Guided Transcranial Magnetic Stimulation
• A Deep Learning Framework for Classification of in vitro Multi-Electrode Array Recordings
• Predicting Auditory Spatial Attention from EEG using Single- and Multi-task Convolutional Neural Networks
• Motor Imagery Classification Emphasizing Corresponding Frequency Domain Method based on Deep Learning Framework
• Reconstructing ERP Signals Using Generative Adversarial Networks for Mobile Brain-Machine Interface
• Online Adaptation via Dual-Stage Alignment and Self-Supervision for Fast-Calibration Brain-Computer Interfaces
• Hybrid Pipeline SWD Detection in Long-Term EEG Signals
• SingLEM: Single-Channel Large EEG Model
• UMind: A Unified Multitask Network for Zero-Shot M/EEG Visual Decoding
• Task-Oriented Learning for Automatic EEG Denoising
• Multi-Scale Neural network for EEG Representation Learning in BCI
• Understanding and Comparing Deep Neural Networks for Age and Gender Classification
• ArtifactGen: Benchmarking WGAN-GP vs Diffusion for Label-Aware EEG Artifact Synthesis
• Self-Calibrating BCIs: Ranking and Recovery of Mental Targets Without Labels
• Decoding Visual Neural Representations by Multimodal with Dynamic Balancing
• Handwriting Imagery EEG Classification based on Convolutional Neural Networks
• Improving brain computer interface performance by data augmentation with conditional Deep Convolutional Generative Adversarial Networks
• Improving Electroencephalogram-Based Deception Detection in Concealed Information Test under Low Stimulus Heterogeneity
• Motor Imagery EEG Signal Classification Using Minimally Random Convolutional Kernel Transform and Hybrid Deep Learning
• DynaMind: Reconstructing Dynamic Visual Scenes from EEG by Aligning Temporal Dynamics and Multimodal Semantics to Guided Diffusion
• A Single Subject Machine Learning Based Classification of Motor Imagery EEGs
• DLGE: Dual Local-Global Encoding for Generalizable Cross-BCI-Paradigm
• Real or Virtual? Using Brain Activity Patterns to differentiate Attended Targets during Augmented Reality Scenarios
• PTSM: Physiology-aware and Task-invariant Spatio-temporal Modeling for Cross-Subject EEG Decoding
• EDAPT: Towards Calibration-Free BCIs with Continual Online Adaptation
• Cross-BCI, A Cross-BCI-Paradigm Classifica-tion Model Towards Universal BCI Applications
• Towards Generalizable Learning Models for EEG-Based Identification of Pain Perception
• A multi-modal dataset of electroencephalography and functional near-infrared spectroscopy recordings for motor imagery of multi-types of joints from unilateral upper limb
• Visualizing Deep Learning-based Radio Modulation Classifier
• Exploring Embedding Methods in Binary Hyperdimensional Computing: A Case Study for Motor-Imagery based Brain-Computer Interfaces
• Neurology-as-a-Service for the Developing World
• The Repeated-Stimulus Confound in Electroencephalography
• CADDA: Class-wise Automatic Differentiable Data Augmentation for EEG Signals
• When Brain Foundation Model Meets Cauchy-Schwarz Divergence: A New Framework for Cross-Subject Motor Imagery Decoding
• Transfer Learning in Brain-Computer Interfaces with Adversarial Variational Autoencoders
• MIRepNet: A Pipeline and Foundation Model for EEG-Based Motor Imagery Classification
• Deep Fusion of VGG19 and ConvMixer With Superlet Transform for Cognitive Load Detection
• Active Learning for Black-Box Adversarial Attacks in EEG-Based Brain-Computer Interfaces
• EEG-ConvTransformer for Single-Trial EEG based Visual Stimuli Classification
• EEG-based video identification using graph signal modeling and graph convolutional neural network
• Uncertainty-Aware Cross-Modal Knowledge Distillation with Prototype Learning for Multimodal Brain-Computer Interfaces
• Domain generalization through latent distribution exploration for motor imagery EEG classification
• Functional connectivity ensemble method to enhance BCI performance (FUCONE)
• A Novel RL-assisted Deep Learning Framework for Task-informative Signals Selection and Classification for Spontaneous BCIs
• AFPM: Alignment-based Frame Patch Modeling for Cross-Dataset EEG Decoding
• Toward Improving fNIRS Classification: A Study on Activation Functions in Deep Neural Architectures
• Domain Generalization for Session-Independent Brain-Computer Interface
• Voice of Your Brain: Cognitive Representations of Imagined Speech,Overt Speech, and Speech Perception Based on EEG
• Deep Learning for micro-Electrocorticographic (μECoG) Data
• Deep brain state classification of MEG data
• EEG Foundation Models: A Critical Review of Current Progress and Future Directions
• AdaBrain-Bench: Benchmarking Brain Foundation Models for Brain-Computer Interface Applications
• BrainFLORA: Uncovering Brain Concept Representation via Multimodal Neural Embeddings
• TransformEEG: Towards Improving Model Generalizability in Deep Learning-based EEG Parkinson's Disease Detection
• Uncertainty Quantification for Motor Imagery BCI -- Machine Learning vs. Deep Learning
• Tailoring deep learning for real-time brain-computer interfaces: From offline models to calibration-free online decoding
• MMOC: Self-Supervised EEG Emotion Recognition Framework with Multi-Model Online Collaboration
• System Filter-Based Common Components Modeling for Cross-Subject EEG Decoding
• Are Large Brainwave Foundation Models Capable Yet? Insights from Fine-tuning
• Neuro-Informed Joint Learning Enhances Cognitive Workload Decoding in Portable BCIs
• CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decoding
• AGTCNet: A Graph-Temporal Approach for Principled Motor Imagery EEG Classification
• DBConformer: Dual-Branch Convolutional Transformer for EEG Decoding
• EEG Foundation Challenge: From Cross-Task to Cross-Subject EEG Decoding
• Sequential Interpretability: Methods, Applications, and Future Direction for Understanding Deep Learning Models in the Context of Sequential Data
• On using AI for EEG-based BCI applications: problems, current challenges and future trends
• CRIA: A Cross-View Interaction and Instance-Adapted Pre-training Framework for Generalizable EEG Representations
• Human-Centered Shared Autonomy for Motor Planning, Learning, and Control Applications
• Evaluating the structure of cognitive tasks with transfer learning
• 2021 BEETL Competition: Advancing Transfer Learning for Subject Independence & Heterogenous EEG Data Sets
• Data Normalization Strategies for EEG Deep Learning
• Adversarial Representation Learning for Robust Patient-Independent Epileptic Seizure Detection
• DIVER-0 : A Fully Channel Equivariant EEG Foundation Model
• Automated detection of clinical depression based on convolution neural network model
• Inter-subject Deep Transfer Learning for Motor Imagery EEG Decoding
• Integrative Analysis of Patient Health Records and Neuroimages via Memory-based Graph Convolutional Network
• Classification of Visual Perception and Imagery based EEG Signals Using Convolutional Neural Networks
• EEG Foundation Models for BCI Learn Diverse Features of Electrophysiology
• Large Language Models for EEG: A Comprehensive Survey and Taxonomy
• Category-aware EEG image generation based on wavelet transform and contrast semantic loss
• EEG Conformer: Convolutional Transformer for EEG Decoding and Visualization
• AbsoluteNet: A Deep Learning Neural Network to Classify Cerebral Hemodynamic Responses of Auditory Processing
• Model-Agnostic Meta-Learning for EEG Motor Imagery Decoding in Brain-Computer-Interfacing
• BRAVE: Brain-Controlled Prosthetic Arm with Voice Integration and Embodied Learning for Enhanced Mobility
• On the Vulnerability of CNN Classifiers in EEG-Based BCIs
• Advancing Brainwave Modeling with a Codebook-Based Foundation Model
• STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decoding
• QSVM-QNN: Quantum Support Vector Machine Based Quantum Neural Network Learning Algorithm for Brain-Computer Interfacing Systems
• Deep Learning Decoding of Mental State in Non-invasive Brain Computer Interface
• The role of data partitioning on the performance of EEG-based deep learning models in supervised cross-subject analysis: a preliminary study
• Interpretable MEG Decoding of Perceived Speech: Cortical Sources and the Stimulus Features That Drive Retrieval
• ViEEG: Hierarchical Visual Neural Representation for EEG Brain Decoding
• Distinguishing the activity of flexor digitorum brevis and soleus across standing postures with deep learning models
• Minimizing False-Positive Attributions in Explanations of Non-Linear Models
• Data-driven models in human neuroscience and neuroengineering
• Evaluation in EEG Emotion Recognition: State-of-the-Art Review and Unified Framework
• End-to-End Machine Learning for Depressive State Classification via EEG and fNIRS
• Automatic detection of abnormal clinical EEG: comparison of a finetuned foundation model with two deep learning models
• Boosted Convolutional Neural Networks for Motor Imagery EEG Decoding with Multiwavelet-based Time-Frequency Conditional Granger Causality Analysis
• Epileptic Seizure Classification with Symmetric and Hybrid Bilinear Models
• DAL: Feature Learning from Overt Speech to Decode Imagined Speech-based EEG Signals with Convolutional Autoencoder
• A brain-inspired generative model for EEG-based cognitive state identification
• KnowEEG: Explainable Knowledge Driven EEG Classification
• xEEGNet: Towards Explainable AI in EEG Dementia Classification
• NeuralSet: A High-Performing Python Package for Neuro-AI
• Advancing Face-to-Face Emotion Communication: A Multimodal Dataset (AFFEC)
• A Simple Review of EEG Foundation Models: Datasets, Advancements and Future Perspectives
• Decoding EEG Brain Activity for Multi-Modal Natural Language Processing
• Leakage-Audited Benchmarking Reveals Limited Evidence for Cross-Subject Auditory-Evoked EEG Vowel Perception Decoding
• A DYNAMIC EEG-BASED EMOTION RECOGNITION MODEL FOR DIGITAL INTERACTION DESIGN: A SPARSE SPATIOTEMPORAL MODELING APPROACH
• Motor Imagery Classification of Single-Arm Tasks Using Convolutional Neural Network based on Feature Refining
• A General Framework for Revealing Human Mind with auto-encoding GANs
• An amplitudes-perturbation data augmentation method in convolutional neural networks for EEG decoding
• SSTAF: Spatial-Spectral-Temporal Attention Fusion Transformer for Motor Imagery Classification
• Early Detection of Cognitive Impairment in Elderly using a Passive FPVS-EEG BCI and Machine Learning -- Extended Version
• Brain-Machine Interfaces & Information Retrieval Challenges and Opportunities
• xLSTM-ECG: Multi-label ECG Classification via Feature Fusion with xLSTM
• Machine learning in epilepsy

Discussions

• Deep learning with convolutional neural networks for brain mapping from EEG [hn, 119 points, 18 comments]

Related

• Deep learning with convolutional neural networks for decoding and visualization of EEG pathology
• Deep Learning with ConvNET Predicts Imagery Tasks Through EEG
• Deep Convolutional Neural Network Applied to Electroencephalography: Raw Data vs Spectral Features
• Assessing learned features of Deep Learning applied to EEG
• Convolutional Neural Networks with A Topographic Representation Module for EEG-Based Brain-Computer Interfaces