Multi Modal Convolutional Neural Networks for Brain Tumor Segmentation

2018/09/17 by Mehmet Aygün, Aygün, Mehmet, Yusuf H. Şahin +3 · 2 citations
Computer Science · Neuroscience · #Advanced Neural Network Applications #Brain Tumor Detection and Classification #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Medical Image Segmentation Techniques

paper · pdf · doi:10.48550/arxiv.1809.06191

openalex publication_date 2018/09/17 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In this work, we propose a multi-modal Convolutional Neural Network (CNN) approach for brain tumor segmentation. We investigate how to combine different modalities efficiently in the CNN framework.We adapt various fusion methods, which are previously employed on video recognition problem, to the brain tumor segmentation problem,and we investigate their efficiency in terms of memory and performance.Our experiments, which are performed on BRATS dataset, lead us to the conclusion that learning separate representations for each modality and combining them for brain tumor segmentation could increase the performance of CNN systems.

Citations

• Adam: A Method for Stochastic Optimization
• The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)
• Long Short-Term Memory
• 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
• Convolutional Two-Stream Network Fusion for Video Action Recognition

Cited by

• Semi-supervised learning and integration of multi-sequence MR-images for carotid vessel wall and plaque segmentation
• Hierarchical Deep Feature Fusion and Ensemble Learning for Enhanced Brain Tumor MRI Classification

Related

• A Multiscale Patch Based Convolutional Network for Brain Tumor\n Segmentation
• Brain tumor segmentation based on deep learning and an attention mechanism using MRI multi-modalities brain images
• A Multimodal Feature Distillation with Mamba-Transformer Network for Brain Tumor Segmentation with Incomplete Modalities
• Brain Tumor Segmentation Network Using Attention-based Fusion and Spatial Relationship Constraint
• On Enhancing Brain Tumor Segmentation Across Diverse Populations with Convolutional Neural Networks