IDEAL: Improved DEnse locAL Contrastive Learning for Semi-Supervised Medical Image Segmentation

2022/10/26 by Basak, Hritam, Chattopadhyay, Soumitri, Kundu, Rohit +2
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences

paper · doi:10.48550/arxiv.2210.15075

Abstract

Due to the scarcity of labeled data, Contrastive Self-Supervised Learning (SSL) frameworks have lately shown great potential in several medical image analysis tasks. However, the existing contrastive mechanisms are sub-optimal for dense pixel-level segmentation tasks due to their inability to mine local features. To this end, we extend the concept of metric learning to the segmentation task, using a dense (dis)similarity learning for pre-training a deep encoder network, and employing a semi-supervised paradigm to fine-tune for the downstream task. Specifically, we propose a simple convolutional projection head for obtaining dense pixel-level features, and a new contrastive loss to utilize these dense projections thereby improving the local representations. A bidirectional consistency regularization mechanism involving two-stream model training is devised for the downstream task. Upon comparison, our IDEAL method outperforms the SoTA methods by fair margins on cardiac MRI segmentation. Code available: https://github.com/hritam-98/IDEAL-ICASSP23

Related

• Overcoming Dimensional Collapse in Self-supervised Contrastive Learning for Medical Image Segmentation
• Contrastive learning of global and local features for medical image\n segmentation with limited annotations
• Dense Self-Supervised Learning for Medical Image Segmentation
• Self-Ensembling Contrastive Learning for Semi-Supervised Medical Image Segmentation
• Self-supervised Learning of Dense Hierarchical Representations for Medical Image Segmentation