vix.ing · top · new · best · stats · spec

Distill-to-Label: Weakly Supervised Instance Labeling Using Knowledge Distillation

2019/07/26 by Jayaraman J. Thiagarajan, Thiagarajan, Jayaraman J., Satyananda Kashyap +3
Computer Science · Mathematics · Medicine · #AI in cancer detection #Colorectal Cancer Screening and Detection #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.CV #cs.LG #stat.ML

paper · pdf · doi:10.48550/arxiv.1907.12926

arxiv created 2019/07/26 · openalex publication_date 2019/07/26 · arxiv updated 2019/07/31 · openalex created_date 2022/07/28 · openalex updated_date 2026/07/28

Abstract

Weakly supervised instance labeling using only image-level labels, in lieu of expensive fine-grained pixel annotations, is crucial in several applications including medical image analysis. In contrast to conventional instance segmentation scenarios in computer vision, the problems that we consider are characterized by a small number of training images and non-local patterns that lead to the diagnosis. In this paper, we explore the use of multiple instance learning (MIL) to design an instance label generator under this weakly supervised setting. Motivated by the observation that an MIL model can handle bags of varying sizes, we propose to repurpose an MIL model originally trained for bag-level classification to produce reliable predictions for single instances, i.e., bags of size 1. To this end, we introduce a novel regularization strategy based on virtual adversarial training for improving MIL training, and subsequently develop a knowledge distillation technique for repurposing the trained MIL model. Using empirical studies on colon cancer and breast cancer detection from histopathological images, we show that the proposed approach produces high-quality instance-level prediction and significantly outperforms state-of-the MIL methods.

Related