vix.ing · top · new · best · stats · spec

Zero-Shot Recognition through Image-Guided Semantic Classification

2020/07/23 by Mei-Chen Yeh, Fang Li, Yeh, Mei-Chen +1
Computer Science · Medicine · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Viral Infections and Outbreaks Research

paper · pdf · doi:10.48550/arxiv.2007.11814

openalex publication_date 2020/07/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We present a new embedding-based framework for zero-shot learning (ZSL). Most embedding-based methods aim to learn the correspondence between an image classifier (visual representation) and its class prototype (semantic representation) for each class. Motivated by the binary relevance method for multi-label classification, we propose to inversely learn the mapping between an image and a semantic classifier. Given an input image, the proposed Image-Guided Semantic Classification (IGSC) method creates a label classifier, being applied to all label embeddings to determine whether a label belongs to the input image. Therefore, semantic classifiers are image-adaptive and are generated during inference. IGSC is conceptually simple and can be realized by a slight enhancement of an existing deep architecture for classification; yet it is effective and outperforms state-of-the-art embedding-based generalized ZSL approaches on standard benchmarks.

Citations

Related