vix.ing · top · new · best · stats

Difficulty-Net: Learning to Predict Difficulty for Long-Tailed Recognition

2022/09/07 by Saptarshi Sinha, Hiroki Ohashi, Sinha, Saptarshi +1 · 1 citation
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #cs.AI #cs.CV #cs.LG

paper · pdf · doi:10.48550/arxiv.2209.02960

Accepted for publication at WACV 2023

arxiv created 2022/09/07 · openalex publication_date 2022/09/07 · arxiv updated 2022/09/08 · openalex created_date 2022/09/30 · openalex updated_date 2026/07/28

Abstract

Long-tailed datasets, where head classes comprise much more training samples than tail classes, cause recognition models to get biased towards the head classes. Weighted loss is one of the most popular ways of mitigating this issue, and a recent work has suggested that class-difficulty might be a better clue than conventionally used class-frequency to decide the distribution of weights. A heuristic formulation was used in the previous work for quantifying the difficulty, but we empirically find that the optimal formulation varies depending on the characteristics of datasets. Therefore, we propose Difficulty-Net, which learns to predict the difficulty of classes using the model's performance in a meta-learning framework. To make it learn reasonable difficulty of a class within the context of other classes, we newly introduce two key concepts, namely the relative difficulty and the driver loss. The former helps Difficulty-Net take other classes into account when calculating difficulty of a class, while the latter is indispensable for guiding the learning to a meaningful direction. Extensive experiments on popular long-tailed datasets demonstrated the effectiveness of the proposed method, and it achieved state-of-the-art performance on multiple long-tailed datasets.

Cited by

Related