vix.ing · top · new · best · stats · spec

Combining Weakly and Webly Supervised Learning for Classifying Food Images

2017/12/23 by Parneet Kaur, Kaur, Parneet, Karan Sikka +3 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning and Data Classification #Metabolomics and Mass Spectrometry Studies

paper · pdf · doi:10.48550/arxiv.1712.08730

openalex publication_date 2017/12/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Food classification from images is a fine-grained classification problem. Manual curation of food images is cost, time and scalability prohibitive. On the other hand, web data is available freely but contains noise. In this paper, we address the problem of classifying food images with minimal data curation. We also tackle a key problems with food images from the web where they often have multiple cooccuring food types but are weakly labeled with a single label. We first demonstrate that by sequentially adding a few manually curated samples to a larger uncurated dataset from two web sources, the top-1 classification accuracy increases from 50.3% to 72.8%. To tackle the issue of weak labels, we augment the deep model with Weakly Supervised learning (WSL) that results in an increase in performance to 76.2%. Finally, we show some qualitative results to provide insights into the performance improvements using the proposed ideas.

Cited by

Related