vix.ing · top · new · best · stats · spec

Connecting Sphere Manifolds Hierarchically for Regularization

2021/06/25 by Damien Scieur, Scieur, Damien, Youngsung Kim +1
Computer Science · #AI in cancer detection #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG)

paper · pdf · doi:10.48550/arxiv.2106.13549

openalex publication_date 2021/06/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper considers classification problems with hierarchically organized classes. We force the classifier (hyperplane) of each class to belong to a sphere manifold, whose center is the classifier of its super-class. Then, individual sphere manifolds are connected based on their hierarchical relations. Our technique replaces the last layer of a neural network by combining a spherical fully-connected layer with a hierarchical layer. This regularization is shown to improve the performance of widely used deep neural network architectures (ResNet and DenseNet) on publicly available datasets (CIFAR100, CUB200, Stanford dogs, Stanford cars, and Tiny-ImageNet).

Related