vix.ing · top · new · best · stats · spec

Learning Symmetrization for Equivariance with Orbit Distance Minimization

2023/11/13 by Tien Dat Nguyen, Nguyen, Tien Dat, Jinwoo Kim +5
Engineering · Materials Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Medical Imaging and Analysis

paper · pdf · doi:10.48550/arxiv.2311.07143

openalex publication_date 2023/11/13 · openalex created_date 2023/11/15 · openalex updated_date 2026/07/28

Abstract

We present a general framework for symmetrizing an arbitrary neural-network architecture and making it equivariant with respect to a given group. We build upon the proposals of Kim et al. (2023); Kaba et al. (2023) for symmetrization, and improve them by replacing their conversion of neural features into group representations, with an optimization whose loss intuitively measures the distance between group orbits. This change makes our approach applicable to a broader range of matrix groups, such as the Lorentz group O(1, 3), than these two proposals. We experimentally show our method's competitiveness on the SO(2) image classification task, and also its increased generality on the task with O(1, 3). Our implementation will be made accessible at https://github.com/tiendatnguyen-vision/Orbit-symmetrize.

Related