vix.ing · top · new · best · stats · spec

L0onie: Compressing COINs with L0-constraints

2022/07/08 by Juan Ramírez, Ramirez, Juan, Jose Gallego-Posada +1
Computer Science · Engineering · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Information Theory (cs.IT) #Machine Learning (cs.LG) #Medical Imaging and Analysis

paper · pdf · doi:10.48550/arxiv.2207.04144

openalex publication_date 2022/07/08 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Advances in Implicit Neural Representations (INR) have motivated research on domain-agnostic compression techniques. These methods train a neural network to approximate an object, and then store the weights of the trained model. For example, given an image, a network is trained to learn the mapping from pixel locations to RGB values. In this paper, we propose L0onie, a sparsity-constrained extension of the COIN compression method. Sparsity allows to leverage the faster learning of overparameterized networks, while retaining the desirable compression rate of smaller models. Moreover, our constrained formulation ensures that the final model respects a pre-determined compression rate, dispensing of the need for expensive architecture search.

Related