vix.ing · top · new · best · stats · spec

On the capacity of neural networks

2022/11/02 by Leonardo Cruciani, Cruciani, Leonardo
Computer Science · #Computational Physics (physics.comp-ph) #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Physical sciences #Neural Networks and Applications #Quantum Physics (quant-ph)

paper · pdf · doi:10.48550/arxiv.2211.07531

openalex publication_date 2022/11/02 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The aim of this thesis is to compare the capacity of different models of neural networks. We start by analysing the problem solving capacity of a single perceptron using a simple combinatorial argument. After some observations on the storage capacity of a basic network, known as an associative memory, we introduce a powerful statistical mechanical approach to calculate its capacity in the training rule-dependent Hopfield model. With the aim of finding a more general definition that can be applied even to quantum neural nets, we then follow Gardner's work, which let us get rid of the dependency on the training rule, and comment the results obtained by Lewenstein et al. by applying Gardner's methods on a recently proposed quantum perceptron model.

Related