Memory Capacity of Neural Networks using a Circulant Weight Matrix

2014/03/12 by Vamsi Sashank Kotagiri, Kotagiri, Vamsi Sashank · 1 citation
Computer Science · Neuroscience · #Neural Networks and Applications #Neural Networks Stability and Synchronization #Neural dynamics and brain function

paper · pdf · doi:10.48550/arxiv.1403.3115

Abstract

This paper presents results on the memory capacity of a generalized feedback neural network using a circulant matrix. Children are capable of learning soon after birth which indicates that the neural networks of the brain have prior learnt capacity that is a consequence of the regular structures in the brain's organization. Motivated by this idea, we consider the capacity of circulant matrices as weight matrices in a feedback network.

Cited by

• Intermittent Learning: On-Device Machine Learning on Intermittently Powered System

Related

• Memory Capacity of Recurrent Neural Networks with Matrix Representation
• Neural Network Capacity for Multilevel Inputs
• Memory Capacity of a Random Neural Network
• Kernel Memory Networks: A Unifying Framework for Memory Modeling
• Memory Retrieval in the B-Matrix Neural Network