2025/03/06 by Andrea Alessandrelli, Alessandrelli, Andrea, Adriano Barra +7 · 1 citation
Computer Science · Physics and Astronomy · #Neural Networks and Applications #Quantum many-body systems #Neural Networks and Reservoir Computing
paper · pdf · doi:10.48550/arxiv.2503.04454
By leveraging tools from the statistical mechanics of complex systems, in these short notes we extend the architecture of a neural network for hetero-associative memory (called three-directional associative memories, TAM) to explore supervised and unsupervised learning protocols. In particular, by providing entropic-heterogeneous datasets to its various layers, we predict and quantify a new emergent phenomenon -- that we term \em layer's cooperativeness -- where the interplay of dataset entropies across network's layers enhances their retrieval capabilities Beyond those they would have without reciprocal influence. Naively we would expect layers trained with less informative datasets to develop smaller retrieval regions compared to those pertaining to layers that experienced more information: this does not happen and all the retrieval regions settle to the same amplitude, allowing for optimal retrieval performance globally. This cooperative dynamics marks a significant advancement in understanding emergent computational capabilities within disordered systems.