2024/01/19 by Alex Ushveridze, Ushveridze, Alex
Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #Cognitive Science and Education Research #Computability, Logic, AI Algorithms #FOS: Computer and information sciences #Information Theory (cs.IT) #Neural Networks and Applications
paper · pdf · doi:10.48550/arxiv.2401.10428
openalex publication_date 2024/01/19 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
This paper proposes a novel perspective on learning, positing it as the pursuit of dynamical invariants -- data combinations that remain constant or exhibit minimal change over time as a system evolves. This concept is underpinned by both informational and physical principles, rooted in the inherent properties of these invariants. Firstly, their stability makes them ideal for memorization and integration into associative networks, forming the basis of our knowledge structures. Secondly, the predictability of these stable invariants makes them valuable sources of usable energy, quantifiable as kTln2 per bit of accurately predicted information. This energy can be harnessed to explore new transformations, rendering learning systems energetically autonomous and increasingly effective. Such systems are driven to continuously seek new data invariants as energy sources. The paper further explores several meta-architectures of autonomous, self-propelled learning agents that utilize predictable information patterns as a source of usable energy.