From lazy to rich to exclusive task representations in neural networks and neural codes

2023/09/25 by Matthew Farrell, Stefano Recanatesi, Eric Shea‐Brown +1 · 1 voice · 2 citations
Neuroscience · Engineering · #Neural dynamics and brain function #Advanced Memory and Neural Computing #Functional Brain Connectivity Studies

paper · doi:10.1016/j.conb.2023.102780

Citations

• The Geometry of Abstraction in the Hippocampus and Prefrontal Cortex
• The Principles of Deep Learning Theory
• Koopman Operator, Geometry, and Learning of Dynamical Systems

Cited by

• Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking)
• A mathematical theory for understanding when abstract representations emerge in neural networks

Discussions

• From lazy to rich to exclusive task representations in neural networks and neural codes doi.org/10.1016/j.co... #neuroscience [bsky, 16 points, 0 comments]