Murfet, Daniel
- Open Problems in Mechanistic Interpretability
2025/01/27 by Lee Sharkey, Bilal Chughtai, Sharkey, Lee +58 · 7 voices · 57 citations
Computer Science · #Natural Language Processing Techniques #Statistical and Computational Modeling #cs.LG
- The Local Learning Coefficient: A Singularity-Aware Complexity Measure
2023/08/23 by Edmund Lau, Lau, Edmund, Furman, Zach +3 · 9 citations
Computer Science · Physics and Astronomy · #14B05 #62F15 #68T07 #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Neural Networks and Applications #Statistical Mechanics and Entropy
- Dynamical versus Bayesian Phase Transitions in a Toy Model of Superposition
2023/10/10 by Zhongtian Chen, Chen, Zhongtian, Edmund Lau +7 · 7 citations
Computer Science · #62F15 #68T07 #Artificial Intelligence (cs.AI) #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Neural Networks and Applications
- Differentiation and Specialization of Attention Heads via the Refined Local Learning Coefficient
2024/10/03 by Wang, George, Hoogland, Jesse, van Wingerden, Stan +2 · 12 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Loss Landscape Degeneracy and Stagewise Development in Transformers
2024/02/04 by Hoogland, Jesse, Wang, George, Farrugia-Roberts, Matthew +3 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- You Are What You Eat -- AI Alignment Requires Understanding How Data Shapes Structure and Generalisation
2025/02/08 by Lehalleur, Simon Pepin, Hoogland, Jesse, Farrugia-Roberts, Matthew +5 · 6 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Totally acyclic complexes over noetherian schemes
2009/02/17 by Murfet, Daniel, Salarian, Shokrollah · 1 citation
#Algebraic Geometry (math.AG) #Commutative Algebra (math.AC) #FOS: Mathematics
- Programs as Singularities
2025/04/10 by Daniel Murfet, Murfet, Daniel, Will Troiani +1 · 1 voice · 1 citation
Computer Science · Decision Sciences · Mathematics · #Complex Systems and Decision Making #cs.LG #cs.LO #math.LO
- Logic and the 2-Simplicial Transformer
2019/09/02 by James Clift, Clift, James, Dmitry Doryn +5 · 1 citation
Computer Science · #Advanced Graph Neural Networks #FOS: Computer and information sciences #Logic in Computer Science (cs.LO) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics
- Dynamics of Transient Structure in In-Context Linear Regression Transformers
2025/01/29 by Carroll, Liam, Hoogland, Jesse, Farrugia-Roberts, Matthew +1 · 5 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Compressibility Measures Complexity: Minimum Description Length Meets Singular Learning Theory
2025/10/14 by Einar Urdshals, Edmund Lau, Urdshals, Einar +7 · 1 voice
Computer Science · #Computability, Logic, AI Algorithms #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Neural Networks and Applications
- Structural Inference: Interpreting Small Language Models with Susceptibilities
2025/04/25 by Garrett Baker, Baker, Garrett, George Wang +5 · 2 voices · 2 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Modes of Sequence Models and Learning Coefficients
2025/04/25 by Chen, Zhongtian, Murfet, Daniel · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)