Matthew L. Leavitt

1. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
   2022/06/09 by Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 · 3 voices · 192 citations
   #cs.CL #cs.AI #cs.CY #cs.LG #stat.ML
2. Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs
   2023/09/13 by Angelica Chen, Chen, Angelica, Ravid Shwartz-Ziv +7 · 4 voices · 31 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Explainable Artificial Intelligence (XAI)
3. Towards falsifiable interpretability research
   2020/10/22 by Matthew L. Leavitt, Leavitt, Matthew L., Ari S. Morcos +1 · 4 citations
   Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Computers and Society (cs.CY) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
4. Selectivity considered harmful: evaluating the causal impact of class selectivity in DNNs
   2020/03/03 by Matthew L. Leavitt, Ari S. Morcos, Leavitt, Matthew L. +1 · 6 citations
   Biochemistry, Genetics and Molecular Biology · Computer Science · Materials Science · #Cell Image Analysis Techniques #Domain Adaptation and Few-Shot Learning #Machine Learning in Materials Science
5. On the special role of class-selective neurons in early training
   2023/05/27 by Omkar Ranadive, Ranadive, Omkar, Nikhil Thakurdesai +7 · 3 citations
   Biochemistry, Genetics and Molecular Biology · Computer Science · Neuroscience · #Cell Image Analysis Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Neural dynamics and brain function
6. Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation
   2022/11/01 by Cody Blakeney, Jessica Zosa Forde, Blakeney, Cody +7 · 1 citation
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling