Leavitt, Matthew L.

1. Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs
   2023/09/13 by Angelica Chen, Ravid Shwartz-Ziv, Chen, Angelica +7 · 4 voices · 31 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Explainable Artificial Intelligence (XAI)
2. Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
   2024/05/30 by Ankner, Zachary, Blakeney, Cody, Sreenivasan, Kartik +3 · 25 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
3. Dynamic Masking Rate Schedules for MLM Pretraining
   2023/05/24 by Ankner, Zachary, Saphra, Naomi, Blalock, Davis +2 · 4 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
4. Towards falsifiable interpretability research
   2020/10/22 by Matthew L. Leavitt, Leavitt, Matthew L., Ari S. Morcos +1 · 4 citations
   Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Computers and Society (cs.CY) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
5. Selectivity considered harmful: evaluating the causal impact of class selectivity in DNNs
   2020/03/03 by Matthew L. Leavitt, Leavitt, Matthew L., Ari S. Morcos +1 · 6 citations
   Biochemistry, Genetics and Molecular Biology · Computer Science · Materials Science · #Cell Image Analysis Techniques #Domain Adaptation and Few-Shot Learning #Machine Learning in Materials Science
6. Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation
   2022/11/01 by Cody Blakeney, Jessica Zosa Forde, Blakeney, Cody +7 · 1 citation
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling