Kumar, Tanishq

1. Scaling Laws for Precision
   2024/11/07 by Tanishq Kumar, Zachary Ankner, Kumar, Tanishq +16 · 7 voices · 29 citations
   Arts and Humanities · #Philosophy and History of Science
2. Overtrained Language Models Are Harder to Fine-Tune
   2025/03/24 by Jacob M. Springer, Jacob Mitchell Springer, Sachin Goyal +14 · 8 voices · 23 citations
   Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
3. Grokking as the Transition from Lazy to Rich Training Dynamics
   2023/10/09 by Tanishq Kumar, Kumar, Tanishq, Blake Bordelon +5 · 14 citations
   Computer Science · Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Reservoir Computing #Quantum many-body systems #Stochastic Gradient Optimization Techniques
4. No Free Prune: Information-Theoretic Barriers to Pruning at Initialization
   2024/02/02 by Tanishq Kumar, Kevin Luo, Kumar, Tanishq +3 · 3 citations
   Computer Science · Materials Science · #Stochastic Gradient Optimization Techniques #Explainable Artificial Intelligence (XAI) #Machine Learning in Materials Science