Tanishq Kumar
- Scaling Laws for Precision
2024/11/07 by Tanishq Kumar, Zachary Ankner, Kumar, Tanishq +16 · 7 voices · 35 citations
Arts and Humanities · #Philosophy and History of Science
- Overtrained Language Models Are Harder to Fine-Tune
2025/03/24 by Jacob M. Springer, Jacob Mitchell Springer, Springer, Jacob Mitchell +14 · 8 voices · 27 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- Speculative Speculative Decoding
2026/03/03 by Tanishq Kumar, Tri Dao, Avner May · 12 voices · 2 citations
#cs.LG
- Grokking as the Transition from Lazy to Rich Training Dynamics
2023/10/09 by Tanishq Kumar, Kumar, Tanishq, Blake Bordelon +5 · 23 citations
Computer Science · Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Reservoir Computing #Quantum many-body systems #Stochastic Gradient Optimization Techniques
- No Free Prune: Information-Theoretic Barriers to Pruning at Initialization
2024/02/02 by Tanishq Kumar, Kumar, Tanishq, Kevin Luo +3 · 3 citations
Computer Science · Materials Science · #Stochastic Gradient Optimization Techniques #Explainable Artificial Intelligence (XAI) #Machine Learning in Materials Science