Orr, Douglas

1. SparQ Attention: Bandwidth-Efficient LLM Inference
   2023/12/08 by Luka Ribar, Ribar, Luka, Ivan Chelombiev +10 · 1 voice · 30 citations
   Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling #cs.LG
2. u-μP: The Unit-Scaled Maximal Update Parametrization
   2024/07/24 by Blake, Charlie, Eichenberg, Constantin, Dean, Josef +7 · 10 citations
   #FOS: Computer and information sciences #Machine Learning (cs.LG)
3. Unit Scaling: Out-of-the-Box Low-Precision Training
   2023/03/20 by Charlie Blake, Douglas J. Orr, Blake, Charlie +3 · 5 citations
   Computer Science · Physics and Astronomy · #Computational Physics and Python Applications #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Model Reduction and Neural Networks
4. Approximate Top-k for Increased Parallelism
   2024/12/05 by Oscar Key, Key, Oscar, Luka Ribar +6 · 3 citations
   Computer Science · #Complexity and Algorithms in Graphs #Advanced Graph Theory Research #Coding theory and cryptography