Suvinay Subramanian

1. TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings
   2023/04/04 by Norman P. Jouppi, Jouppi, Norman P., George Thomas Kurian +27 · 1 voice · 88 citations
   Computer Science · Engineering · #Advanced Optical Network Technologies #Computer architecture #Computer science #Dataflow #Embedded system #Field-programmable gate array #Interconnection Networks and Systems #Modularity (biology) #PCI Express #Parallel computing #Photonic and Optical Devices #Supercomputer #cs.AI #cs.AR #cs.LG #cs.PF
2. FLAT: An Optimized Dataflow for Mitigating Attention Bottlenecks
   2021/07/13 by Sheng-Chun Kao, Suvinay Subramanian, Kao, Sheng-Chun +7 · 19 citations
   Computer Science · Engineering · #Advanced Neural Network Applications #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques
3. Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decoding
   2025/02/17 by Tian Jin, Jin Tian, Ellie Y. Cheng +17 · 1 voice · 17 citations
   Computer Science · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Neural Networks and Applications #Parallel #and Cluster Computing (cs.DC) #cs.CL #cs.DC #cs.LG
4. STEP: Learning N:M Structured Sparsity Masks from Scratch with Precondition
   2023/02/02 by Yucheng Lu, Shivani Agrawal, Lu, Yucheng +9 · 7 citations
   Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications
5. Effective Interplay between Sparsity and Quantization: From Theory to Practice
   2024/05/31 by Simla Burcu Harma, Ayan Chakraborty, Harma, Simla Burcu +19 · 8 citations
   Computer Science · Engineering · #Neural Networks and Applications #Advanced MEMS and NEMS Technologies
6. Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers
   2024/02/07 by Abhimanyu Rajeshkumar Bambhaniya, Bambhaniya, Abhimanyu Rajeshkumar, Amir Yazdanbakhsh +11 · 3 citations
   Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
7. Training Recipe for N:M Structured Sparsity with Decaying Pruning Mask
   2022/09/15 by Sheng-Chun Kao, Kao, Sheng-Chun, Amir Yazdanbakhsh +9 · 2 citations
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Machine Learning and Data Classification #Performance (cs.PF)
8. JaxPruner: A concise library for sparsity research
   2023/04/27 by Joo Hyung Lee, Wonpyo Park, Lee, Joo Hyung +45 · 1 citation
   Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification #Software Engineering (cs.SE)