Singhania, Prajwal
- Loki: Low-rank Keys for Efficient Sparse Attention
2024/06/04 by Prajwal Singhania, Singhania, Prajwal, Siddharth Singh +7 · 23 citations
Computer Science · Neuroscience · #Anomaly Detection Techniques and Applications #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech and Audio Processing
- Thou shalt not hate: Countering Online Hate Speech
2018/08/13 by Binny Mathew, Punyajoy Saha, Mathew, Binny +13 · 9 citations
Computer Science · Social Sciences · #FOS: Computer and information sciences #Freedom of Expression and Defamation #Hate Speech and Cyberbullying Detection #Social Media and Politics #Social and Information Networks (cs.SI)
- Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs
2024/06/14 by Abhimanyu Hans, Hans, Abhimanyu, Yuxin Wen +19 · 9 citations
Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling #Wikis in Education and Collaboration
- Alternating Direction Method of Multipliers for Quantization
2020/09/08 by Huang, Tianjian, Singhania, Prajwal, Sanjabi, Maziar +2 · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers
2025/02/12 by Singh, Siddharth, Singhania, Prajwal, Ranjan, Aditya +9 · 3 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- A 4D Hybrid Algorithm to Scale Parallel Training to Thousands of GPUs
2023/05/22 by Siddharth Singh, Singh, Siddharth, Singhania, Prajwal +3 · 1 citation
Computer Science · Mathematics · #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications