Timalsina, Aman
- Simple linear attention language models balance the recall-throughput tradeoff
2024/02/28 by Simran Arora, Arora, Simran, Sabri Eyuboglu +15 · 38 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Advanced Graph Neural Networks
- How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections
2022/06/24 by Albert Gu, Gu, Albert, Isys Johnson +7 · 22 citations
Computer Science · #Blind Source Separation Techniques #Neural Networks and Applications #Target Tracking and Data Fusion in Sensor Networks
- Zoology: Measuring and Improving Recall in Efficient Language Models
2023/12/08 by Simran Arora, Sabri Eyuboglu, Arora, Simran +13 · 27 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Topic Modeling
- Just read twice: closing the recall gap for recurrent language models
2024/07/07 by Arora, Simran, Timalsina, Aman, Singhal, Aaryan +6 · 11 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
2023/10/28 by Stefano Massaroli, Michael Poli, Massaroli, Stefano +23 · 6 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Signal Processing (eess.SP) #Topic Modeling #electronic engineering #information engineering