vix.ing · top · new · best · stats · spec

Albert Gu

  1. Mamba: Linear-Time Sequence Modeling with Selective State Spaces
    2023/12/01 by Albert Gu, Gu, Albert, Tri Dao +1 · 13 voices · 917 citations
    Computer Science · #Machine Learning and Algorithms #Neural Networks and Applications #Topic Modeling #cs.AI #cs.LG
  2. Dynamic Chunking for End-to-End Hierarchical Sequence Modeling
    2025/07/10 by Sukjun Hwang, Hwang, Sukjun, Brandon Wang +3 · 14 voices · 14 citations
    #cs.LG
  3. Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
    2024/02/29 by Soham De, De, Soham, Samuel L. Smith +31 · 5 voices · 25 citations
    #cs.LG #cs.CL
  4. Efficiently Modeling Long Sequences with Structured State Spaces
    2021/10/31 by Albert Gu, Gu, Albert, Karan Goel +3 · 338 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
  5. An Empirical Study of Mamba-based Language Models
    2024/06/12 by Roger Waleffe, Wonmin Byeon, Waleffe, Roger +30 · 1 voice · 46 citations
    Arts and Humanities · #Language, Linguistics, Cultural Analysis #cs.CL #cs.LG
  6. Resurrecting Recurrent Neural Networks for Long Sequences
    2023/03/11 by Antonio Orvieto, Orvieto, Antonio, Samuel Smith +13 · 2 voices · 55 citations
    Computer Science · Engineering · Materials Science · #cs.LG
  7. HiPPO: Recurrent Memory with Optimal Polynomial Projections
    2020/08/17 by Albert Gu, Gu, Albert, Tri Dao +7 · 72 citations
    Computer Science · #Time Series Analysis and Forecasting #Anomaly Detection Techniques and Applications #Data Stream Mining Techniques
  8. On the Parameterization and Initialization of Diagonal State Space Models
    2022/06/23 by Albert Gu, Ankit Gupta, Gu, Albert +5 · 57 citations
    Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications
  9. How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections
    2022/06/24 by Albert Gu, Gu, Albert, Isys Johnson +7 · 20 citations
    Computer Science · #Blind Source Separation Techniques #Neural Networks and Applications #Target Tracking and Data Fusion in Sensor Networks
  10. Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling
    2024/03/05 by Yair Schiff, Chia-Hsiang Kao, Schiff, Yair +9 · 23 citations
    Biochemistry, Genetics and Molecular Biology · #FOS: Biological sciences #FOS: Computer and information sciences #Genetics, Bioinformatics, and Biomedical Research #Genomics (q-bio.GN) #Genomics and Phylogenetic Studies #Machine Learning (cs.LG) #Machine Learning in Bioinformatics
  11. Structured State Space Models for In-Context Reinforcement Learning
    2023/03/07 by Chris Xiaoxuan Lu, Yannick Schroecker, Lu, Chris +11 · 13 citations
    Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Reinforcement Learning in Robotics
  12. A Kernel Theory of Modern Data Augmentation
    2018/03/16 by Tri Dao, Albert Gu, Dao, Tri +9 · 7 citations
    Computer Science · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
  13. Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models
    2024/08/19 by Aviv Bick, Kevin Y. Li, Bick, Aviv +7 · 12 citations
    Computer Science · Engineering · #Topic Modeling #Natural Language Processing Techniques #Reservoir Engineering and Simulation Methods
  14. On the Benefits of Memory for Modeling Time-Dependent PDEs
    2024/09/03 by Ricardo Buitrago Ruiz, Ruiz, Ricardo Buitrago, Tanya Marwah +5 · 12 citations
    Decision Sciences · #Simulation Techniques and Applications
  15. S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spaces
    2022/10/12 by Éric Nguyen, Karan Goel, Nguyen, Eric +13 · 4 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Electrical engineering #Generative Adversarial Networks and Image Synthesis #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #electronic engineering #information engineering
  16. Model Patching: Closing the Subgroup Performance Gap with Data Augmentation
    2020/08/15 by Karan Goel, Albert Gu, Goel, Karan +5 · 3 citations
    Computer Science · #Topic Modeling #Software Testing and Debugging Techniques #Software System Performance and Reliability
  17. Mamba-3: Improved Sequence Modeling using State Space Principles
    2026/03/16 by Aakash Lahoti, Kevin Y. Li, Berlin Chen +5 · 1 voice · 4 citations
    #cs.LG
  18. Towards a General Purpose CNN for Long Range Dependencies in ND
    2022/06/07 by David W. Romero, Romero, David W., David M. Knigge +11 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  19. Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps
    2020/12/29 by Tri Dao, Dao, Tri, Nimit S. Sohoni +13 · 1 citation
    Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Speech Recognition and Synthesis #Stochastic Gradient Optimization Techniques
  20. Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism
    2025/04/22 by Eric P. Xing, Bick, Aviv, Xing, Eric +2 · 4 citations
    Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Machine Learning in Healthcare
  21. Pretraining Without Attention
    2022/12/20 by Junxiong Wang, Wang, Junxiong, Jing Nathan Yan +5 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
  22. Lyra: An Efficient and Expressive Subquadratic Architecture for Modeling Biological Sequences
    2025/03/20 by Kumar Ramesh, Krithik Ramesh, Sameed M. Siddiqui +9 · 2 voices · 1 citation
    Computer Science · #Algorithms and Data Compression #Cellular Automata and Applications #cs.LG #q-bio.GN
  23. HybriDNA: A Hybrid Transformer-Mamba2 Long-Range DNA Language Model
    2025/02/15 by Mingqian Ma, Guoqing Liu, Ma, Mingqian +25 · 3 citations
    Environmental Science · #Artificial Intelligence (cs.AI) #Environmental DNA in Biodiversity Studies #FOS: Biological sciences #FOS: Computer and information sciences #Genomics (q-bio.GN) #Machine Learning (cs.LG)
  24. Raven: High-Recall Sequence Modeling with Sparse Memory Routing
    2026/07/28 by Arshia Afzal, Aviv Bick, Eric P. Xing +2
    #cs.LG #cs.AI