Yury Zemlyanskiy
- CoLT5: Faster Long-Range Transformers with Conditional Computation
2023/03/17 by Joshua Ainslie, Ainslie, Joshua, Tao Lei +21 · 3 voices · 9 citations
Computer Science · #Handwritten Text Recognition Techniques #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
2023/05/22 by Joshua Ainslie, Ainslie, Joshua, James Lee-Thorp +9 · 247 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Domain Adaptation and Few-Shot Learning
- Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
2022/10/18 by Luke Vilnis, Vilnis, Luke, Yury Zemlyanskiy +7 · 2 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Data Classification
- GLIMMER: generalized late-interaction memory reranker
2023/06/17 by Michiel de Jong, Yury Zemlyanskiy, de Jong, Michiel +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference
2022/12/15 by Michiel de Jong, Yury Zemlyanskiy, de Jong, Michiel +11 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Bioinformatics #Natural Language Processing Techniques #Topic Modeling
- MEMORY-VQ: Compression for Tractable Internet-Scale Memory
2023/08/28 by Yury Zemlyanskiy, Michiel de Jong, Zemlyanskiy, Yury +11 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling