de Jong, Michiel

1. CoLT5: Faster Long-Range Transformers with Conditional Computation
   2023/03/17 by Joshua Ainslie, Tao Lei, Ainslie, Joshua +21 · 3 voices · 9 citations
   Computer Science · #Handwritten Text Recognition Techniques #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
2. GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
   2023/05/22 by Joshua Ainslie, James Lee-Thorp, Ainslie, Joshua +9 · 249 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Domain Adaptation and Few-Shot Learning
3. Mention Memory: incorporating textual knowledge into Transformers through entity mention attention
   2021/10/12 by de Jong, Michiel, Zemlyanskiy, Yury, FitzGerald, Nicholas +2 · 2 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
4. GLIMMER: generalized late-interaction memory reranker
   2023/06/17 by Michiel de Jong, de Jong, Michiel, Yury Zemlyanskiy +9 · 2 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
5. Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing
   2022/09/29 by Zemlyanskiy, Yury, de Jong, Michiel, Ainslie, Joshua +5 · 1 citation
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
6. FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference
   2022/12/15 by Michiel de Jong, de Jong, Michiel, Yury Zemlyanskiy +11 · 1 citation
   Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Bioinformatics #Natural Language Processing Techniques #Topic Modeling
7. Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute
   2023/01/25 by de Jong, Michiel, Zemlyanskiy, Yury, FitzGerald, Nicholas +4 · 1 citation
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
8. MEMORY-VQ: Compression for Tractable Internet-Scale Memory
   2023/08/28 by Yury Zemlyanskiy, Zemlyanskiy, Yury, Michiel de Jong +11 · 1 citation
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling