Pilault, Jonathan
- On Extractive and Abstractive Neural Document Summarization with\n Transformer Language Models
2019/09/07 by Sandeep Subramanian, Raymond Li, Subramanian, Sandeep +5 · 1 voice · 10 citations
Computer Science · #Advanced Text Analysis Techniques #Natural Language Processing Techniques #Topic Modeling #cs.CL
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
2024/08/07 by Vasudev Shyam, Jonathan Pilault, Shyam, Vasudev +7 · 2 voices · 6 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques #Advanced Data Compression Techniques
- Zamba: A Compact 7B SSM Hybrid Model
2024/05/26 by Paolo Glorioso, Quentin Anthony, Glorioso, Paolo +11 · 33 citations
Engineering · #Advanced Manufacturing and Logistics Optimization #Agricultural Engineering and Mechanization #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Nuclear and radioactivity studies
- Block-State Transformers
2023/06/15 by Mahan Fathi, Jonathan Pilault, Fathi, Mahan +11 · 1 voice · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.LG
- Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction
2023/01/24 by Jonathan Pilault, Xavier García, Pilault, Jonathan +5 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data
2020/09/19 by Pilault, Jonathan, Elhattami, Amine, Pal, Christopher · 3 citations
#FOS: Computer and information sciences #I.2.7 #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- The Zamba2 Suite: Technical Report
2024/11/22 by Paolo Glorioso, Quentin Anthony, Glorioso, Paolo +13 · 1 voice · 7 citations
Computer Science · Physics and Astronomy · Engineering · #cs.LG #cs.AI #cs.CL
- JaxPruner: A concise library for sparsity research
2023/04/27 by Joo Hyung Lee, Lee, Joo Hyung, Wonpyo Park +45 · 1 citation
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification #Software Engineering (cs.SE)
- Zyda: A 1.3T Dataset for Open Language Modeling
2024/06/04 by Tokpanov, Yury, Millidge, Beren, Glorioso, Paolo +4 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences