Lieber, Opher
- Jamba: A Hybrid Transformer-Mamba Language Model
2024/03/28 by Opher Lieber, Lieber, Opher, Barak Lenz +42 · 4 voices · 51 citations
Arts and Humanities · Social Sciences · #Language, Discourse, Communication Strategies #Multilingual Education and Policy
- MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
2022/05/01 by Ehud Karpas, Omri Abend, Karpas, Ehud +31 · 23 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #AI-based Problem Solving and Planning
- PMI-Masking: Principled masking of correlated spans
2020/10/05 by Yoav Levine, Barak Lenz, Levine, Yoav +11 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
2024/08/22 by Jamba Team, Barak Lenz, Lenz, Barak +113 · 6 citations
Engineering · Materials Science · #Fluid Dynamics and Vibration Analysis #High voltage insulation and dielectric phenomena #Power Transformer Diagnostics and Insulation
- Standing on the Shoulders of Giant Frozen Language Models
2022/04/21 by Levine, Yoav, Dalmedigos, Itay, Ram, Ori +10 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences