Moshe Berchansky
- Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
2025/01/31 by Nadav Timor, Jonathan Mamou, Timor, Nadav +13 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- CoTAR: Chain-of-Thought Attribution Reasoning with Multi-level Granularity
2024/04/16 by Moshe Berchansky, Daniel Fleischer, Berchansky, Moshe +5 · 3 citations
Computer Science · #Bayesian Modeling and Causal Inference #Advanced Graph Neural Networks #Logic, Reasoning, and Knowledge
- Dynamic Speculation Lookahead Accelerates Speculative Decoding of Large Language Models
2024/05/07 by Jonathan Mamou, Oren Pereg, Mamou, Jonathan +11 · 3 citations
Computer Science · #Advanced Data Compression Techniques #Chaos-based Image/Signal Encryption #Computation and Language (cs.CL) #Error Correcting Code Techniques #FOS: Computer and information sciences