Levy, Omer
- LIMA: Less Is More for Alignment
2023/05/18 by Chunting Zhou, Zhou, Chunting, Pengfei Liu +27 · 6 voices · 119 citations
Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.AI #cs.CL #cs.LG
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Eric Bieber, Comanici, Gheorghe +6844 · 8 voices · 1358 citations
#cs.CL #cs.AI
- Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
2024/08/20 by Chunting Zhou, Lili Yu, Zhou, Chunting +17 · 4 voices · 115 citations
Neuroscience · #Brain Tumor Detection and Classification
- RoBERTa: A Robustly Optimized BERT Pretraining Approach
2019/07/26 by Liu, Yinhan, Ott, Myle, Goyal, Naman +7 · 814 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- What Does BERT Look At? An Analysis of BERT's Attention
2019/06/11 by Kevin Clark, Urvashi Khandelwal, Clark, Kevin +5 · 2 voices · 74 citations
#cs.CL
- Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
2024/04/12 by Xuezhe Ma, Ma, Xuezhe, Xiaomeng Yang +17 · 3 voices · 4 citations
#cs.LG #cs.CL
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
2018/04/20 by Wang, Alex, Singh, Amanpreet, Michael, Julian +3 · 375 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language\n Generation, Translation, and Comprehension
2019/10/29 by Yinhan Liu, Lewis, Mike, Liu, Yinhan +12 · 259 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Transformer Feed-Forward Layers Are Key-Value Memories
2020/12/29 by Geva, Mor, Schuster, Roei, Berant, Jonathan +1 · 161 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
2019/05/02 by Alex Wang, Wang, Alex, Yada Pruksachatkun +13 · 144 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation
2023/05/02 by Yuval Kirstain, Adam Polyak, Kirstain, Yuval +9 · 196 citations
Computer Science · #Data Visualization and Analytics #Visual Attention and Saliency Detection #Image and Video Quality Assessment
- Are Sixteen Heads Really Better than One?
2019/05/25 by Paul Michel, Omer Levy, Michel, Paul +3 · 68 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- code2seq: Generating Sequences from Structured Representations of Code
2018/08/04 by Uri Alon, Shaked Brody, Alon, Uri +5 · 1 voice · 16 citations
#cs.LG #cs.PL #stat.ML
- Generalization through Memorization: Nearest Neighbor Language Models
2019/11/01 by Urvashi Khandelwal, Omer Levy, Khandelwal, Urvashi +7 · 60 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method
2014/02/15 by Yoav Goldberg, Omer Levy, Goldberg, Yoav +1 · 39 citations
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
- Zero-Shot Relation Extraction via Reading Comprehension
2017/06/13 by Levy, Omer, Seo, Minjoon, Choi, Eunsol +1 · 31 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- SpanBERT: Improving Pre-training by Representing and Predicting Spans
2019/07/24 by Joshi, Mandar, Chen, Danqi, Liu, Yinhan +3 · 33 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- code2vec: Learning Distributed Representations of Code
2018/03/26 by Alon, Uri, Zilberstein, Meital, Levy, Omer +1 · 22 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Programming Languages (cs.PL)
- Annotation Artifacts in Natural Language Inference Data
2018/03/06 by Gururangan, Suchin, Swayamdipta, Swabha, Levy, Omer +3 · 16 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor
2022/12/19 by Or Honovich, Thomas Scialom, Honovich, Or +5 · 23 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning
- Transformer Language Models without Positional Encodings Still Learn Positional Information
2022/03/30 by Adi Haviv, Haviv, Adi, Ori Ram +7 · 20 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
- Instruction Induction: From Few Examples to Natural Language Task Descriptions
2022/05/22 by Or Honovich, Uri Shaham, Honovich, Or +5 · 15 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning and Data Classification #Topic Modeling
- SCROLLS: Standardized CompaRison Over Long Language Sequences
2022/01/10 by Uri Shaham, Shaham, Uri, Elad Segal +19 · 12 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
- Scaling Laws for Generative Mixed-Modal Language Models
2023/01/10 by Armen Aghajanyan, Lili Yu, Aghajanyan, Armen +17 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding
2023/05/23 by Shaham, Uri, Ivgi, Maor, Efrat, Avia +2 · 13 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Branch-Solve-Merge Improves Large Language Model Evaluation and Generation
2023/10/23 by Saha, Swarnadeep, Levy, Omer, Celikyilmaz, Asli +3 · 14 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Self-Alignment with Instruction Backtranslation
2023/08/11 by Xian Li, Li, Xian, Ping Yu +12 · 11 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- BERT for Coreference Resolution: Baselines and Analysis
2019/08/24 by Joshi, Mandar, Levy, Omer, Weld, Daniel S. +1 · 6 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- How to Train BERT with an Academic Budget
2021/04/15 by Izsak, Peter, Berchansky, Moshe, Levy, Omer · 5 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Ultra-Fine Entity Typing
2018/07/13 by Eunsol Choi, Omer Levy, Choi, Eunsol +5 · 4 citations
Computer Science · Decision Sciences · #Advanced Data Storage Technologies #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Scientific Computing and Data Management
- Blockwise Self-Attention for Long Document Understanding
2019/11/07 by Qiu, Jiezhong, Ma, Hao, Levy, Omer +3 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Vision Transformers with Mixed-Resolution Tokenization
2023/04/01 by Tomer Ronen, Ronen, Tomer, Omer Levy +3 · 5 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Visual Attention and Saliency Detection
- Improving Transformer Models by Reordering their Sublayers
2019/11/10 by Press, Ofir, Smith, Noah A., Levy, Omer · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- LMentry: A Language Model Benchmark of Elementary Language Tasks
2022/11/03 by Avia Efrat, Or Honovich, Efrat, Avia +3 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Altogether: Image Captioning via Re-aligning Alt-text
2024/10/22 by Hu Xu, Xu, Hu, Po-Yao Huang +23 · 6 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Video Analysis and Summarization
- The Turking Test: Can Language Models Understand Instructions?
2020/10/22 by Avia Efrat, Efrat, Avia, Omer Levy +1 · 2 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Named Entity Disambiguation for Noisy Text
2017/06/28 by Eshel, Yotam, Cohen, Noam, Radinsky, Kira +3 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens
2021/08/25 by Itay Itzhak, Itzhak, Itay, Omer Levy +1 · 1 voice · 1 citation
#cs.CL #cs.AI #cs.LG
- Simulating Action Dynamics with Neural Process Networks
2017/11/14 by Bosselut, Antoine, Levy, Omer, Holtzman, Ari +3 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- A General Path-Based Representation for Predicting Program Properties
2018/03/26 by Alon, Uri, Zilberstein, Meital, Levy, Omer +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Programming Languages (cs.PL)
- Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling
2018/05/12 by Luheng He, Kenton Lee, He, Luheng +5 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation
2019/02/05 by Karpukhin, Vladimir, Levy, Omer, Eisenstein, Jacob +1 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Structural Language Models of Code
2019/09/30 by Alon, Uri, Sadaka, Roy, Levy, Omer +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Programming Languages (cs.PL)
- Aligned Cross Entropy for Non-Autoregressive Machine Translation
2020/04/03 by Ghazvininejad, Marjan, Karpukhin, Vladimir, Zettlemoyer, Luke +1 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Few-Shot Question Answering by Pretraining Span Selection
2021/01/02 by Ram, Ori, Kirstain, Yuval, Berant, Jonathan +2 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Coreference Resolution without Span Representations
2021/01/02 by Kirstain, Yuval, Ram, Ori, Levy, Omer · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- What Do You Get When You Cross Beam Search with Nucleus Sampling?
2021/07/20 by Shaham, Uri, Levy, Omer · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- A Few More Examples May Be Worth Billions of Parameters
2021/10/08 by Kirstain, Yuval, Lewis, Patrick, Riedel, Sebastian +1 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Learning to Retrieve Passages without Supervision
2021/12/14 by Ram, Ori, Shachaf, Gal, Levy, Omer +2 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Recurrent Additive Networks
2017/05/21 by Kenton Lee, Omer Levy, Lee, Kenton +3 · 1 citation
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning and Algorithms #Topic Modeling