Roy Schwartz
- Green AI
2019/07/22 by Roy Schwartz, Jesse Dodge, Schwartz, Roy +5 · 2 voices · 66 citations
Computer Science · Engineering · #Green IT and Sustainability #Mobile Crowdsensing and Crowdsourcing #cs.CL #cs.CV #cs.CY #cs.LG #stat.ME
- Transformers are Multi-State RNNs
2024/01/11 by Matanel Oren, Michael Hassid, Oren, Matanel +7 · 1 voice · 22 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Topic Modeling #cs.CL
- Green AI
2020/11/17 by Roy Schwartz, Jesse Dodge, Noah A. Smith +1 · 54 citations
Environmental Science · #Air Quality Monitoring and Forecasting
- Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
2020/02/14 by Jesse Dodge, Dodge, Jesse, Gabriel Ilharco +9 · 27 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications
2018/04/25 by Dongyeop Kang, Kang, Dongyeop, Waleed Ammar +11 · 21 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Software Engineering Research #Topic Modeling
- Random Feature Attention
2021/03/03 by Hao Peng, Peng, Hao, Nikolaos Pappas +9 · 35 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Efficient Methods for Natural Language Processing: A Survey
2022/08/31 by Marcos Treviso, Ji-Ung Lee, Treviso, Marcos +41 · 2 voices · 8 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
- Show Your Work: Improved Reporting of Experimental Results
2019/09/06 by Jesse Dodge, Suchin Gururangan, Dodge, Jesse +7 · 17 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Data Classification
- Textually Pretrained Speech Language Models
2023/05/22 by Michael Hassid, Tal Remez, Hassid, Michael +21 · 22 citations
Computer Science · #Topic Modeling #Speech Recognition and Synthesis #Natural Language Processing Techniques
- Measuring the Carbon Intensity of AI in Cloud Instances
2022/06/10 by Jesse Dodge, Taylor Prewitt, Dodge, Jesse +17 · 11 citations
Computer Science · Engineering · Environmental Science · #Environmental Impact and Sustainability #FOS: Computer and information sciences #Green IT and Sustainability #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing
- ABC: Attention with Bounded-memory Control
2021/10/06 by Hao Peng, Peng, Hao, Jungo Kasai +13 · 6 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Algorithms #Topic Modeling
- Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images
2023/03/13 by Nitzan Bitton-Guetta, Bitton-Guetta, Nitzan, Yonatan Bitton +11 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Beyond Performance: Quantifying and Mitigating Label Bias in LLMs
2024/05/04 by Yuval Reif, Roy Schwartz, Reif, Yuval +1 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Attend First, Consolidate Later: On the Importance of Attention in Different LLM Layers
2024/09/05 by Amit Ben Artzy, Roy Schwartz, Ben-Artzy, Amit +1 · 8 citations
Economics, Econometrics and Finance · #Law, Economics, and Judicial Systems
- The Larger the Better? Improved LLM Code-Generation via Budget Reallocation
2024/03/31 by Michael Hassid, Hassid, Michael, Tal Remez +7 · 6 citations
Computer Science · #Digital Rights Management and Security
- Context Length Alone Hurts LLM Performance Despite Perfect Retrieval
2025/10/06 by Yufeng Du, Minyang Tian, Du, Yufeng +16 · 16 citations
Computer Science · #Semantic Web and Ontologies #Algorithms and Data Compression #Natural Language Processing Techniques
- Local Guarantees in Graph Cuts and Clustering
2017/04/02 by Moses Charikar, Neha Gupta, Charikar, Moses +3 · 2 citations
Business, Management and Accounting · Decision Sciences · Economics, Econometrics and Finance · #Consumer Market Behavior and Pricing #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Game Theory and Applications #Game Theory and Voting Systems
- VASR: Visual Analogies of Situation Recognition
2022/12/08 by Yonatan Bitton, Bitton, Yonatan, Ron Yosef +9 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Topic Modeling
- From Tokens to Words: On the Inner Lexicon of LLMs
2024/10/08 by Guy Kaplan, Kaplan, Guy, Matanel Oren +5 · 7 citations
Computer Science · Arts and Humanities · #Natural Language Processing Techniques #Translation Studies and Practices
- Rational Recurrences
2018/08/28 by Hao Peng, Roy Schwartz, Peng, Hao +5 · 1 citation
Computer Science · #Topic Modeling #Machine Learning and Algorithms #Natural Language Processing Techniques
- What Can Natural Language Processing Do for Peer Review?
2024/05/10 by Ilia Kuznetsov, Osama Mohammed Afzal, Kuznetsov, Ilia +45 · 5 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
- A Mixture of h-1 Heads is Better than h Heads
2020/05/13 by Hao Peng, Peng, Hao, Roy Schwartz +5 · 1 citation
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- Fighting Bias with Bias: Promoting Model Robustness by Amplifying Dataset Biases
2023/05/30 by Yuval Reif, Roy Schwartz, Reif, Yuval +1 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling
- On Pruning State-Space LLMs
2025/02/26 by Tamer Ghattas, Michael Hassid, Ghattas, Tamer +3 · 2 citations
Computer Science · Engineering · #Time Series Analysis and Forecasting #Parallel Computing and Optimization Techniques #Advanced Memory and Neural Computing