Madian Khabsa
- Llama 2: Open Foundation and Fine-Tuned Chat Models
2023/07/18 by Hugo Touvron, Touvron, Hugo, Louis Martin +133 · 1363 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech and dialogue systems
- Effective Long-Context Scaling of Foundation Models
2023/09/27 by Wenhan Xiong, Xiong, Wenhan, Jingyu Liu +40 · 2 voices · 42 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Conv-Linformer: Boosting Linformer's Performance with Convolution in Small-Scale Settings
2020/06/08 by Sinong Wang, Belinda Z. Li, Wang, Sinong +6 · 166 citations
Computer Science · #Neural Networks and Applications #Neural Networks and Reservoir Computing #Advanced Graph Neural Networks
- Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations
2023/12/07 by Hakan Inan, Inan, Hakan, Kartikeya Upasani +19 · 178 citations
Computer Science · Health Professions · #Hate Speech and Cyberbullying Detection #Interpreting and Communication in Healthcare
- Progressive Prompts: Continual Learning for Language Models
2023/01/29 by Anastasia Razdaibiedina, Razdaibiedina, Anastasia, Yuning Mao +8 · 25 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- MART: Improving LLM Safety with Multi-round Automatic Red-Teaming
2023/11/13 by Suyu Ge, Ge, Suyu, Chunting Zhou +13 · 23 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Software Engineering Research
- Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterization
2023/05/06 by Anastasia Razdaibiedina, Yuning Mao, Razdaibiedina, Anastasia +10 · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
2023/01/25 by Davis Liang, Hila Gonen, Liang, Davis +13 · 9 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- CLEAR: Contrastive Learning for Sentence Representation
2020/12/31 by Zhuofeng Wu, Wu, Zhuofeng, Sinong Wang +9 · 8 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Sentiment Analysis and Opinion Mining #Topic Modeling
- Entailment as Few-Shot Learner
2021/04/29 by Sinong Wang, Wang, Sinong, Fang, Han +6 · 10 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning
2021/10/14 by Yuning Mao, Lambert Mathias, Mao, Yuning +13 · 5 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- The Perfect Blend: Redefining RLHF with Mixture of Judges
2024/09/30 by Tengyu Xu, Xu, Tengyu, Eryk Helenowski +37 · 2 voices · 5 citations
#cs.LG #cs.AI #cs.CL
- Adversarial Training for Community Question Answer Selection Based on Multi-scale Matching
2018/04/22 by Yang Xiao, Yang, Xiao, Miaosen Wang +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Diversity-driven Data Selection for Language Model Tuning through Sparse Autoencoder
2025/02/19 by Xianjun Yang, Yang, Xianjun, Shaoliang Nie +13 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- To Pretrain or Not to Pretrain: Examining the Benefits of Pretraining on Resource Rich Tasks
2020/06/15 by Sinong Wang, Wang, Sinong, Madian Khabsa +3 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Preference Optimization with Multi-Sample Comparisons
2024/10/16 by Chaoqi Wang, Wang, Chaoqi, Chen Zhu +18 · 1 citation
Decision Sciences · #Multi-Criteria Decision Making