Derek Tam
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
2022/06/09 by Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 · 3 voices · 136 citations
#cs.CL #cs.AI #cs.CY #cs.LG #stat.ML
- TIES-Merging: Resolving Interference When Merging Models
2023/06/02 by Prateek Yadav, Derek Tam, Yadav, Prateek +7 · 134 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Topic Modeling #Multimodal Machine Learning Applications
- Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
2022/05/11 by Haokun Liu, Derek Tam, Liu, Haokun +10 · 76 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Evaluating the Factual Consistency of Large Language Models Through News Summarization
2022/11/15 by Derek Tam, Anisha Mascarenhas, Tam, Derek +9 · 9 citations
Computer Science · Decision Sciences · #Topic Modeling #Natural Language Processing Techniques #Data Quality and Management
- Merging by Matching Models in Task Parameter Subspaces
2023/12/07 by Derek Tam, Tam, Derek, Mohit Bansal +3 · 6 citations
Computer Science · #Reinforcement Learning in Robotics
- Fishers for Free? Approximating the Fisher Information Matrix by Recycling the Squared Gradient Accumulator
2025/07/24 by Yuxin Li, Felix Dangel, Li, YuXin +5 · 4 citations
Computer Science · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Metaheuristic Optimization Algorithms Research #Stochastic Gradient Optimization Techniques
- Realistic Evaluation of Model Merging for Compositional Generalization
2024/09/26 by Derek Tam, Tam, Derek, Yash Kant +7 · 2 citations
Computer Science · Engineering · #Geochemistry and Geologic Mapping #Mineral Processing and Grinding