Dan Busbridge

1. Distillation Scaling Laws
   2025/02/12 by Dan Busbridge, Busbridge, Dan, Amitis Shidani +9 · 9 voices · 15 citations
   Engineering · #Process Optimization and Integration
2. Theory, Analysis, and Best Practices for Sigmoid Self-Attention
   2024/09/06 by Jason Ramapuram, Federico Danieli, Ramapuram, Jason +20 · 1 voice · 13 citations
   Psychology · #Identity, Memory, and Therapy
3. Relational Graph Attention Networks
   2019/04/11 by Dan Busbridge, Dane Sherburn, Busbridge, Dan +5 · 7 citations
   Computer Science · Physics and Astronomy · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #Complex Network Analysis Techniques #FOS: Computer and information sciences #Graph Theory and Algorithms #Machine Learning (cs.LG) #Machine Learning (stat.ML)
4. Scaling Laws for Forgetting during Finetuning with Pretraining Data Injection
   2025/02/09 by Louis Béthune, David Grangier, Bethune, Louis +9 · 9 citations
   Computer Science · #Computation and Language (cs.CL) #Computer Graphics and Visualization Techniques #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Machine Learning (cs.LG) #Neural Networks and Applications
5. Do Self-Supervised and Supervised Methods Learn Similar Visual Representations?
   2021/10/01 by Tom George Grigg, Grigg, Tom George, Dan Busbridge +5 · 3 citations
   Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques
6. Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
   2025/01/21 by Samira Abnar, Abnar, Samira, Harshay Shah +9 · 7 citations
   Computer Science · #Topic Modeling #Bayesian Methods and Mixture Models #Machine Learning and Algorithms
7. Scaling Laws for Optimal Data Mixtures
   2025/07/12 by Mustafa Shukor, Louis Béthune, Shukor, Mustafa +11 · 10 citations
   Computer Science · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Machine Learning (cs.LG)
8. Poly-View Contrastive Learning
   2024/03/08 by Amitis Shidani, Devon Hjelm, Shidani, Amitis +9 · 2 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification