Adam Ibrahim
- Simple and Scalable Strategies to Continually Pre-train Large Language Models
2024/03/13 by Adam Ibrahim, Ibrahim, Adam, Benjamin Therien +14 · 3 voices · 23 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- Zamba: A Compact 7B SSM Hybrid Model
2024/05/26 by Paolo Glorioso, Quentin Anthony, Glorioso, Paolo +11 · 26 citations
Engineering · #Advanced Manufacturing and Logistics Optimization #Agricultural Engineering and Mechanization #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Nuclear and radioactivity studies
- Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?
2024/06/06 by Rylan Schaeffer, Hailey Schoelkopf, Schaeffer, Rylan +15 · 15 citations
Computer Science · #Explainable Artificial Intelligence (XAI)
- Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
2025/03/04 by Vaibhav Singh, Paul Janson, Singh, Vaibhav +11 · 3 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms
- Learning Robust Kernel Ensembles with Kernel Average Pooling
2022/09/30 by Pouya Bashivan, Bashivan, Pouya, Adam Ibrahim +5 · 1 citation
Computer Science · Medicine · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #COVID-19 diagnosis using AI