Abnar, Samira

1. Quantifying Attention Flow in Transformers
   2020/05/02 by Abnar, Samira, Zuidema, Willem · 79 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
2. Long Range Arena: A Benchmark for Efficient Transformers
   2020/11/08 by Yi Tay, Tay, Yi, Mostafa Dehghani +17 · 50 citations
   Computer Science · Engineering · #Advanced Neural Network Applications #Ferroelectric and Negative Capacitance Devices #Power Line Inspection Robots
3. Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
   2022/07/21 by Yi Tay, Tay, Yi, Mostafa Dehghani +17 · 1 voice · 5 citations
   Computer Science · Physics and Astronomy · #Complex Network Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Theoretical and Computational Physics #cs.CL #cs.LG
4. Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
   2021/09/22 by Tay, Yi, Dehghani, Mostafa, Rao, Jinfeng +7 · 10 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
5. Exploring the Limits of Large Scale Pre-training
   2021/10/05 by Abnar, Samira, Dehghani, Mostafa, Neyshabur, Behnam +1 · 8 citations
   #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
6. GAUDI: A Neural Architect for Immersive 3D Scene Generation
   2022/07/27 by Miguel Ángel Bautista, Pengsheng Guo, Bautista, Miguel Angel +21 · 6 citations
   Computer Science · Engineering · #Generative Adversarial Networks and Image Synthesis #Advanced Vision and Imaging #Human Motion and Animation
7. Diffusion Probabilistic Fields
   2023/03/01 by Zhuang, Peiye, Abnar, Samira, Gu, Jiatao +3 · 3 citations
   #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
8. Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
   2025/01/21 by Samira Abnar, Abnar, Samira, Harshay Shah +9 · 7 citations
   Computer Science · #Topic Modeling #Bayesian Methods and Mixture Models #Machine Learning and Algorithms
9. Experiential, Distributional and Dependency-based Word Embeddings have\n Complementary Roles in Decoding Brain Activity
   2017/11/25 by Samira Abnar, Rasyan Ahmed, Abnar, Samira +5 · 1 citation
   Computer Science · Neuroscience · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Neurobiology of Language and Bilingualism #Text Readability and Simplification #Topic Modeling
10. Adaptivity and Modularity for Efficient Generalization Over Task Complexity
    2023/10/13 by Samira Abnar, Abnar, Samira, Omid Saremi +19 · 1 citation
    Computer Science · #Machine Learning and Data Classification #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
11. Aggregate-and-Adapt Natural Language Prompts for Downstream Generalization of CLIP
    2024/10/31 by Huang, Chen, Seto, Skyler, Abnar, Samira +3 · 1 citation
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)