Muzio, Alexandre

1. Scalable and Efficient MoE Training for Multitask Multilingual Models
   2021/09/22 by Young Jin Kim, Ammar Ahmad Awan, Kim, Young Jin +15 · 9 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
2. SEER-MoE: Sparse Expert Efficiency through Regularization for Mixture-of-Experts
   2024/04/07 by Alexandre Muzio, Alexander Y. Sun, Muzio, Alexandre +3 · 9 citations
   Computer Science · Engineering · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Flow Measurement and Analysis #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG)
3. Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers
   2022/05/28 by Rui Liu, Liu, Rui, Young Jin Kim +5 · 4 citations
   Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
4. XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders
   2020/12/31 by Shuming Ma, Jian Yang, Ma, Shuming +22 · 2 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
5. DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders
   2021/06/25 by Shuming Ma, Li Dong, Ma, Shuming +14 · 3 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
6. Improving Multilingual Translation by Representation and Gradient Regularization
   2021/09/10 by Yang, Yilin, Eriguchi, Akiko, Muzio, Alexandre +3 · 1 citation
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
7. Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task
   2021/11/03 by Jian Yang, Shuming Ma, Yang, Jian +18 · 1 citation
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling