vix.ing · top · new · best · stats · spec

Ruder, Sebastian

  1. An overview of gradient descent optimization algorithms
    2016/09/15 by Sebastian Ruder, Ruder, Sebastian · 3 voices · 276 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Medical Image Segmentation Techniques #Face and Expression Recognition
  2. An Overview of Multi-Task Learning in Deep Neural Networks
    2017/06/15 by Sebastian Ruder, Ruder, Sebastian · 186 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification #Machine Learning and Algorithms
  3. Language Models are Multilingual Chain-of-Thought Reasoners
    2022/10/06 by Freda Shi, Shi, Freda, Mirac Süzgün +20 · 73 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  4. PaLM 2 Technical Report
    2023/05/17 by Rohan Anil, Andrew M. Dai, Anil, Rohan +224 · 83 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  5. XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization
    2020/03/24 by Hu, Junjie, Ruder, Sebastian, Siddhant, Aditya +3 · 51 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  6. Gemini: A Family of Highly Capable Multimodal Models
    2023/12/19 by Gemini Robotics Team, Gemini Team, Rohan Anil +2692 · 9 voices · 6 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #cs.AI #cs.CL #cs.CV
  7. The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs
    2025/04/24 by Piotr Nawrot, Robert Li, Nawrot, Piotr +9 · 6 voices · 8 citations
    #cs.CL #cs.LG
  8. Long Range Arena: A Benchmark for Efficient Transformers
    2020/11/08 by Yi Tay, Mostafa Dehghani, Tay, Yi +17 · 60 citations
    Computer Science · Engineering · #Advanced Neural Network Applications #Ferroelectric and Negative Capacitance Devices #Power Line Inspection Robots
  9. Universal Language Model Fine-tuning for Text Classification
    2018/01/18 by Jeremy Howard, Howard, Jeremy, Sebastian Ruder +1 · 4 voices · 2 citations
    Computer Science · Mathematics · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.CL #cs.LG #stat.ML
  10. Compacter: Efficient Low-Rank Hypercomplex Adapter Layers
    2021/06/08 by Rabeeh Karimi Mahabadi, James Henderson, Mahabadi, Rabeeh Karimi +3 · 38 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Domain Adaptation and Few-Shot Learning
  11. How Good is Your Tokenizer? On the Monolingual Performance of\n Multilingual Language Models
    2020/12/31 by Phillip Rust, Jonas Pfeiffer, Rust, Phillip +7 · 34 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  12. MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer
    2020/04/30 by Pfeiffer, Jonas, Vulić, Ivan, Gurevych, Iryna +1 · 26 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  13. AdapterHub: A Framework for Adapting Transformers
    2020/07/15 by Pfeiffer, Jonas, Rücklé, Andreas, Poth, Clifton +5 · 21 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  14. Mind the Gap: Assessing Temporal Generalization in Neural Language Models
    2021/02/03 by Lazaridou, Angeliki, Kuncoro, Adhiguna, Gribovskaya, Elena +11 · 19 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  15. Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation
    2024/12/04 by Shivalika Singh, Singh, Shivalika, Angelika Romanou +44 · 50 citations
    Arts and Humanities · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Second Language Learning and Teaching
  16. Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks
    2021/06/08 by Mahabadi, Rabeeh Karimi, Ruder, Sebastian, Dehghani, Mostafa +1 · 17 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  17. SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages
    2024/06/14 by Holy Lovenia, Rahmad Mahendra, Lovenia, Holy +122 · 1 voice · 14 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #cs.CL
  18. Episodic Memory in Lifelong Language Learning
    2019/06/03 by Cyprien de Masson d’Autume, Sebastian Ruder, d'Autume, Cyprien de Masson +5 · 11 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  19. MasakhaNER: Named Entity Recognition for African Languages
    2021/03/22 by David Ifeoluwa Adelani, Jade Abbott, Adelani, David Ifeoluwa +113 · 11 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  20. XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation
    2021/04/15 by Ruder, Sebastian, Constant, Noah, Botha, Jan +8 · 11 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  21. Charformer: Fast Character Transformers via Gradient-based Subword Tokenization
    2021/06/23 by Yi Tay, Vinh Q. Tran, Tay, Yi +17 · 12 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
  22. Aya 23: Open Weight Releases to Further Multilingual Progress
    2024/05/23 by Viraat Aryabumi, John Dang, Aryabumi, Viraat +39 · 1 voice · 15 citations
    Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling #cs.CL
  23. Modular Deep Learning
    2023/02/22 by Jonas Pfeiffer, Pfeiffer, Jonas, Sebastian Ruder +5 · 12 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Software Engineering Research #Topic Modeling
  24. Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning
    2024/02/09 by Shivalika Singh, Freddie Vargus, Singh, Shivalika +63 · 14 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
  25. To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks
    2019/03/14 by Peters, Matthew E., Ruder, Sebastian, Smith, Noah A. · 6 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  26. Large Language Models are Easily Confused: A Quantitative Metric, Security Implications and Typological Analysis
    2024/06/28 by Marchisio, Kelly, Wei-Yin Ko, Alexandre Bérard +6 · 15 citations
    Health Professions · Arts and Humanities · #Interpreting and Communication in Healthcare #Translation Studies and Practices
  27. NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis
    2022/01/20 by Muhammad, Shamsuddeen Hassan, Adelani, David Ifeoluwa, Ruder, Sebastian +9 · 7 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  28. Rethinking embedding coupling in pre-trained language models
    2020/10/24 by Chung, Hyung Won, Févry, Thibault, Tsai, Henry +2 · 5 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  29. Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning
    2023/11/18 by Clifton Poth, Hannah Sterz, Poth, Clifton +17 · 8 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  30. BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer
    2023/05/24 by Akari Asai, Asai, Akari, Sneha Kudugunta +15 · 7 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  31. M-RewardBench: Evaluating Reward Models in Multilingual Settings
    2024/10/20 by Srishti Gureja, Gureja, Srishti, Lester James V. Miranda +16 · 13 citations
    Health Professions · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Interpreting and Communication in Healthcare #Machine Learning (cs.LG)
  32. NL-Augmenter: A Framework for Task-Sensitive Natural Language\n Augmentation
    2021/12/05 by Kaustubh Dhole, Dhole, Kaustubh D., Varun Gangal +221 · 5 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  33. How Does Quantization Affect Multilingual LLMs?
    2024/07/03 by Kelly Marchisio, Saurabh Dash, Marchisio, Kelly +11 · 9 citations
    Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification
  34. IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation
    2021/04/16 by Cahyawijaya, Samuel, Winata, Genta Indra, Wilie, Bryan +9 · 5 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  35. UNKs Everywhere: Adapting Multilingual Language Models to New Scripts
    2020/12/31 by Pfeiffer, Jonas, Vulić, Ivan, Gurevych, Iryna +1 · 4 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  36. Romanization-based Large-scale Adaptation of Multilingual Language Models
    2023/04/18 by Sukannya Purkayastha, Purkayastha, Sukannya, Sebastian Ruder +7 · 5 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
  37. ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning
    2021/11/22 by Vamsi Aribandi, Yi Tay, Aribandi, Vamsi +25 · 4 citations
    Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  38. One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia
    2022/03/24 by Alham Fikri Aji, Aji, Alham Fikri, Genta Indra Winata +21 · 5 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  39. AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages
    2023/02/17 by Shamsuddeen Hassan Muhammad, Muhammad, Shamsuddeen Hassan, Idris Abdulmumin +48 · 5 citations
    Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Linguistics and Discourse Analysis #Natural Language Processing Techniques #Sentiment Analysis and Opinion Mining
  40. NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages
    2022/05/31 by Winata, Genta Indra, Aji, Alham Fikri, Cahyawijaya, Samuel +11 · 5 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  41. AxCell: Automatic Extraction of Results from Machine Learning Papers
    2020/04/29 by Kardas, Marcin, Czapla, Piotr, Stenetorp, Pontus +4 · 3 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (stat.ML)
  42. Command A: An Enterprise-Ready Large Language Model
    2025/04/01 by Team Cohere, Cohere, Team, : +316 · 13 citations
    Business, Management and Accounting · Computer Science · #Business Process Modeling and Analysis #Software System Performance and Reliability #Advanced Software Engineering Methodologies
  43. Multi-view Subword Regularization
    2021/03/15 by Xinyi Wang, Wang, Xinyi, Sebastian Ruder +3 · 3 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
  44. Learning to select data for transfer learning with Bayesian Optimization
    2017/07/17 by Ruder, Sebastian, Plank, Barbara · 2 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  45. NusaCrowd: Open Source Initiative for Indonesian NLP Resources
    2022/12/19 by Samuel Cahyawijaya, Cahyawijaya, Samuel, Holy Lovenia +91 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Speech and dialogue systems
  46. AfriQA: Cross-lingual Open-Retrieval Question Answering for African Languages
    2023/05/11 by Odunayo Ogundepo, Tajuddeen Gwadabe, Ogundepo, Odunayo +101 · 3 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  47. MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition
    2022/10/22 by David Ifeoluwa Adelani, Adelani, David Ifeoluwa, Graham Neubig +87 · 2 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text and Document Classification Technologies
  48. Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold
    2022/06/20 by Ruder, Sebastian, Vulić, Ivan, Søgaard, Anders · 2 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  49. A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis
    2016/09/09 by Ruder, Sebastian, Ghaffari, Parsa, Breslin, John G. · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  50. Data Selection Strategies for Multi-Domain Sentiment Analysis
    2017/02/08 by Ruder, Sebastian, Ghaffari, Parsa, Breslin, John G. · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  51. On the Limitations of Unsupervised Bilingual Dictionary Induction
    2018/05/09 by Søgaard, Anders, Ruder, Sebastian, Vulić, Ivan · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  52. Strong Baselines for Neural Semi-supervised Learning under Domain Shift
    2018/04/25 by Ruder, Sebastian, Plank, Barbara · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  53. Language and Task Arithmetic with Parameter-Efficient Layers for Zero-Shot Summarization
    2023/11/15 by Alexandra Chronopoulou, Jonas Pfeiffer, Chronopoulou, Alexandra +9 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  54. BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts
    2024/08/15 by Qizhen Zhang, Zhang, Qizhen, Nikolas Gritsch +19 · 3 citations
    Computer Science · Business, Management and Accounting · #Time Series Analysis and Forecasting #Customer churn and segmentation #Data Stream Mining Techniques
  55. Balancing Average and Worst-case Accuracy in Multitask Learning
    2021/10/12 by Paul Michel, Sebastian Ruder, Michel, Paul +3 · 1 citation
    Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and Algorithms #Multimodal Machine Learning Applications
  56. Efficient Test Time Adapter Ensembling for Low-resource Language Varieties
    2021/09/10 by Xinyi Wang, Yulia Tsvetkov, Wang, Xinyi +5 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  57. AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic
    2024/12/05 by Nathaniel R. Robinson, Robinson, Nathaniel R., Kelly Marchisio +4 · 3 citations
    Arts and Humanities · Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Historical and Linguistic Studies #Language, Linguistics, Cultural Analysis #Natural Language Processing Techniques
  58. Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation
    2022/03/17 by Wang, Xinyi, Ruder, Sebastian, Neubig, Graham · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  59. XTREME-S: Evaluating Cross-lingual Speech Representations
    2022/03/21 by Alexis Conneau, Ankur Bapna, Conneau, Alexis +35 · 1 citation
    Computer Science · #Speech Recognition and Synthesis #Natural Language Processing Techniques #Topic Modeling
  60. Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer
    2022/05/24 by Ahmet Üstün, Üstün, Ahmet, Arianna Bisazza +7 · 1 citation
    Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Topic Modeling
  61. Evaluating the Diversity, Equity and Inclusion of NLP Technology: A Case Study for Indian Languages
    2022/05/25 by Simran Khanuja, Khanuja, Simran, Sebastian Ruder +3 · 1 citation
    Computer Science · #Speech and dialogue systems #Text Readability and Simplification #Natural Language Processing Techniques
  62. TaTa: A Multilingual Table-to-Text Dataset for African Languages
    2022/10/31 by Sebastian Gehrmann, Sebastian Ruder, Gehrmann, Sebastian +11 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
  63. QAmeleon: Multilingual QA with Only 5 Examples
    2022/11/15 by Agrawal, Priyanka, Alberti, Chris, Huot, Fantine +6 · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  64. Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features
    2023/07/11 by Ester Hlavnova, Hlavnova, Ester, Sebastian Ruder +1 · 1 citation
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
  65. Evaluating and Modeling Attribution for Cross-Lingual Question Answering
    2023/05/23 by Benjamin Müller, Muller, Benjamin, John Wieting +15 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
  66. Arbiters of Ambivalence: Challenges of Using LLMs in No-Consensus Tasks
    2025/05/28 by Radharapu, Bhaktipriya, Revel, Manon, Ung, Megan +2 · 3 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  67. A Post-trainer's Guide to Multilingual Training Data: Uncovering Cross-lingual Transfer Dynamics
    2025/04/23 by Luísa Shimabucoro, Ahmet Üstün, Shimabucoro, Luisa +5 · 2 citations
    Arts and Humanities · Health Professions · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #EFL/ESL Teaching and Learning #FOS: Computer and information sciences #Interpreting and Communication in Healthcare #Second Language Learning and Teaching