vix.ing · top · new · best · stats · spec

Shao, Rulin

  1. DataComp-LM: In search of the next generation of training sets for language models
    2024/06/17 by Jeffrey Li, Alex Chengyu Fang, Alex Fang +121 · 2 voices · 82 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
  2. Spurious Rewards: Rethinking Training Signals in RLVR
    2025/06/12 by Rulin Shao, Shao, Rulin, Shuyue Stella Li +25 · 60 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
  3. Scaling Retrieval-Based Language Models with a Trillion-Token Datastore
    2024/07/09 by Shao, Rulin, He, Jacqueline, Asai, Akari +5 · 19 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
  4. VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Use
    2023/08/12 by Yonatan Bitton, Bitton, Yonatan, Hritik Bansal +14 · 11 citations
    Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Text Readability and Simplification
  5. MPCFormer: fast, performant and private Transformer inference with MPC
    2022/11/02 by Dacheng Li, Li, Dacheng, Rulin Shao +9 · 9 citations
    Computer Science · Engineering · #Cryptography and Data Security #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques
  6. OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
    2024/11/21 by Akari Asai, Asai, Akari, Jacqueline He +50 · 2 voices · 14 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques #Semantic Web and Ontologies #cs.AI #cs.CL #cs.DL #cs.IR #cs.LG
  7. ReasonIR: Training Retrievers for Reasoning Tasks
    2025/04/29 by Shao, Rulin, Qiao, Rui, Kishore, Varsha +8 · 31 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
  8. Language models scale reliably with over-training and on downstream tasks
    2024/03/13 by Samir Yitzhak Gadre, Gadre, Samir Yitzhak, Georgios Smyrnis +45 · 12 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  9. On the Adversarial Robustness of Vision Transformers
    2021/03/29 by Shao, Rulin, Shi, Zhouxing, Yi, Jinfeng +2 · 5 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  10. DISTFLASHATTN: Distributed Memory-efficient Attention for Long-context LLMs Training
    2023/10/05 by Li, Dacheng, Shao, Rulin, Xie, Anze +5 · 7 citations
    #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
  11. Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment
    2022/12/20 by Rohan Pandey, Pandey, Rohan, Rulin Shao +7 · 5 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
  12. RoRA-VLM: Robust Retrieval-Augmented Vision Language Models
    2024/10/11 by Jingyuan Qi, Zhiyang Xu, Qi, Jingyuan +13 · 7 citations
    Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  13. Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning
    2024/02/18 by Zhiyang Xu, Xu, Zhiyang, Chao Feng +15 · 5 citations
    Psychology · #Visual and Cognitive Learning Processes
  14. ICONS: Influence Consensus for Vision-Language Data Selection
    2024/12/31 by Xindi Wu, Wu, Xindi, Mengzhou Xia +9 · 7 citations
    Computer Science · #Natural Language Processing Techniques #Semantic Web and Ontologies #Advanced Image and Video Retrieval Techniques
  15. Learning to Reason for Factuality
    2025/08/07 by Xilun Chen, Ilia Kulikov, Chen, Xilun +13 · 11 citations
    #cs.CL
  16. Improving Factuality with Explicit Working Memory
    2024/12/24 by Chen, Mingda, Li, Yang, Padthe, Karthik +5 · 5 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  17. DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research
    2025/11/24 by Shao, Rulin, Asai, Akari, Shen, Shannon Zejiang +18 · 7 citations
    Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare
  18. Frustratingly Simple Retrieval Improves Challenging, Reasoning-Intensive Benchmarks
    2025/07/02 by Lyu, Xinxi, Duan, Michael, Shao, Rulin +2 · 5 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
  19. How and When Adversarial Robustness Transfers in Knowledge Distillation?
    2021/10/22 by Shao, Rulin, Yi, Jinfeng, Chen, Pin-Yu +1 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  20. Stochastic Channel-Based Federated Learning for Medical Data Privacy Preserving
    2019/10/23 by Rulin Shao, Hongyu He, Shao, Rulin +5 · 1 citation
    Computer Science · #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #Mobile Crowdsensing and Crowdsourcing
  21. TruthRL: Incentivizing Truthful LLMs via Reinforcement Learning
    2025/09/30 by Wei, Zhepei, Yang, Xiao, Sun, Kai +12 · 4 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  22. TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrieval
    2025/02/28 by Lin, Chien-Yu, Kamahori, Keisuke, Liu, Yiyu +11 · 1 citation
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)