vix.ing · top · new · best · stats · spec

Ruoyu Sun

  1. ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models
    2023/10/16 by Ziniu Li, Li, Ziniu, Tian Xu +10 · 45 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
  2. On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization
    2018/08/08 by Xiangyi Chen, Sijia Liu, Chen, Xiangyi +5 · 14 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural Networks and Applications #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  3. Adam-mini: Use Fewer Learning Rates To Gain More
    2024/06/24 by Yushun Zhang, Congliang Chen, Zhang, Yushun +14 · 25 citations
    Computer Science · Engineering · #Advanced Adaptive Filtering Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music and Audio Processing
  4. AceGPT, Localizing Large Language Models in Arabic
    2023/09/21 by Huang Huang, Huang, Huang, F. Richard Yu +36 · 19 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques
  5. A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems
    2020/10/29 by Jiawei Zhang, Zhang, Jiawei, Peijun Xiao +5 · 14 citations
    Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Domain Adaptation and Few-Shot Learning
  6. Why Transformers Need Adam: A Hessian Perspective
    2024/02/26 by Yushun Zhang, Congliang Chen, Zhang, Yushun +9 · 17 citations
    Physics and Astronomy · #Space Science and Extraterrestrial Life
  7. Adam Can Converge Without Any Modification On Update Rules
    2022/08/20 by Yushun Zhang, Zhang, Yushun, Congliang Chen +7 · 10 citations
    Computer Science · Mathematics · Physics and Astronomy · #Stochastic Gradient Optimization Techniques #Markov Chains and Monte Carlo Methods #Statistical Mechanics and Entropy
  8. Preserving Diversity in Supervised Fine-Tuning of Large Language Models
    2024/08/29 by Ziniu Li, Congliang Chen, Li, Ziniu +11 · 15 citations
    Physics and Astronomy · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Magnetic confinement fusion research
  9. Improved Iteration Complexity Bounds of Cyclic Block Coordinate Descent for Convex Problems
    2015/12/15 by Ruoyu Sun, Sun, Ruoyu, Mingyi Hong +1 · 3 citations
    Computer Science · Engineering · Medicine · #Bone and Joint Diseases #Complexity and Algorithms in Graphs #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  10. Stability Analysis and Generalization Bounds of Adversarial Training
    2022/10/03 by Jiancong Xiao, Yanbo Fan, Xiao, Jiancong +7 · 5 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
  11. PDHG-Unrolled Learning-to-Optimize Method for Large-Scale Linear Programming
    2024/06/04 by Bingheng Li, Linxin Yang, Li, Bingheng +19 · 6 citations
    Computer Science · Engineering · #Advanced Algorithms and Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Metaheuristic Optimization Algorithms Research #Neural Networks and Applications #Optimization and Control (math.OC)
  12. Adversarial Rademacher Complexity of Deep Neural Networks
    2022/11/27 by Jiancong Xiao, Yanbo Fan, Xiao, Jiancong +5 · 3 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Anomaly Detection Techniques and Applications
  13. On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Method
    2021/01/01 by Dawei Li, Ruoyu Sun, Li, Dawei +1 · 2 citations
    Engineering · Mathematics · Computer Science · #Sparse and Compressive Sensing Techniques #Advanced Optimization Algorithms Research #Stochastic Gradient Optimization Techniques
  14. Understanding the Loss Surface of Neural Networks for Binary Classification
    2018/02/19 by Shiyu Liang, Liang, Shiyu, Ruoyu Sun +5 · 4 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications
  15. Global Convergence of MAML and Theory-Inspired Neural Architecture Search for Few-Shot Learning
    2022/03/17 by Haoxiang Wang, Yite Wang, Wang, Haoxiang +5 · 2 citations
    Computer Science · Biochemistry, Genetics and Molecular Biology · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Cancer-related molecular mechanisms research
  16. CoRT: Code-integrated Reasoning within Thinking
    2025/06/11 by Cheng‐Peng Li, Zhengyang Tang, Li, Chengpeng +19 · 7 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
  17. Combining Transformer based Deep Reinforcement Learning with Black-Litterman Model for Portfolio Optimization
    2024/02/23 by Ruoyu Sun, Sun, Ruoyu, Angelos Stefanidis +5 · 2 citations
    Decision Sciences · #Stock Market Forecasting Methods
  18. Does Momentum Change the Implicit Regularization on Separable Data?
    2021/10/08 by Bohan Wang, Wang, Bohan, Meng Qi +11 · 1 citation
    Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  19. MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning
    2024/07/30 by Yupeng Chen, S Wang, Chen, Yupeng +11 · 2 citations
    Engineering · Physics and Astronomy · #Advancements in Photolithography Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Magnetic confinement fusion research #Nuclear reactor physics and engineering
  20. SymILO: A Symmetry-Aware Learning Framework for Integer Linear Optimization
    2024/09/29 by Qian Chen, Tianjian Zhang, Chen, Qian +13 · 3 citations
    Computer Science · Engineering · #FOS: Mathematics #Fault Detection and Control Systems #Machine Learning and Algorithms #Neural Networks and Applications #Optimization and Control (math.OC)
  21. Balanced Training for Sparse GANs
    2023/02/28 by Yite Wang, Jing Wu, Wang, Yite +5 · 1 citation
    Computer Science · #Generative Adversarial Networks and Image Synthesis #Anomaly Detection Techniques and Applications #Digital Media Forensic Detection
  22. A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentiality
    2024/10/15 by Yihan Li, Huang, Hanbo, Bowen Jiang +10 · 1 citation
    Engineering · #Advanced Surface Polishing Techniques
  23. On the Convergence of Adam under Non-uniform Smoothness: Separability from SGDM and Beyond
    2024/03/22 by Bohan Wang, Wang, Bohan, Huishuai Zhang +9 · 1 citation
    Economics, Econometrics and Finance · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Mathematical Dynamics and Fractals #Mathematical and Theoretical Analysis #Optimization and Control (math.OC) #Stochastic processes and financial applications
  24. On Representing Convex Quadratically Constrained Quadratic Programs via Graph Neural Networks
    2024/11/21 by Chenyang Wu, Wu, Chenyang, Qian Chen +11 · 1 citation
    Computer Science · Engineering · Mathematics · #Advanced Control Systems Optimization #Advanced Optimization Algorithms Research #FOS: Mathematics #Machine Learning and Algorithms #Optimization and Control (math.OC)
  25. SLAI T-Rex: Full-Parameter Post-training of the DeepSeek-V4 Family on Ascend SuperPOD
    2026/07/22 by Dongfang Li, Xiaodong Luo, Ruoyu Sun +64
    Computer Science · #cs.AI #cs.CL