vix.ing · top · new · best · stats · spec

Sun, Ruoyu

  1. ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models
    2023/10/16 by Ziniu Li, Li, Ziniu, Tian Xu +10 · 44 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
  2. On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization
    2018/08/08 by Chen, Xiangyi, Liu, Sijia, Sun, Ruoyu +1 · 11 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  3. Adam-mini: Use Fewer Learning Rates To Gain More
    2024/06/24 by Yushun Zhang, Zhang, Yushun, Congliang Chen +14 · 22 citations
    Computer Science · Engineering · #Advanced Adaptive Filtering Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music and Audio Processing
  4. AceGPT, Localizing Large Language Models in Arabic
    2023/09/21 by Huang Huang, Huang, Huang, F. Richard Yu +36 · 16 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques
  5. A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems
    2020/10/29 by Jiawei Zhang, Zhang, Jiawei, Peijun Xiao +5 · 11 citations
    Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Domain Adaptation and Few-Shot Learning
  6. Why Transformers Need Adam: A Hessian Perspective
    2024/02/26 by Yushun Zhang, Congliang Chen, Zhang, Yushun +9 · 17 citations
    Physics and Astronomy · #Space Science and Extraterrestrial Life
  7. A GNN-Guided Predict-and-Search Framework for Mixed-Integer Linear Programming
    2023/02/11 by Han, Qingyu, Yang, Linxin, Chen, Qian +5 · 10 citations
    #FOS: Mathematics #Optimization and Control (math.OC)
  8. Preserving Diversity in Supervised Fine-Tuning of Large Language Models
    2024/08/29 by Ziniu Li, Li, Ziniu, Congliang Chen +11 · 15 citations
    Physics and Astronomy · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Magnetic confinement fusion research
  9. Max-Sliced Wasserstein Distance and its use for GANs
    2019/04/11 by Deshpande, Ishan, Hu, Yuan-Ting, Sun, Ruoyu +6 · 5 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  10. Adam Can Converge Without Any Modification On Update Rules
    2022/08/20 by Yushun Zhang, Congliang Chen, Zhang, Yushun +7 · 6 citations
    Computer Science · Mathematics · Physics and Astronomy · #Stochastic Gradient Optimization Techniques #Markov Chains and Monte Carlo Methods #Statistical Mechanics and Entropy
  11. Stability Analysis and Generalization Bounds of Adversarial Training
    2022/10/03 by Jiancong Xiao, Yanbo Fan, Xiao, Jiancong +7 · 5 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
  12. Towards a Better Global Loss Landscape of GANs
    2020/11/10 by Sun, Ruoyu, Fang, Tiantian, Schwing, Alex · 3 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  13. PDHG-Unrolled Learning-to-Optimize Method for Large-Scale Linear Programming
    2024/06/04 by Bingheng Li, Li, Bingheng, Linxin Yang +19 · 6 citations
    Computer Science · Engineering · #Advanced Algorithms and Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Metaheuristic Optimization Algorithms Research #Neural Networks and Applications #Optimization and Control (math.OC)
  14. Adversarial Rademacher Complexity of Deep Neural Networks
    2022/11/27 by Jiancong Xiao, Xiao, Jiancong, Yanbo Fan +5 · 3 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Anomaly Detection Techniques and Applications
  15. Distilling Object Detectors with Task Adaptive Regularization
    2020/06/23 by Sun, Ruoyu, Tang, Fuhui, Zhang, Xiaopeng +2 · 2 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  16. On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Method
    2021/01/01 by Dawei Li, Li, Dawei, Ruoyu Sun +1 · 2 citations
    Engineering · Mathematics · Computer Science · #Sparse and Compressive Sensing Techniques #Advanced Optimization Algorithms Research #Stochastic Gradient Optimization Techniques
  17. Global Convergence of MAML and Theory-Inspired Neural Architecture Search for Few-Shot Learning
    2022/03/17 by Haoxiang Wang, Wang, Haoxiang, Yite Wang +5 · 2 citations
    Computer Science · Biochemistry, Genetics and Molecular Biology · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Cancer-related molecular mechanisms research
  18. Improved Iteration Complexity Bounds of Cyclic Block Coordinate Descent for Convex Problems
    2015/12/15 by Sun, Ruoyu, Hong, Mingyi · 1 citation
    #FOS: Mathematics #Optimization and Control (math.OC)
  19. Understanding the Loss Surface of Neural Networks for Binary Classification
    2018/02/19 by Shiyu Liang, Ruoyu Sun, Liang, Shiyu +5 · 2 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications
  20. LEMON: Lossless model expansion
    2023/10/12 by Wang, Yite, Su, Jiahao, Lu, Hanlin +6 · 2 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  21. CoRT: Code-integrated Reasoning within Thinking
    2025/06/11 by Cheng‐Peng Li, Li, Chengpeng, Zhengyang Tang +19 · 7 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
  22. Adding One Neuron Can Eliminate All Bad Local Minima
    2018/05/22 by Liang, Shiyu, Sun, Ruoyu, Lee, Jason D. +1 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  23. On the Benefit of Width for Neural Networks: Disappearance of Bad Basins
    2018/12/28 by Li, Dawei, Ding, Tian, Sun, Ruoyu · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  24. When GNNs meet symmetry in ILPs: an orbit-based feature augmentation approach
    2025/01/24 by Chen, Qian, Li, Lei, Li, Qian +6 · 3 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  25. Combining Transformer based Deep Reinforcement Learning with Black-Litterman Model for Portfolio Optimization
    2024/02/23 by Ruoyu Sun, Angelos Stefanidis, Sun, Ruoyu +5 · 2 citations
    Decision Sciences · #Stock Market Forecasting Methods
  26. Optimization for deep learning: theory and algorithms
    2019/12/19 by Sun, Ruoyu · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  27. SymILO: A Symmetry-Aware Learning Framework for Integer Linear Optimization
    2024/09/29 by Chen, Qian, Zhang, Tianjian, Yang, Linxin +5 · 3 citations
    #FOS: Mathematics #Optimization and Control (math.OC)
  28. Does Momentum Change the Implicit Regularization on Separable Data?
    2021/10/08 by Wang, Bohan, Meng, Qi, Zhang, Huishuai +4 · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  29. MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning
    2024/07/30 by Yupeng Chen, S Wang, Chen, Yupeng +11 · 2 citations
    Engineering · Physics and Astronomy · #Advancements in Photolithography Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Magnetic confinement fusion research #Nuclear reactor physics and engineering
  30. DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Data
    2022/11/27 by Fang, Tiantian, Sun, Ruoyu, Schwing, Alex · 1 citation
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  31. RealCritic: Towards Effectiveness-Driven Evaluation of Language Model Critiques
    2025/01/24 by Tang, Zhengyang, Li, Ziniu, Xiao, Zhenyang +8 · 2 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  32. NTK-SAP: Improving neural network pruning by aligning training dynamics
    2023/04/06 by Wang, Yite, Li, Dawei, Sun, Ruoyu · 1 citation
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  33. How Graph Neural Networks Learn: Lessons from Training Dynamics
    2023/10/08 by Yang, Chenxiao, Wu, Qitian, Wipf, David +2 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  34. A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentiality
    2024/10/15 by Yihan Li, Huang, Hanbo, Bowen Jiang +10 · 1 citation
    Engineering · #Advanced Surface Polishing Techniques
  35. Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives
    2025/05/27 by Liu, Yajiao, Chen, Congliang, Yang, Junchi +1 · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  36. On Representing Convex Quadratically Constrained Quadratic Programs via Graph Neural Networks
    2024/11/21 by Chenyang Wu, Wu, Chenyang, Qian Chen +11 · 1 citation
    Computer Science · Engineering · Mathematics · #Advanced Control Systems Optimization #Advanced Optimization Algorithms Research #FOS: Mathematics #Machine Learning and Algorithms #Optimization and Control (math.OC)
  37. Teaching Language Models to Reason with Tools
    2025/10/23 by Li, Chengpeng, Tang, Zhengyang, Li, Ziniu +8 · 1 citation
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences