Mingyi Hong
- Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering
2016/10/15 by Bo Yang, Yang, Bo, Xiao Fu +5 · 37 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Face and Expression Recognition #Human Pose and Action Recognition #Machine Learning (cs.LG)
- Is One Layer Enough? Training A Single Transformer Layer Can Match Full-Parameter RL Training
2026/07/01 by Zijian Zhang, Rizhen Hu, Athanasios Glentis +4 · 17 voices
#cs.LG #cs.CL
- Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problems
2014/10/06 by Mingyi Hong, Hong, Mingyi, Zhi‐Quan Luo +3 · 23 citations
Computer Science · Engineering · #Advanced Adaptive Filtering Techniques #Direction-of-Arrival Estimation Techniques #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques
- On the Linear Convergence of the Alternating Direction Method of Multipliers
2012/08/20 by Mingyi Hong, Zhi‐Quan Luo, Hong, Mingyi +1 · 14 citations
Computer Science · Engineering · #49 #90 #Advanced Adaptive Filtering Techniques #Direction-of-Arrival Estimation Techniques #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Statistics Theory (math.ST)
- On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization
2018/08/08 by Xiangyi Chen, Sijia Liu, Chen, Xiangyi +5 · 16 citations
Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural Networks and Applications #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- A Unified Algorithmic Framework for Block-Structured Optimization Involving Big Data: With applications in machine learning and signal processing
2015/12/25 by Mingyi Hong, Meisam Razaviyayn, Zhi-Quan Luo +3 · 18 citations
Engineering · Computer Science · Mathematics · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications
- ZO-AdaMM: Zeroth-Order Adaptive Momentum Method for Black-Box\n Optimization
2019/10/14 by Xiangyi Chen, Chen, Xiangyi, Sijia Liu +11 · 16 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Iteration Complexity Analysis of Block Coordinate Descent Methods
2013/10/25 by Mingyi Hong, Hong, Mingyi, Xiangfeng Wang +5 · 16 citations
Engineering · Computer Science · Mathematics · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Advanced Optimization Algorithms Research
- A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum
2021/02/15 by Prashant Khanduri, Siliang Zeng, Khanduri, Prashant +9 · 15 citations
Computer Science · Engineering · Medicine · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Pancreatic and Hepatic Oncology Research
- Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
2024/02/18 by Yihua Zhang, Pingzhi Li, Zhang, Yihua +23 · 22 citations
Computer Science · Engineering · Mathematics · #Advanced Control Systems Design #Computation and Language (cs.CL) #Digital Filter Design and Implementation #FOS: Computer and information sciences #Machine Learning (cs.LG) #Numerical methods for differential equations
- A Survey of Recent Advances in Optimization Methods for Wireless Communications
2024/01/22 by Ya‐Feng Liu, Liu, Ya-Feng, Tsung‐Hui Chang +11 · 18 citations
Engineering · #Advanced MIMO Systems Optimization #Antenna Design and Optimization #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Information Theory (cs.IT) #Millimeter-Wave Propagation and Modeling #Optimization and Control (math.OC) #Signal Processing (eess.SP) #electronic engineering #information engineering
- Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy
2021/06/25 by Xinwei Zhang, Zhang, Xinwei, Xiangyi Chen +7 · 8 citations
Computer Science · Social Sciences · #Cryptography and Data Security #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- Decentralized Riemannian Gradient Descent on the Stiefel Manifold
2021/02/14 by Shixiang Chen, Chen, Shixiang, Alfredo García +5 · 9 citations
Computer Science · #Distributed Control Multi-Agent Systems #Neural Networks Stability and Synchronization #Stochastic Gradient Optimization Techniques
- An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning
2023/08/01 by Yihua Zhang, Zhang, Yihua, Prashant Khanduri +9 · 12 citations
Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #Complexity and Algorithms in Graphs #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques
- Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMs
2025/02/13 by Siyan Zhao, Mingyi Hong, Zhao, Siyan +7 · 25 citations
Computer Science · Social Sciences · #Data Mining Algorithms and Applications #Semantic Web and Ontologies #Artificial Intelligence in Law
- Distributed Learning in the Nonconvex World: From batch data to streaming and beyond
2020/05/01 by Tsung-Hui Chang, Mingyi Hong, Hoi-To Wai +2 · 7 citations
Computer Science · #Stochastic Gradient Optimization Techniques #Distributed Sensor Networks and Detection Algorithms #Privacy-Preserving Technologies in Data
- Reinforcing Multi-Turn Reasoning in LLM Agents via Turn-Level Reward Design
2025/05/17 by Siliang Zeng, Wei, Quan, Zeng, Siliang +17 · 34 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Advancing Model Pruning via Bi-level Optimization
2022/10/08 by Yihua Zhang, Yuguang Yao, Zhang, Yihua +13 · 9 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining
2024/06/04 by Andi Han, Jiaxiang Li, Han, Andi +11 · 12 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Face and Expression Recognition #Image and Signal Denoising Methods #Machine Learning (cs.LG) #Sparse and Compressive Sensing Techniques
- Towards LLM Unlearning Resilient to Relearning Attacks: A Sharpness-Aware Minimization Perspective and Beyond
2025/02/07 by Chongyu Fan, Fan, Chongyu, Jinghan Jia +8 · 20 citations
Computer Science · #Cloud Data Security Solutions #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Security and Intrusion Detection #Privacy-Preserving Technologies in Data
- STEM: A Stochastic Two-Sided Momentum Algorithm Achieving Near-Optimal Sample and Communication Complexities for Federated Learning
2021/06/19 by Prashant Khanduri, Pranay Sharma, Khanduri, Prashant +11 · 5 citations
Computer Science · Engineering · #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #Wireless Communication Security Techniques
- Inference-Time Alignment of Diffusion Models with Direct Noise Optimization
2024/05/29 by Zhiwei Tang, Jiangweizhi Peng, Tang, Zhiwei +9 · 9 citations
Physics and Astronomy · Computer Science · #Model Reduction and Neural Networks #Advanced Mathematical Modeling in Engineering
- Improved Iteration Complexity Bounds of Cyclic Block Coordinate Descent for Convex Problems
2015/12/15 by Ruoyu Sun, Mingyi Hong, Sun, Ruoyu +1 · 3 citations
Computer Science · Engineering · Medicine · #Bone and Joint Diseases #Complexity and Algorithms in Graphs #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- On the Global Convergence of Imitation Learning: A Case for Linear Quadratic Regulator
2019/01/11 by Mingyi Hong, Cai, Qi, Yongxin Chen +4 · 4 citations
Computer Science · Decision Sciences · Physics and Astronomy · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Optimization and Control (math.OC) #Reinforcement Learning in Robotics
- Maximum-Likelihood Inverse Reinforcement Learning with Finite-Time Guarantees
2022/10/04 by Siliang Zeng, Chenliang Li, Zeng, Siliang +5 · 4 citations
Computer Science · #Adaptive Dynamic Programming Control #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
- Zeroth Order Nonconvex Multi-Agent Optimization over Networks
2017/10/27 by Davood Hajinezhad, Mingyi Hong, Hajinezhad, Davood +3 · 4 citations
Computer Science · Engineering · #Advanced MIMO Systems Optimization #Cooperative Communication and Network Coding #Distributed Control Multi-Agent Systems #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- FedBCD: A Communication-Efficient Collaborative Learning Framework for Distributed Features
2022/01/01 by Yang Liu, Xinwei Zhang, Yan Kang +4 · 2 citations
Computer Science · #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #Advanced Graph Neural Networks
- Learning to Beamform in Heterogeneous Massive MIMO Networks
2020/11/08 by Minghe Zhu, Tsung‐Hui Chang, Zhu, Minghe +3 · 2 citations
Engineering · #Advanced MIMO Systems Optimization #Millimeter-Wave Propagation and Modeling #Antenna Design and Optimization
- How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspective
2022/03/27 by Yimeng Zhang, Zhang, Yimeng, Yuguang Yao +11 · 2 citations
Computer Science · Medicine · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Cardiac Arrest and Resuscitation #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Muon Outperforms Adam in Tail-End Associative Memory Learning
2025/09/30 by Shuche Wang, Wang, Shuche, Fengzhuo Zhang +17 · 1 voice · 7 citations
Engineering · Physics and Astronomy · #Muon and positron interactions and applications #Particle Detector Development and Performance #Particle physics theoretical and experimental studies #cs.AI #cs.LG #math.OC
- DiSK: Differentially Private Optimizer with Simplified Kalman Filter for Noise Reduction
2024/10/04 by Xinwei Zhang, Zhiqi Bu, Zhang, Xinwei +9 · 4 citations
Engineering · #Advanced Adaptive Filtering Techniques #Advanced Wireless Communication Techniques #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Power Line Communications and Noise
- Linear Transceiver Design for a MIMO Interfering Broadcast Channel Achieving Max-Min Fairness
2012/08/31 by Meisam Razaviyayn, Mingyi Hong, Razaviyayn, Meisam +3 · 1 citation
Computer Science · Engineering · #Advanced MIMO Systems Optimization #Advanced Wireless Network Optimization #Cooperative Communication and Network Coding #FOS: Computer and information sciences #Information Theory (cs.IT)
- BRiTE: Bootstrapping Reinforced Thinking Process to Enhance Language Model Reasoning
2025/01/31 by Han Zhong, Zhong, Han, Y.‐Z. Yin +22 · 5 citations
Computer Science · #Natural Language Processing Techniques
- Unlearning as multi-task optimization: A normalized gradient difference approach with an adaptive learning rate
2024/10/29 by Zhiqi Bu, Bu, Zhiqi, Xiaomeng Jin +11 · 4 citations
Computer Science · #Neural Networks and Applications
- On Faster Convergence of Cyclic Block Coordinate Descent-type Methods for Strongly Convex Minimization
2016/07/10 by Xingguo Li, Li, Xingguo, Tuo Zhao +7 · 1 citation
Mathematics · Computer Science · #Advanced Optimization Algorithms Research #Optimization and Variational Analysis #Iterative Methods for Nonlinear Equations
- Krylov Cubic Regularized Newton: A Subspace Second-Order Method with Dimension-Free Convergence Rate
2024/01/05 by Ruichen Jiang, Parameswaran Raman, Jiang, Ruichen +9 · 2 citations
Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- A Bayesian Approach to Robust Inverse Reinforcement Learning
2023/09/15 by Ran Wei, Siliang Zeng, Wei, Ran +9 · 2 citations
Computer Science · #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
- Differentially Private SGD Without Clipping Bias: An Error-Feedback Approach
2023/11/24 by Xinwei Zhang, Zhiqi Bu, Zhang, Xinwei +5 · 2 citations
Computer Science · Mathematics · #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Random Matrices and Applications #Stochastic Gradient Optimization Techniques
- BLUR: A Bi-Level Optimization Approach for LLM Unlearning
2025/06/09 by Hadi Reisizadeh, Jinghan Jia, Reisizadeh, Hadi +15 · 6 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Pre-training Differentially Private Models with Limited Public Data
2024/02/28 by Zhiqi Bu, Bu, Zhiqi, Xinwei Zhang +7 · 2 citations
Computer Science · Decision Sciences · #Privacy-Preserving Technologies in Data #Auction Theory and Applications
- Unraveling the Gradient Descent Dynamics of Transformers
2024/11/12 by Bingqing Song, Song, Bingqing, Boran Han +7 · 3 citations
Engineering · Materials Science · Physics and Astronomy · #Characterization and Applications of Magnetic Nanoparticles #Diamond and Carbon-based Materials Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Micro and Nano Robotics #Optimization and Control (math.OC)
- Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning
2023/10/13 by Yihua Zhang, Zhang, Yihua, Yimeng Zhang +15 · 2 citations
Computer Science · #Advanced Neural Network Applications #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- First-Order Algorithms Without Lipschitz Gradient: A Sequential Local Optimization Approach
2020/10/07 by Junyu Zhang, Zhang, Junyu, Mingyi Hong +1 · 1 citation
Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Tensor decomposition and applications
- Penalty Dual Decomposition Method For Nonsmooth Nonconvex Optimization
2017/12/13 by Qingjiang Shi, Mingyi Hong, Shi, Qingjiang +5 · 2 citations
Engineering · Mathematics · Computer Science · #Sparse and Compressive Sensing Techniques #Advanced Optimization Algorithms Research #Blind Source Separation Techniques
- Decomposing Linearly Constrained Nonconvex Problems by a Proximal Primal Dual Approach: Algorithms, Convergence, and Applications
2016/04/02 by Mingyi Hong, Hong, Mingyi · 2 citations
Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Online Proximal-ADMM For Time-varying Constrained Convex Optimization
2020/05/07 by Yijian Zhang, Emiliano Dall’Anese, Zhang, Yijian +3 · 1 citation
Computer Science · Engineering · #Advanced MIMO Systems Optimization #Distributed Control Multi-Agent Systems #FOS: Electrical engineering #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Systems and Control (eess.SY) #electronic engineering #information engineering
- Primal-Dual First-Order Methods for Affinely Constrained Multi-Block Saddle Point Problems
2021/09/29 by Junyu Zhang, Mengdi Wang, Zhang, Junyu +5 · 1 citation
Computer Science · Engineering · Mathematics · #Advanced Multi-Objective Optimization Algorithms #Advanced Optimization Algorithms Research #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques
- Learning to Coordinate in Multi-Agent Systems: A Coordinated Actor-Critic Algorithm and Finite-Time Guarantees
2021/10/11 by Siliang Zeng, Tianyi Chen, Zeng, Siliang +5 · 1 citation
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multiagent Systems (cs.MA) #Reinforcement Learning in Robotics
- Zeroth-Order SciML: Non-intrusive Integration of Scientific Software with Deep Learning
2022/06/04 by Ioannis Tsaknakis, Bhavya Kailkhura, Tsaknakis, Ioannis +11 · 1 citation
Computer Science · Decision Sciences · Materials Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Machine Learning in Materials Science #Scientific Computing and Data Management
- Joint Base Station Clustering and Beamformer Design for Partial Coordinated Transmission in Heterogenous Networks
2012/03/28 by Mingyi Hong, Ruoyu Sun, Hong, Mingyi +5 · 1 citation
Engineering · #Advanced MIMO Systems Optimization #Energy Harvesting in Wireless Networks #FOS: Computer and information sciences #Information Theory (cs.IT) #Millimeter-Wave Propagation and Modeling
- NESTT: A Nonconvex Primal-Dual Splitting Method for Distributed and Stochastic Optimization
2016/05/25 by Davood Hajinezhad, Mingyi Hong, Hajinezhad, Davood +5 · 2 citations
Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization
2025/10/23 by Zijian Zhang, Rong Wang, Zhang, Zijian +8 · 4 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Learning Reward and Policy Jointly from Demonstration and Preference Improves Alignment
2024/06/11 by Chenliang Li, Li, Chenliang, Siliang Zeng +11 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Data Stream Mining Techniques #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Robotics (cs.RO)
- MuonBP: Faster Muon via Block-Periodic Orthogonalization
2025/10/19 by Ahmed Khaled, Kaan Ozkara, Khaled, Ahmed +7 · 5 citations
Engineering · Chemistry · Computer Science · #Muon and positron interactions and applications #Advanced NMR Techniques and Applications #Computational Physics and Python Applications
- Style4Rec: Enhancing Transformer-based E-commerce Recommendation Systems with Style and Shopping Cart Information
2025/01/16 by Berke Ugurlu, Ugurlu, Berke, Mingyi Hong +3 · 1 citation
Business, Management and Accounting · Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Customer churn and segmentation #Digital Marketing and Social Media #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Recommender Systems and Techniques
- Stochastic Proximal Gradient Consensus Over Random Networks
2015/11/28 by Mingyi Hong, Hong, Mingyi, Tsung‐Hui Chang +1 · 1 citation
Computer Science · Engineering · #Distributed Control Multi-Agent Systems #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques
- Barzilai-Borwein Fails Superlinear Convergence on an Open Set of Quadratics for Every Dimension n≥ 4
2026/07/23 by Dawei Li, Xiaotian Jiang, Mingyi Hong
#math.OC #cs.AI #cs.LG