Kayhan Behdin
- ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models
2024/06/12 by Meng Xiang, Kayhan Behdin, Meng, Xiang +5 · 5 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- mSAM: Micro-Batch-Averaged Sharpness-Aware Minimization
2023/02/19 by Kayhan Behdin, Behdin, Kayhan, Qingquan Song +15 · 2 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- OSSCAR: One-Shot Structured Pruning in Vision and Language Models with Combinatorial Optimization
2024/03/02 by Meng Xiang, Shibal Ibrahim, Meng, Xiang +9 · 2 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Sparse NMF with Archetypal Regularization: Computational and Robustness Properties
2021/04/08 by Kayhan Behdin, Rahul Mazumder, Behdin, Kayhan +1 · 1 citation
Computer Science · Decision Sciences · Engineering · #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multi-Criteria Decision Making #Sparse and Compressive Sensing Techniques
- Improved Deep Neural Network Generalization Using m-Sharpness-Aware Minimization
2022/12/07 by Kayhan Behdin, Behdin, Kayhan, Qingquan Song +11 · 1 citation
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- On Statistical Properties of Sharpness-Aware Minimization: Provable Guarantees
2023/02/23 by Kayhan Behdin, Rahul Mazumder, Behdin, Kayhan +1 · 1 citation
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
- Scaling Down, Serving Fast: Compressing and Deploying Efficient LLMs for Recommendation Systems
2025/02/20 by Kayhan Behdin, Ata Fatahibaarzi, Behdin, Kayhan +36 · 2 citations
Computer Science · #Data Mining Algorithms and Applications #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Machine Learning and Data Classification #Semantic Web and Ontologies