Thrampoulidis, Christos
- Transformers as Support Vector Machines
2023/08/31 by Davoud Ataee Tarzanagh, Tarzanagh, Davoud Ataee, Yingcong Li +5 · 5 voices · 5 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
- Imbalance Trouble: Revisiting Neural-Collapse Geometry
2022/08/10 by Christos Thrampoulidis, Ganesh Ramachandra Kini, Thrampoulidis, Christos +5 · 7 citations
Computer Science · #Digital Imaging for Blood Diseases #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications
- Linear Stochastic Bandits Under Safety Constraints
2019/08/16 by Sanae Amani, Amani, Sanae, Mahnoosh Alizadeh +3 · 5 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Reinforcement Learning in Robotics
- The Gaussian min-max theorem in the Presence of Convexity
2014/08/20 by Christos Thrampoulidis, Thrampoulidis, Christos, Samet Oymak +3 · 4 citations
Computer Science · Engineering · #Blind Source Separation Techniques #FOS: Computer and information sciences #FOS: Mathematics #Image and Signal Denoising Methods #Information Theory (cs.IT) #Probability (math.PR) #Sparse and Compressive Sensing Techniques
- On the Role of Attention in Prompt-tuning
2023/06/06 by Oymak, Samet, Rawat, Ankit Singh, Soltanolkotabi, Mahdi +1 · 6 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Provable Benefits of Overparameterization in Model Compression: From Double Descent to Pruning Neural Networks
2020/12/16 by Chang, Xiangyu, Li, Yingcong, Oymak, Samet +1 · 4 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Memorization Capacity of Multi-Head Attention in Transformers
2023/06/03 by Sadegh Mahdavi, Mahdavi, Sadegh, Renjie Liao +3 · 5 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG)
- A Model of Double Descent for High-dimensional Binary Linear Classification
2019/11/13 by Deng, Zeyu, Kammoun, Abla, Thrampoulidis, Christos · 3 citations
#FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Signal Processing (eess.SP) #electronic engineering #information engineering
- Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data
2025/02/07 by Fan Chen, Mark Schmidt, Fan, Chen +3 · 9 citations
Computer Science · Business, Management and Accounting · #Face and Expression Recognition #Customer churn and segmentation #Imbalanced Data Classification Techniques
- Unlocking the Potential of Prompt-Tuning in Bridging Generalized and Personalized Federated Learning
2023/10/27 by Deng, Wenlong, Thrampoulidis, Christos, Li, Xiaoxiao · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- On the Optimization and Generalization of Multi-head Attention
2023/10/19 by Deora, Puneesh, Ghaderi, Rouzbeh, Taheri, Hossein +1 · 4 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- The Generalized Lasso for Sub-gaussian Measurements with Dithered Quantization
2018/07/18 by Thrampoulidis, Christos, Rawat, Ankit Singh · 2 citations
#FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Information Theory (cs.IT) #Signal Processing (eess.SP) #Statistics Theory (math.ST) #electronic engineering #information engineering
- On the Effect of Negative Gradient in Group Relative Deep Reinforcement Optimization
2025/05/24 by Wenlong Deng, Deng, Wenlong, Yi Ren +9 · 14 citations
Social Sciences · #Advanced Computing and Algorithms #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Simple Bounds for Noisy Linear Inverse Problems with Exact Side Information
2013/12/02 by Samet Oymak, Oymak, Samet, Christos Thrampoulidis +3 · 3 citations
Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Optimization and Control (math.OC) #Photoacoustic and Ultrasonic Imaging #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Statistics Theory (math.ST)
- Generalization and Stability of Interpolating Neural Networks with Minimal Width
2023/02/18 by Hossein Taheri, Christos Thrampoulidis, Taheri, Hossein +1 · 3 citations
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
- Leveraging Online Olympiad-Level Math Problems for LLMs Training and Contamination-Resistant Evaluation
2025/01/24 by Mahdavi, Sadegh, Li, Muchen, Liu, Kaiwen +3 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Towards Better Out-of-Distribution Generalization of Neural Algorithmic Reasoning Tasks
2022/11/01 by Mahdavi, Sadegh, Swersky, Kevin, Kipf, Thomas +3 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Implicit Bias and Fast Convergence Rates for Self-attention
2024/02/08 by Bhavya Vasudeva, Puneesh Deora, Vasudeva, Bhavya +3 · 3 citations
Neuroscience · #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- The Squared-Error of Generalized LASSO: A Precise Analysis
2013/11/04 by Oymak, Samet, Thrampoulidis, Christos, Hassibi, Babak · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Precise Error Analysis of Regularized M-estimators in High-dimensions
2016/01/23 by Christos Thrampoulidis, Ehsan Abbasi, Thrampoulidis, Christos +3 · 1 citation
Computer Science · Engineering · #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Microwave Imaging and Scattering Analysis #Sparse and Compressive Sensing Techniques #Statistics Theory (math.ST)
- On the Implicit Geometry of Cross-Entropy Parameterizations for Label-Imbalanced Data
2023/03/14 by Tina Behnia, Behnia, Tina, Ganesh Ramachandra Kini +5 · 2 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Industrial Vision Systems and Defect Detection #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Engineering the Neural Collapse Geometry of Supervised-Contrastive Loss
2023/10/02 by Gill, Jaidev, Vakilian, Vala, Thrampoulidis, Christos · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Implicit Optimization Bias of Next-Token Prediction in Linear Models
2024/02/28 by Christos Thrampoulidis, Thrampoulidis, Christos · 2 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
- Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations
2024/08/27 by Yize Zhao, Tina Behnia, Zhao, Yize +5 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Analytic Study of Double Descent in Binary Classification: The Impact of\n Loss
2020/01/30 by Ganesh Ramachandra Kini, Kini, Ganesh, Christos Thrampoulidis +1 · 1 citation
Computer Science · Mathematics · #Machine Learning and Data Classification #Domain Adaptation and Few-Shot Learning #Statistical Methods and Inference
- Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods
2024/10/13 by Taheri, Hossein, Thrampoulidis, Christos, Mazumdar, Arya · 3 citations
#FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Optimal Combination of Linear and Spectral Estimators for Generalized\n Linear Models
2020/08/07 by Marco Mondelli, Christos Thrampoulidis, Mondelli, Marco +3 · 1 citation
Computer Science · Engineering · #Blind Source Separation Techniques #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sparse and Compressive Sensing Techniques #Statistics Theory (math.ST)
- Binary Classification of Gaussian Mixtures: Abundance of Support Vectors, Benign Overfitting and Regularization
2020/11/18 by Ke Wang, Wang, Ke, Christos Thrampoulidis +1 · 1 citation
Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification #Statistics Theory (math.ST)
- Asymptotic Behavior of Adversarial Training in Binary Classification
2020/10/26 by Taheri, Hossein, Pedarsani, Ramtin, Thrampoulidis, Christos · 1 citation
#FOS: Computer and information sciences #FOS: Electrical engineering #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Signal Processing (eess.SP) #electronic engineering #information engineering
- Theoretical Insights Into Multiclass Classification: A High-dimensional Asymptotic View
2020/11/16 by Christos Thrampoulidis, Samet Oymak, Thrampoulidis, Christos +3 · 1 citation
Computer Science · Mathematics · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Statistical Methods and Inference #Statistics Theory (math.ST)
- UCB-based Algorithms for Multinomial Logistic Regression Bandits
2021/03/21 by Amani, Sanae, Thrampoulidis, Christos · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Sharp global convergence guarantees for iterative nonconvex optimization: A Gaussian process perspective
2021/09/20 by Chandrasekher, Kabir Aladin, Pananjady, Ashwin, Thrampoulidis, Christos · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Probability (math.PR) #Statistics Theory (math.ST)
- Safe Linear Thompson Sampling with Side Information
2019/11/06 by Moradipari, Ahmadreza, Amani, Sanae, Alizadeh, Mahnoosh +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level Optimization
2023/05/30 by Fan Chen, Gaspard Choné-Ducasse, Fan, Chen +5 · 1 citation
Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Machine Learning and ELM
- Geometry of Semantics in Next-Token Prediction: How Optimization Implicitly Organizes Linguistic Representations
2025/05/13 by Zhao, Yize, Thrampoulidis, Christos · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Label-Imbalanced and Group-Sensitive Classification under Overparameterization
2021/03/02 by Ganesh Ramachandra Kini, Orestis Paraskevas, Kini, Ganesh Ramachandra +5 · 1 citation
Computer Science · #FOS: Computer and information sciences #Face and Expression Recognition #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Text and Document Classification Technologies
- DARE the Extreme: Revisiting Delta-Parameter Pruning For Fine-Tuned Models
2024/10/12 by Deng, Wenlong, Zhao, Yize, Vakilian, Vala +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Next-token prediction capacity: general upper bounds and a lower bound for transformers
2024/05/22 by Liam Madden, Curtis Fox, Madden, Liam +3 · 1 citation
Engineering · Materials Science · #15A03 #26B35 #Advancements in Photolithography Techniques #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning in Materials Science #Optimization and Control (math.OC) #Semiconductor materials and devices
- On GRPO Collapse in Search-R1: The Lazy Likelihood-Displacement Death Spiral
2025/12/03 by Deng, Wenlong, Li, Yushu, Gong, Boying +3 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- How Muon's Spectral Design Benefits Generalization: A Study on Imbalanced Data
2025/10/27 by Vasudeva, Bhavya, Deora, Puneesh, Zhao, Yize +2 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)