Samet Oymak
- Transformers as Support Vector Machines
2023/08/31 by Davoud Ataee Tarzanagh, Tarzanagh, Davoud Ataee, Yingcong Li +5 · 5 voices · 5 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
- Mechanics of Next Token Prediction with Self-Attention
2024/03/12 by Yingcong Li, Yixiao Huang, Li, Yingcong +7 · 2 voices · 5 citations
Engineering · #Metallurgy and Material Forming #Robotic Mechanisms and Dynamics
- Transformers as Algorithms: Generalization and Stability in In-context Learning
2023/01/17 by Yingcong Li, Li, Yingcong, M. Emrullah Ildiz +5 · 25 citations
Computer Science · #Machine Learning and Algorithms #Gaussian Processes and Bayesian Inference #Machine Learning and Data Classification
- Towards moderate overparameterization: global convergence guarantees for training shallow neural networks
2019/02/12 by Samet Oymak, Oymak, Samet, Mahdi Soltanolkotabi +1 · 22 citations
Computer Science · #Stochastic Gradient Optimization Techniques #Advanced Neural Network Applications #Machine Learning and Algorithms
- Generalization Guarantees for Neural Networks via Harnessing the Low-rank Structure of the Jacobian
2019/06/12 by Samet Oymak, Oymak, Samet, Zalan Fabian +5 · 14 citations
Physics and Astronomy · Computer Science · Engineering · #Model Reduction and Neural Networks #Neural Networks and Applications #Sparse and Compressive Sensing Techniques
- From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers
2024/02/21 by M. Emrullah Ildiz, Ildiz, M. Emrullah, Yixiao Huang +7 · 7 citations
Computer Science · #Reinforcement Learning in Robotics
- Overparameterized Nonlinear Learning: Gradient Descent Takes the Shortest Path?
2018/12/25 by Samet Oymak, Mahdi Soltanolkotabi, Oymak, Samet +1 · 3 citations
Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Selective Attention: Enhancing Transformer through Principled Context Control
2024/11/19 by Xuechen Zhang, Xiangyu Chang, Zhang, Xuechen +10 · 1 voice · 6 citations
Psychology · #cs.LG #cs.CL
- Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond
2024/07/13 by Yingcong Li, Ankit Singh Rawat, Li, Yingcong +3 · 7 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Non-asymptotic and Accurate Learning of Nonlinear Dynamical Systems
2020/02/20 by Yahya Sattar, Sattar, Yahya, Samet Oymak +1 · 3 citations
Computer Science · Engineering · Physics and Astronomy · #Applications (stat.AP) #Control Systems and Identification #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Optimization and Control (math.OC) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Retrieval Augmented Time Series Forecasting
2024/11/12 by Kutay Tire, Ege Onur Taga, Tire, Kutay +5 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Time Series Analysis and Forecasting
- High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws
2024/10/24 by M. Emrullah Ildiz, Halil Alperen Gozeten, Ildiz, M. Emrullah +7 · 8 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications
- Finite Sample Identification of Bilinear Dynamical Systems
2022/08/29 by Yahya Sattar, Sattar, Yahya, Samet Oymak +3 · 3 citations
Engineering · Physics and Astronomy · Computer Science · #Control Systems and Identification #Model Reduction and Neural Networks #Gaussian Processes and Bayesian Inference
- TimePFN: Effective Multivariate Time Series Forecasting with Synthetic Data
2025/02/22 by Ege Onur Taga, M. Emrullah Ildiz, Taga, Ege Onur +3 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Time Series Analysis and Forecasting
- Max-Margin Token Selection in Attention Mechanism
2023/06/23 by Davoud Ataee Tarzanagh, Tarzanagh, Davoud Ataee, Yingcong Li +5 · 3 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- Effective Restoration of Source Knowledge in Continual Test Time Adaptation
2023/11/08 by Fahim Faisal Niloy, Niloy, Fahim Faisal, Sk Miraj Ahmed +7 · 3 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cancer-related molecular mechanisms research #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Simple Bounds for Noisy Linear Inverse Problems with Exact Side Information
2013/12/02 by Samet Oymak, Christos Thrampoulidis, Oymak, Samet +3 · 2 citations
Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Optimization and Control (math.OC) #Photoacoustic and Ultrasonic Imaging #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Statistics Theory (math.ST)
- Extrapolation by Association: Length Generalization Transfer in Transformers
2025/06/10 by Nayoung Lee, Cai, Ziyang, Lee, Nayoung +6 · 5 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Language and cultural evolution #Multimodal Machine Learning Applications #Topic Modeling
- On the Marginal Benefit of Active Learning: Does Self-Supervision Eat Its Cake?
2020/11/16 by Yao-Chun Chan, Chan, Yao-Chun, Mingchen Li +3 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Multimodal Machine Learning Applications
- Theoretical Insights Into Multiclass Classification: A High-dimensional Asymptotic View
2020/11/16 by Christos Thrampoulidis, Samet Oymak, Thrampoulidis, Christos +3 · 1 citation
Computer Science · Mathematics · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Statistical Methods and Inference #Statistics Theory (math.ST)
- Non-Stationary Representation Learning in Sequential Linear Bandits
2022/01/13 by Yuzhen Qin, Tommaso Menara, Qin, Yuzhen +7 · 1 citation
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Data Stream Mining Techniques #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Label-Imbalanced and Group-Sensitive Classification under Overparameterization
2021/03/02 by Ganesh Ramachandra Kini, Kini, Ganesh Ramachandra, Orestis Paraskevas +5 · 1 citation
Computer Science · #FOS: Computer and information sciences #Face and Expression Recognition #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Text and Document Classification Technologies
- FedYolo: Augmenting Federated Learning with Pretrained Transformers
2023/07/10 by Xuechen Zhang, Zhang, Xuechen, Mingchen Li +11 · 1 citation
Computer Science · #Privacy-Preserving Technologies in Data #Recommender Systems and Techniques #Age of Information Optimization
- Learning Compact Neural Networks with Regularization
2018/02/05 by Samet Oymak, Oymak, Samet · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
- Making Small Language Models Efficient Reasoners: Intervention, Supervision, Reinforcement
2025/05/12 by Xuechen Zhang, Zhang, Xuechen, Chun‐Lin Ni +8 · 3 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- When and How Unlabeled Data Provably Improve In-Context Learning
2025/06/18 by Yingcong Li, Li, Yingcong, Xiangyu Chang +8 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification #Optimization and Control (math.OC)