vix.ing · top · new · best · stats · spec

Oymak, Samet

  1. Transformers as Support Vector Machines
    2023/08/31 by Davoud Ataee Tarzanagh, Tarzanagh, Davoud Ataee, Yingcong Li +5 · 5 voices · 5 citations
    Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
  2. Mechanics of Next Token Prediction with Self-Attention
    2024/03/12 by Yingcong Li, Yixiao Huang, Li, Yingcong +7 · 2 voices · 5 citations
    Engineering · #Metallurgy and Material Forming #Robotic Mechanisms and Dynamics
  3. Transformers as Algorithms: Generalization and Stability in In-context Learning
    2023/01/17 by Yingcong Li, Li, Yingcong, M. Emrullah Ildiz +5 · 25 citations
    Computer Science · #Machine Learning and Algorithms #Gaussian Processes and Bayesian Inference #Machine Learning and Data Classification
  4. Towards moderate overparameterization: global convergence guarantees for training shallow neural networks
    2019/02/12 by Samet Oymak, Mahdi Soltanolkotabi, Oymak, Samet +1 · 22 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Advanced Neural Network Applications #Machine Learning and Algorithms
  5. Generalization Guarantees for Neural Networks via Harnessing the Low-rank Structure of the Jacobian
    2019/06/12 by Samet Oymak, Oymak, Samet, Zalan Fabian +5 · 14 citations
    Physics and Astronomy · Computer Science · Engineering · #Model Reduction and Neural Networks #Neural Networks and Applications #Sparse and Compressive Sensing Techniques
  6. Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks
    2024/02/06 by Park, Jongho, Park, Jaeseung, Xiong, Zheyang +5 · 14 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  7. Non-asymptotic Identification of LTI Systems from a Single Trajectory
    2018/06/14 by Oymak, Samet, Ozay, Necmiye · 4 citations
    #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Systems and Control (eess.SY) #electronic engineering #information engineering
  8. The Gaussian min-max theorem in the Presence of Convexity
    2014/08/20 by Thrampoulidis, Christos, Oymak, Samet, Hassibi, Babak · 4 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Probability (math.PR)
  9. On the Role of Attention in Prompt-tuning
    2023/06/06 by Oymak, Samet, Rawat, Ankit Singh, Soltanolkotabi, Mahdi +1 · 6 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  10. Provable Benefits of Overparameterization in Model Compression: From Double Descent to Pruning Neural Networks
    2020/12/16 by Chang, Xiangyu, Li, Yingcong, Oymak, Samet +1 · 4 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  11. From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers
    2024/02/21 by M. Emrullah Ildiz, Yixiao Huang, Ildiz, M. Emrullah +7 · 7 citations
    Computer Science · #Reinforcement Learning in Robotics
  12. Overparameterized Nonlinear Learning: Gradient Descent Takes the Shortest Path?
    2018/12/25 by Samet Oymak, Oymak, Samet, Mahdi Soltanolkotabi +1 · 3 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  13. Selective Attention: Enhancing Transformer through Principled Context Control
    2024/11/19 by Xuechen Zhang, Zhang, Xuechen, Xiangyu Chang +10 · 1 voice · 6 citations
    Psychology · #cs.LG #cs.CL
  14. Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond
    2024/07/13 by Yingcong Li, Ankit Singh Rawat, Li, Yingcong +3 · 7 citations
    Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  15. Non-asymptotic and Accurate Learning of Nonlinear Dynamical Systems
    2020/02/20 by Yahya Sattar, Samet Oymak, Sattar, Yahya +1 · 3 citations
    Computer Science · Engineering · Physics and Astronomy · #Applications (stat.AP) #Control Systems and Identification #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Optimization and Control (math.OC) #Systems and Control (eess.SY) #electronic engineering #information engineering
  16. Efficient Contextual LLM Cascades through Budget-Constrained Policy Learning
    2024/04/17 by Zhang, Xuechen, Huang, Zijian, Taga, Ege Onur +3 · 6 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  17. Retrieval Augmented Time Series Forecasting
    2024/11/12 by Kutay Tire, Tire, Kutay, Ege Onur Taga +5 · 8 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Time Series Analysis and Forecasting
  18. Unsupervised Multi-source Domain Adaptation Without Access to Source Data
    2021/04/05 by Ahmed, Sk Miraj, Raychaudhuri, Dripta S., Paul, Sujoy +2 · 3 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  19. High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws
    2024/10/24 by M. Emrullah Ildiz, Ildiz, M. Emrullah, Halil Alperen Gozeten +7 · 8 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications
  20. Continuous Chain of Thought Enables Parallel Exploration and Reasoning
    2025/05/29 by Gozeten, Halil Alperen, Ildiz, M. Emrullah, Zhang, Xuechen +3 · 11 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  21. Provable and Efficient Continual Representation Learning
    2022/03/03 by Li, Yingcong, Li, Mingchen, Asif, M. Salman +1 · 3 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  22. Finite Sample Identification of Bilinear Dynamical Systems
    2022/08/29 by Yahya Sattar, Sattar, Yahya, Samet Oymak +3 · 3 citations
    Engineering · Physics and Astronomy · Computer Science · #Control Systems and Identification #Model Reduction and Neural Networks #Gaussian Processes and Bayesian Inference
  23. Gradient Descent with Early Stopping is Provably Robust to Label Noise for Overparameterized Neural Networks
    2019/03/27 by Li, Mingchen, Soltanolkotabi, Mahdi, Oymak, Samet · 2 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  24. TimePFN: Effective Multivariate Time Series Forecasting with Synthetic Data
    2025/02/22 by Ege Onur Taga, M. Emrullah Ildiz, Taga, Ege Onur +3 · 8 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Time Series Analysis and Forecasting
  25. BREAD: Branched Rollouts from Expert Anchors Bridge SFT & RL for Reasoning
    2025/06/20 by Zhang, Xuechen, Huang, Zijian, Li, Yingcong +3 · 11 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  26. Max-Margin Token Selection in Attention Mechanism
    2023/06/23 by Davoud Ataee Tarzanagh, Yingcong Li, Tarzanagh, Davoud Ataee +5 · 3 citations
    Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
  27. Effective Restoration of Source Knowledge in Continual Test Time Adaptation
    2023/11/08 by Fahim Faisal Niloy, Sk Miraj Ahmed, Niloy, Fahim Faisal +7 · 3 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Cancer-related molecular mechanisms research #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
  28. Simple Bounds for Noisy Linear Inverse Problems with Exact Side Information
    2013/12/02 by Samet Oymak, Oymak, Samet, Christos Thrampoulidis +3 · 2 citations
    Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Optimization and Control (math.OC) #Photoacoustic and Ultrasonic Imaging #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Statistics Theory (math.ST)
  29. Simultaneously Structured Models with Application to Sparse and Low-rank Matrices
    2012/12/16 by Oymak, Samet, Jalali, Amin, Fazel, Maryam +2 · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Optimization and Control (math.OC)
  30. The Squared-Error of Generalized LASSO: A Precise Analysis
    2013/11/04 by Oymak, Samet, Thrampoulidis, Christos, Hassibi, Babak · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  31. Can Transformers Learn Optimal Filtering for Unknown Systems?
    2023/08/16 by Balim, Haldun, Du, Zhe, Oymak, Samet +1 · 2 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Systems and Control (eess.SY) #electronic engineering #information engineering
  32. Sharp Time--Data Tradeoffs for Linear Inverse Problems
    2015/07/16 by Oymak, Samet, Recht, Benjamin, Soltanolkotabi, Mahdi · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Statistics Theory (math.ST)
  33. Isometric sketching of any set via the Restricted Isometry Property
    2015/06/11 by Oymak, Samet, Recht, Benjamin, Soltanolkotabi, Mahdi · 1 citation
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (stat.ML) #Probability (math.PR) #Statistics Theory (math.ST)
  34. Parallel Correlation Clustering on Big Graphs
    2015/07/17 by Pan, Xinghao, Papailiopoulos, Dimitris, Oymak, Samet +3 · 1 citation
    #Data Structures and Algorithms (cs.DS) #Distributed #FOS: Computer and information sciences #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC)
  35. Universality laws for randomized dimension reduction, with applications
    2015/11/30 by Oymak, Samet, Tropp, Joel A. · 1 citation
    #60D05 #60F17 (Primary) 60B20 (Secondary) #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (stat.ML) #Probability (math.PR) #Statistics Theory (math.ST)
  36. Near-Optimal Bounds for Binary Embeddings of Arbitrary Sets
    2015/12/14 by Oymak, Samet, Recht, Ben · 1 citation
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Functional Analysis (math.FA) #Machine Learning (cs.LG)
  37. Near-Optimal Sample Complexity Bounds for Circulant Binary Embedding
    2016/03/10 by Oymak, Samet · 1 citation
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences
  38. Stochastic Gradient Descent Learns State Equations with Nonlinear Activations
    2018/09/09 by Oymak, Samet · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  39. Extrapolation by Association: Length Generalization Transfer in Transformers
    2025/06/10 by Cai, Ziyang, Nayoung Lee, Avi Schwarzschild +6 · 5 citations
    Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Language and cultural evolution #Multimodal Machine Learning Applications #Topic Modeling
  40. On the Marginal Benefit of Active Learning: Does Self-Supervision Eat Its Cake?
    2020/11/16 by Yao-Chun Chan, Chan, Yao-Chun, Mingchen Li +3 · 1 citation
    Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Multimodal Machine Learning Applications
  41. Theoretical Insights Into Multiclass Classification: A High-dimensional Asymptotic View
    2020/11/16 by Christos Thrampoulidis, Thrampoulidis, Christos, Samet Oymak +3 · 1 citation
    Computer Science · Mathematics · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Statistical Methods and Inference #Statistics Theory (math.ST)
  42. On the Power of Convolution Augmented Transformer
    2024/07/08 by Li, Mingchen, Zhang, Xuechen, Huang, Yixiao +1 · 2 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
  43. Everything Everywhere All at Once: LLMs can In-Context Learn Multiple Tasks in Superposition
    2024/10/08 by Xiong, Zheyang, Cai, Ziyang, Cooper, John +11 · 2 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  44. Certainty Equivalent Quadratic Control for Markov Jump Systems
    2021/05/26 by Du, Zhe, Sattar, Yahya, Tarzanagh, Davoud Ataee +3 · 1 citation
    #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Systems and Control (eess.SY) #electronic engineering #information engineering
  45. Non-Stationary Representation Learning in Sequential Linear Bandits
    2022/01/13 by Yuzhen Qin, Qin, Yuzhen, Tommaso Menara +7 · 1 citation
    Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Data Stream Mining Techniques #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Systems and Control (eess.SY) #electronic engineering #information engineering
  46. Dissecting Chain-of-Thought: Compositionality through In-Context Filtering and Learning
    2023/05/30 by Li, Yingcong, Sreenivasan, Kartik, Giannou, Angeliki +2 · 1 citation
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  47. Label-Imbalanced and Group-Sensitive Classification under Overparameterization
    2021/03/02 by Ganesh Ramachandra Kini, Kini, Ganesh Ramachandra, Orestis Paraskevas +5 · 1 citation
    Computer Science · #FOS: Computer and information sciences #Face and Expression Recognition #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Text and Document Classification Technologies
  48. FedYolo: Augmenting Federated Learning with Pretrained Transformers
    2023/07/10 by Xuechen Zhang, Mingchen Li, Zhang, Xuechen +11 · 1 citation
    Computer Science · #Privacy-Preserving Technologies in Data #Recommender Systems and Techniques #Age of Information Optimization
  49. Learning Compact Neural Networks with Regularization
    2018/02/05 by Samet Oymak, Oymak, Samet · 1 citation
    Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
  50. Provable Benefits of Task-Specific Prompts for In-context Learning
    2025/03/03 by Chang, Xiangyu, Li, Yingcong, Kara, Muti +2 · 2 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  51. Making Small Language Models Efficient Reasoners: Intervention, Supervision, Reinforcement
    2025/05/12 by Xuechen Zhang, Zhang, Xuechen, Chun‐Lin Ni +8 · 3 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling
  52. Test-Time Training Provably Improves Transformers as In-context Learners
    2025/03/14 by Gozeten, Halil Alperen, Ildiz, M. Emrullah, Zhang, Xuechen +3 · 2 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  53. Gating is Weighting: Understanding Gated Linear Attention through In-context Learning
    2025/04/06 by Li, Yingcong, Tarzanagh, Davoud Ataee, Rawat, Ankit Singh +2 · 2 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  54. When and How Unlabeled Data Provably Improve In-Context Learning
    2025/06/18 by Yingcong Li, Xiangyu Chang, Li, Yingcong +8 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification #Optimization and Control (math.OC)