vix.ing · top · new · best · stats · spec

Sanjeev Arora

  1. CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
    2024/06/26 by Zirui Wang, Mengzhou Xia, Wang, Zirui +23 · 1 voice · 75 citations
    Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Lexicography and Language Studies #Mathematics, Computing, and Information Processing #Natural Language Processing Techniques #cs.CL #cs.CV
  2. Fine-Tuning Language Models with Just Forward Passes
    2023/05/27 by Sadhika Malladi, Malladi, Sadhika, Tianyu Gao +11 · 1 voice · 44 citations
    Computer Science · Engineering · #Ferroelectric and Negative Capacitance Devices #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
  3. LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?
    2025/06/13 by Zihan Zheng, Zheng, Zihan, Zerui Cheng +35 · 8 voices · 17 citations
    #cs.SE #cs.AI #cs.CL #cs.LG
  4. Fine-Grained Analysis of Optimization and Generalization for\n Overparameterized Two-Layer Neural Networks
    2019/01/24 by Sanjeev Arora, Arora, Sanjeev, Simon S. Du +7 · 72 citations
    Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
  5. LESS: Selecting Influential Data for Targeted Instruction Tuning
    2024/02/06 by Mengzhou Xia, Xia, Mengzhou, Sadhika Malladi +7 · 83 citations
    Computer Science · #Intelligent Tutoring Systems and Adaptive Learning #Educational Technology and Assessment #Online Learning and Analytics
  6. A Theoretical Analysis of Contrastive Unsupervised Representation Learning
    2019/02/25 by Sanjeev Arora, Hrishikesh Khandeparkar, Arora, Sanjeev +7 · 52 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Machine Learning and Data Classification
  7. Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Proving
    2025/02/11 by Yong Lin, Lin, Yong, Shange Tang +19 · 2 voices · 29 citations
    #cs.LG #cs.AI
  8. Implicit Regularization in Deep Matrix Factorization
    2019/05/31 by Sanjeev Arora, Arora, Sanjeev, Nadav Cohen +5 · 30 citations
    Computer Science · Engineering · Mathematics · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #Numerical methods in inverse problems #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  9. Stronger generalization bounds for deep nets via a compression approach
    2018/02/14 by Sanjeev Arora, Rong Ge, Arora, Sanjeev +5 · 32 citations
    Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Stochastic Gradient Optimization Techniques
  10. On Exact Computation with an Infinitely Wide Neural Net
    2019/04/26 by Sanjeev Arora, Arora, Sanjeev, Simon S. Du +9 · 32 citations
    Computer Science · #Gaussian Processes and Bayesian Inference #Stochastic Gradient Optimization Techniques #Advanced Neural Network Applications
  11. An Exponential Learning Rate Schedule for Deep Learning
    2019/10/16 by Zhiyuan Li, Li, Zhiyuan, Sanjeev Arora +1 · 30 citations
    Computer Science · #Advanced Neural Network Applications #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
  12. Learning Topic Models - Going beyond SVD
    2012/04/09 by Sanjeev Arora, Arora, Sanjeev, Rong Ge +3 · 15 citations
    Computer Science · #Topic Modeling #Text and Document Classification Technologies #Advanced Text Analysis Techniques
  13. A Practical Algorithm for Topic Modeling with Provable Guarantees
    2012/12/19 by Sanjeev Arora, Arora, Sanjeev, Rong Ge +13 · 9 citations
    Computer Science · #Topic Modeling #Advanced Graph Neural Networks #Text and Document Classification Technologies
  14. Computing a Nonnegative Matrix Factorization -- Provably
    2011/11/03 by Sanjeev Arora, Arora, Sanjeev, Rong Ge +5 · 8 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #DNA and Biological Computing #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Quantum Computing Algorithms and Architecture #graph theory and CDMA systems
  15. An Analysis of the t-SNE Algorithm for Data Visualization
    2018/03/05 by Sanjeev Arora, Arora, Sanjeev, Wei Hu +3 · 11 citations
    Computer Science · #Advanced Clustering Algorithms Research #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topological and Geometric Data Analysis
  16. Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates
    2024/02/28 by Kaifeng Lyu, Lyu, Kaifeng, Haoyu Zhao +9 · 17 citations
    Business, Management and Accounting · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Taxation and Legal Issues
  17. Learning mixtures of separated nonspherical Gaussians
    2005/02/01 by Sanjeev Arora, Ravi Kannan · 6 citations
    Computer Science · Mathematics · #Bayesian Methods and Mixture Models #Data Management and Algorithms #Gaussian Processes and Bayesian Inference #math.PR #msc:62-07 #msc:62H30 #msc:62N02. #msc:68T05
  18. A Kernel-Based View of Language Model Fine-Tuning
    2022/10/11 by Sadhika Malladi, Alexander Wettig, Malladi, Sadhika +7 · 11 citations
    Computer Science · Medicine · #COVID-19 diagnosis using AI #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  19. InstaHide: Instance-hiding Schemes for Private Distributed Learning
    2020/10/06 by Yangsibo Huang, Huang, Yangsibo, Zhao Song +5 · 9 citations
    Computer Science · #Privacy-Preserving Technologies in Data #Adversarial Robustness in Machine Learning #Cryptography and Data Security
  20. Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
    2024/10/11 by Noam Razin, Sadhika Malladi, Razin, Noam +10 · 4 voices · 10 citations
    Economics, Econometrics and Finance · #Economic and Environmental Valuation
  21. A Theory for Emergence of Complex Skills in Language Models
    2023/07/29 by Sanjeev Arora, Anirudh Goyal, Arora, Sanjeev +1 · 2 voices · 8 citations
    Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #cs.AI #cs.CL #cs.LG #stat.ML
  22. AI-Assisted Generation of Difficult Math Questions
    2024/07/30 by Vedant Shah, Shah, Vedant, Dingli Yu +20 · 3 voices · 10 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Mathematics, Computing, and Information Processing #cs.AI #cs.LG
  23. ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficulty
    2024/08/26 by Xindi Wu, Dingli Yu, Wu, Xindi +7 · 14 citations
    Computer Science · #Image Retrieval and Classification Techniques
  24. What Happens after SGD Reaches Zero Loss? --A Mathematical Framework
    2021/10/13 by Zhiyuan Li, Tianhao Wang, Li, Zhiyuan +3 · 6 citations
    Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Stochastic Gradient Optimization Techniques
  25. On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)
    2021/02/24 by Zhiyuan Li, Li, Zhiyuan, Sadhika Malladi +3 · 7 citations
    Computer Science · #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
  26. Understanding Contrastive Learning Requires Incorporating Inductive Biases
    2022/02/28 by Nikunj Saunshi, Jordan T. Ash, Saunshi, Nikunj +13 · 6 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification
  27. Task-Specific Skill Localization in Fine-tuned Language Models
    2023/02/13 by Abhishek Panigrahi, Panigrahi, Abhishek, Nikunj Saunshi +5 · 7 citations
    Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  28. What Makes a Reward Model a Good Teacher? An Optimization Perspective
    2025/03/19 by Noam Razin, Razin, Noam, Zixuan Wang +8 · 20 citations
    Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Education and Islamic Studies #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  29. Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correction
    2025/08/05 by Yong Lin, Lin, Yong, Shange Tang +37 · 2 voices · 34 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.LG
  30. Finding Overlapping Communities in Social Networks: Toward a Rigorous Approach
    2011/12/08 by Sanjeev Arora, Rong Ge, Arora, Sanjeev +5 · 3 citations
    Physics and Astronomy · Computer Science · #Complex Network Analysis Techniques #Opinion Dynamics and Social Influence #Peer-to-Peer Network Technologies
  31. A Sample Complexity Separation between Non-Convex and Convex\n Meta-Learning
    2020/02/25 by Nikunj Saunshi, Saunshi, Nikunj, Yi Zhang +5 · 4 citations
    Computer Science · Engineering · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques
  32. Instruct-SkillMix: A Powerful Pipeline for LLM Instruction Tuning
    2024/08/27 by Simran Kaur, Kaur, Simran, Simon Park +5 · 7 citations
    Computer Science · Engineering · #Computation and Language (cs.CL) #Educational Technology and Assessment #Experimental Learning in Engineering #FOS: Computer and information sciences #Machine Learning (cs.LG)
  33. Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors
    2025/09/16 by Aniket Didolkar, Didolkar, Aniket, Nicolas Ballas +5 · 2 voices · 4 citations
    Computer Science · Social Sciences · #Artificial Intelligence in Law #Natural Language Processing Techniques #Semantic Web and Ontologies #cs.AI #cs.LG
  34. A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks
    2020/10/07 by Nikunj Saunshi, Sadhika Malladi, Saunshi, Nikunj +3 · 3 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Sentiment Analysis and Opinion Mining #Topic Modeling
  35. Provable Representation Learning for Imitation Learning via Bi-level Optimization
    2020/02/24 by Sanjeev Arora, Simon S. Du, Arora, Sanjeev +7 · 2 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
  36. Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent
    2022/07/08 by Zhiyuan Li, Tianhao Wang, Li, Zhiyuan +5 · 3 citations
    Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #FOS: Mathematics #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications #Optimization and Control (math.OC)
  37. Can Models Learn Skill Composition from Examples?
    2024/09/29 by Haoyu Zhao, Simran Kaur, Zhao, Haoyu +7 · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Natural Language Processing Techniques
  38. Advancing Science- and Evidence-based AI Policy
    2025/07/31 by Rishi Bommasani, Sanjeev Arora, Bommasani, Rishi +37 · 1 voice · 6 citations
    Medicine · Computer Science · #Computers and Society (cs.CY) #FOS: Computer and information sciences
  39. Why Are Convolutional Nets More Sample-Efficient than Fully-Connected Nets?
    2020/10/16 by Zhiyuan Li, Li, Zhiyuan, Yi Zhang +3 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms
  40. Why (and When) does Local SGD Generalize Better than SGD?
    2023/03/02 by Xinran Gu, Kaifeng Lyu, Gu, Xinran +5 · 2 citations
    Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Neural Networks and Applications #Statistical Methods and Inference
  41. Rethinking Thinking Tokens: LLMs as Improvement Operators
    2025/10/01 by Lovish Madaan, Madaan, Lovish, Aniket Didolkar +15 · 3 voices · 2 citations
    Business, Management and Accounting · Computer Science · Social Sciences · #Artificial Intelligence in Law #Business Process Modeling and Analysis #Digital Rights Management and Security #cs.AI #cs.LG
  42. TextHide: Tackling Data Privacy in Language Understanding Tasks
    2020/10/12 by Yangsibo Huang, Huang, Yangsibo, Zhao Song +7 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #Cryptography and Data Security #Cryptography and Security (cs.CR) #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Privacy-Preserving Technologies in Data #Topic Modeling
  43. Provable ICA with Unknown Gaussian Noise, and Implications for Gaussian\n Mixtures and Autoencoders
    2012/06/22 by Sanjeev Arora, Rong Ge, Arora, Sanjeev +5 · 1 citation
    Computer Science · Engineering · #Blind Source Separation Techniques #Machine Learning and Algorithms #Sparse and Compressive Sensing Techniques
  44. Language Models as Science Tutors
    2024/02/16 by Alexis Chevalier, Jiayi Geng, Chevalier, Alexis +40 · 2 citations
    Psychology · Computer Science · #Innovative Teaching and Learning Methods #Intelligent Tutoring Systems and Adaptive Learning
  45. On Predicting Generalization using GANs
    2021/11/28 by Yi Zhang, Arushi Gupta, Zhang, Yi +5 · 1 citation
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
  46. On the Power of Context-Enhanced Learning in LLMs
    2025/03/03 by Xingyu Zhu, Zhu, Xingyu, Abinash Panigrahi +3 · 3 citations
    Computer Science · #Topic Modeling #Adversarial Robustness in Machine Learning #Machine Learning and Algorithms
  47. Adaptive Gradient Methods with Local Guarantees
    2022/03/02 by Lu Zhou, Wenhan Xia, Lu, Zhou +5 · 1 citation
    Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  48. Provable unlearning in topic modeling and downstream tasks
    2024/11/19 by Stanley Wei, Sadhika Malladi, Wei, Stanley +4 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  49. Weak-to-Strong Generalization Even in Random Feature Networks, Provably
    2025/03/04 by Kaifeng Lyu, Medvedev, Marko, Dingli Yu +8 · 1 citation
    Computer Science · #Face and Expression Recognition #Neural Networks and Applications #Anomaly Detection Techniques and Applications
  50. T2MLR: Transformer with Temporal Middle-Layer Recurrence
    2026/07/16 by Ziyang Cai, Xingyu Zhu, Yihe Dong +2
    #cs.CL #cs.AI