Christopher De Sa
- QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks
2024/02/06 by Albert Tseng, Tseng, Albert, Jerry Chee +8 · 1 voice · 115 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Cryptography and Data Security #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
- QuIP: 2-Bit Quantization of Large Language Models With Guarantees
2023/07/25 by Jerry Chee, Chee, Jerry, Yaohui Cai +6 · 1 voice · 94 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.LG
- Extracting memorized pieces of (copyrighted) books from open-weight language models
2025/05/18 by A. Feder Cooper, Cooper, A. Feder, Mark A. Lemley +16 · 28 voices · 17 citations
Computer Science · Social Sciences · #Artificial Intelligence in Law #Explainable Artificial Intelligence (XAI) #Expression (computer science) #Generative grammar #Generative model #Law, AI, and Intellectual Property #Memorization #Natural language #Probabilistic logic
- Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy and Research
2024/12/09 by A. Feder Cooper, Cooper, A. Feder, Christopher A. Choquette-Choo +75 · 5 voices · 21 citations
Computer Science · Psychology · Social Sciences · #Artificial intelligence #Computer science #Ethics and Social Impacts of AI #Explainable Artificial Intelligence (XAI) #Generative grammar #Political science #Psychology #cs.AI #cs.CY #cs.LG
- Representation Tradeoffs for Hyperbolic Embeddings
2018/04/10 by Christopher De, Christopher De Sa, De Sa, Christopher +7 · 30 citations
Computer Science · Engineering · Mathematics · #Advanced Numerical Analysis Techniques #FOS: Computer and information sciences #Guidance and Control Systems #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Mathematical Dynamics and Fractals #cs.LG #stat.ML
- Parallel SGD: When does averaging help?
2016/06/23 by Jian Zhang, Christopher De, Zhang, Jian +6 · 22 citations
Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Stochastic Gradient Optimization Techniques #cs.LG #stat.ML
- Improving Neural Network Quantization without Retraining using Outlier Channel Splitting
2019/01/28 by Ritchie Zhao, Yuwei Hu, Zhao, Ritchie +8 · 15 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- Neural Manifold Ordinary Differential Equations
2020/06/18 by Aaron Lou, Lou, Aaron, Derek Lim +12 · 14 citations
Computer Science · Engineering · Mathematics · Physics and Astronomy · #3D Shape Modeling and Analysis #Differential Geometry (math.DG) #FOS: Computer and information sciences #FOS: Mathematics #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #cs.LG #math.DG #stat.ML
- Optimal Complexity in Decentralized Training
2020/06/15 by Yucheng Lu, Christopher De Sa, Christopher De +2 · 13 citations
Computer Science · Mathematics · #Distributed Control Multi-Agent Systems #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #cs.LG #stat.ML
- A Kernel Theory of Modern Data Augmentation
2018/03/16 by Tri Dao, Dao, Tri, Albert Gu +11 · 11 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #cs.LG #stat.ML
- High-Accuracy Low-Precision Training
2018/03/09 by Christopher De Sa, Christopher De, De Sa, Christopher +12 · 19 citations
Computer Science · Engineering · Mathematics · Medicine · #3D Shape Modeling and Analysis #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Medical Imaging and Analysis #Radiomics and Machine Learning in Medical Imaging #cs.LG #stat.ML
- Global Convergence of Stochastic Gradient Descent for Some Non-convex Matrix Problems
2014/11/04 by Christopher De, Christopher De Sa, De Sa, Christopher +4 · 12 citations
Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Matrix Theory and Algorithms #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #cs.LG #math.OC #stat.ML
- Channel Gating Neural Networks
2018/05/29 by Weizhe Hua, Hua, Weizhe, Yuan Zhou +8 · 9 citations
Computer Science · Mathematics · #Anomaly Detection Techniques and Applications #Neural Networks and Applications #Video Surveillance and Tracking Methods #cs.CV #cs.LG #stat.ML
- Understanding Hyperdimensional Computing for Parallel Single-Pass Learning
2022/02/10 by Tao Yu, Changyuan Yu, Yu, Tao +7 · 1 voice · 3 citations
Computer Science · Engineering · Materials Science · Physics and Astronomy · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Magnetic properties of thin films #Multiferroics and related materials #Neural and Evolutionary Computing (cs.NE) #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG #cs.NE
- Differentiating through the Fréchet Mean
2020/02/29 by Aaron Lou, Lou, Aaron, Isay Katsman +10 · 7 citations
Computer Science · Mathematics · #Advanced Graph Neural Networks #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Morphological variations and asymmetry #Topological and Geometric Data Analysis #cs.LG #stat.ML
- Taming the Wild: A Unified Analysis of Hogwild!-Style Algorithms
2015/06/22 by Christopher De Sa, Christopher De, De Sa, Christopher +6 · 7 citations
Computer Science · Mathematics · #Artificial Intelligence in Games #Constraint Satisfaction and Optimization #Data Management and Algorithms #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #cs.LG #math.OC #stat.ML
- SWALP : Stochastic Weight Averaging in Low-Precision Training
2019/04/26 by Guandao Yang, Yang, Guandao, Tianyi Zhang +10 · 5 citations
Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #cs.AI #cs.LG #stat.ML
- PipeMare: Asynchronous Pipeline Parallel DNN Training
2019/10/09 by Bowen Yang, Jian Zhang, Yang, Bowen +10 · 6 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC) #cs.DC #cs.LG #stat.ML
- Scan Order in Gibbs Sampling: Models in Which it Matters and Bounds on How Much
2016/06/10 by Bryan He, He, Bryan, Christopher De Sa +5 · 3 citations
Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.AI #cs.LG #stat.ML
- Gaussian Quadrature for Kernel Features
2017/09/08 by Tri Dao, Christopher De, Dao, Tri +4 · 3 citations
Computer Science · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques #cs.LG
- Equivariant Manifold Flows
2021/07/19 by Isay Katsman, Katsman, Isay, Aaron Lou +9 · 3 citations
Computer Science · Mathematics · #Differential Geometry (math.DG) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #math.DG #stat.ML
- Incremental Knowledge Base Construction Using DeepDive
2015/02/03 by Jaeho Shin, Shin, Jaeho, Sen Wu +10 · 2 citations
Computer Science · Decision Sciences · #Computation and Language (cs.CL) #Currency Recognition and Detection #Data Quality and Management #Databases (cs.DB) #FOS: Computer and information sciences #Geochemistry and Geologic Mapping #Machine Learning (cs.LG) #cs.CL #cs.DB #cs.LG
- Ensuring Rapid Mixing and Low Bias for Asynchronous Gibbs Sampling
2016/02/24 by Christopher De Sa, Christopher De, De Sa, Christopher +4 · 2 citations
Computer Science · Mathematics · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Machine Learning (cs.LG) #Markov Chains and Monte Carlo Methods #Stochastic processes and statistical mechanics #cs.LG
- ModuLoRA: Finetuning 2-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers
2023/09/28 by Junjie Yin, Jiahao Dong, Yin, Junjie +8 · 1 voice · 1 citation
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.LG
- Model-Preserving Adaptive Rounding
2025/05/29 by Albert Tseng, Tseng, Albert, Zhaofeng Sun +3 · 2 voices · 1 citation
Computer Science · #cs.LG #cs.AI
- Variance Reduced Training with Stratified Sampling for Forecasting Models
2021/03/02 by Yucheng Lu, Lu, Yucheng, Youngsuk Park +11 · 2 citations
Computer Science · Decision Sciences · Mathematics · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Forecasting Techniques and Applications #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Stock Market Forecasting Methods #cs.LG #stat.ML
- A Two Pronged Progress in Structured Dense Matrix Multiplication
2016/11/04 by Christopher De Sa, Christopher De, De Sa, Christopher +8 · 3 citations
Computer Science · Mathematics · #Coding theory and cryptography #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Polynomial and algebraic computation #Tensor decomposition and applications #cs.DS
- Moniqua: Modulo Quantized Communication in Decentralized SGD
2020/02/26 by Yucheng Lu, Christopher De, Lu, Yucheng +2 · 2 citations
Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #cs.LG #stat.ML
- Minibatch Gibbs Sampling on Large Graphical Models
2018/06/15 by Christopher De Sa, Vincent Chen, De Sa, Christopher +3 · 1 citation
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- Optimizing JPEG Quantization for Classification Networks
2020/03/05 by Zhijing Li, Li, Zhijing, Christopher De Sa +3 · 1 citation
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Graphics (cs.GR) #Image and Video Processing (eess.IV) #Performance (cs.PF) #cs.CV #cs.GR #cs.PF #eess.IV #electronic engineering #information engineering
- How Low Can We Go: Trading Memory for Error in Low-Precision Training
2021/06/17 by Chengrun Yang, Ziyang Wu, Yang, Chengrun +8 · 1 citation
Computer Science · Physics and Astronomy · #Advanced Multi-Objective Optimization Algorithms #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Model Reduction and Neural Networks #cs.AI #cs.LG
- Revisiting BFloat16 Training
2020/10/13 by Pedram Zamirai, Jian Zhang, Zamirai, Pedram +6 · 1 citation
Computer Science · Mathematics · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics #cs.LG #stat.ML
- A Formal Framework For Probabilistic Unclean Databases
2018/01/21 by Christopher De Sa, De Sa, Christopher, Ihab F. Ilyas +7 · 1 voice
Computer Science · #Databases (cs.DB) #FOS: Computer and information sciences #cs.DB
- Poisson-Minibatching for Gibbs Sampling with Convergence Rate Guarantees
2019/11/21 by Ruqi Zhang, Christopher De, Zhang, Ruqi +2 · 1 citation
Computer Science · Mathematics · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Markov Chains and Monte Carlo Methods #cs.LG #stat.ML