Roger Grosse
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
2024/01/10 by Evan Hubinger, Carson Denison, Hubinger, Evan +77 · 18 voices · 99 citations
Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Ethics and Social Impacts of AI #Topic Modeling #cs.AI #cs.CL #cs.CR #cs.LG #cs.SE
- Kronfluence: Influence Functions with Eigenvalue-corrected Kronecker-Factored Approximate Curvature
2023/08/07 by Roger Grosse, Juhan Bae, Grosse, Roger +31 · 3 voices · 49 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- Governance Architecture for Neural Network Superposition: A Structural Solution to Hallucination via Routing and Interference Filtering
2022/09/21 by Nelson Elhage, Elhage, Nelson, Tristan Hume +29 · 2 voices · 139 citations
Computer Science · Physics and Astronomy · #Explainable Artificial Intelligence (XAI) #Model Reduction and Neural Networks #Neural Networks and Applications #cs.LG
- Optimizing Neural Networks with Kronecker-factored Approximate Curvature
2015/03/19 by James Martens, Martens, James, Roger Grosse +1 · 102 citations
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE) #Stochastic Gradient Optimization Techniques
- Importance Weighted Autoencoders
2015/09/01 by Yuri Burda, Roger Grosse, Burda, Yuri +3 · 1 voice · 27 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Machine Learning in Healthcare #cs.LG #stat.ML
- Discovering Language Model Behaviors with Model-Written Evaluations
2022/12/19 by Ethan Perez, Sam Ringer, Perez, Ethan +123 · 120 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- The Reversible Residual Network: Backpropagation Without Storing Activations
2017/07/14 by Aidan N. Gomez, Mengye Ren, Gomez, Aidan N. +5 · 21 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning
- Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation
2017/08/17 by Yuhuai Wu, Wu, Yuhuai, Elman Mansimov +7 · 30 citations
Computer Science · Engineering · #Adaptive Dynamic Programming Control #Advanced Memory and Neural Computing #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
- If Influence Functions are the Answer, Then What is the Question?
2022/09/12 by Juhan Bae, Nathan Ng, Bae, Juhan +7 · 22 citations
Computer Science · Materials Science · Physics and Astronomy · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning in Materials Science #Model Reduction and Neural Networks #Neural Networks and Applications
- Sorting out Lipschitz function approximation
2018/11/13 by Cem Anil, James Lucas, Anil, Cem +3 · 15 citations
Computer Science · Engineering · #Advanced Image Processing Techniques #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sparse and Compressive Sensing Techniques
- Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batches
2018/03/12 by Yeming Wen, Paul Vicol, Wen, Yeming +7 · 18 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Stochastic Gradient Optimization Techniques
- A Kronecker-factored approximate Fisher matrix for convolution layers
2016/02/03 by Roger Grosse, Grosse, Roger, James Martens +1 · 12 citations
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Stochastic Gradient Optimization Techniques
- Three Mechanisms of Weight Decay Regularization
2018/10/29 by Guodong Zhang, Zhang, Guodong, Chaoqi Wang +5 · 15 citations
Computer Science · #Neural Networks and Applications #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques
- Don't Blame the ELBO! A Linear VAE Perspective on Posterior Collapse
2019/11/06 by James Lucas, Lucas, James, George Tucker +5 · 10 citations
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image and Signal Denoising Methods #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks
- Statistical Inference, Learning and Models in Big Data
2015/09/09 by Beate Franke, Jean-François Plante, Jean‐François Plante +13 · 1 voice · 1 citation
Computer Science · Mathematics · #Gaussian Processes and Bayesian Inference #Data Analysis with R #Statistical Methods and Inference
- Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model
2019/07/09 by Guodong Zhang, Zhang, Guodong, Lala Li +13 · 9 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- Noisy Natural Gradient as Variational Inference
2017/12/06 by Guodong Zhang, Zhang, Guodong, Shengyang Sun +5 · 7 citations
Computer Science · #Machine Learning and Algorithms #Gaussian Processes and Bayesian Inference #Machine Learning and Data Classification
- Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo
2024/04/26 by Zhao, Stephen, Rob Brekelmans, Alireza Makhzani +4 · 8 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- Reversible Recurrent Neural Networks
2018/10/25 by Matthew Mackay, Paul Vicol, MacKay, Matthew +5 · 8 citations
Computer Science · #Neural Networks and Applications #Advanced Neural Network Applications #Time Series Analysis and Forecasting
- When Does Preconditioning Help or Hurt Generalization?
2020/06/18 by Шун-ичи Амари, Jimmy Ba, Amari, Shun-ichi +13 · 4 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Sparse and Compressive Sensing Techniques
- Differentiable Annealed Importance Sampling and the Perils of Gradient Noise
2021/07/21 by Guodong Zhang, Kyle Hsu, Zhang, Guodong +7 · 3 citations
Computer Science · Mathematics · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Statistical Methods and Inference
- Training Data Attribution via Approximate Unrolled Differentiation
2024/05/20 by Juhan Bae, Wu Lin, Bae, Juhan +5 · 6 citations
Computer Science · #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification
- Understanding and Mitigating Exploding Inverses in Invertible Neural\n Networks
2020/06/16 by Jens Behrmann, Behrmann, Jens, Paul Vicol +7 · 2 citations
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning
2021/01/15 by Yuhuai Wu, Markus N. Rabe, Wu, Yuhuai +9 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Logic in Computer Science (cs.LO) #Machine Learning (cs.LG) #Neural Networks and Applications #Topic Modeling
- Connecting the Dots: LLMs can Infer and Verbalize Latent Structure from Disparate Training Data
2024/06/20 by Johannes Treutlein, Treutlein, Johannes, Dami Choi +12 · 4 voices
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- Differentiable Compositional Kernel Learning for Gaussian Processes
2018/06/12 by Shengyang Sun, Sun, Shengyang, Guodong Zhang +9 · 1 citation
Computer Science · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Time Series Analysis and Forecasting
- A Unified Analysis of First-Order Methods for Smooth Games via Integral Quadratic Constraints
2020/09/23 by Guodong Zhang, Zhang, Guodong, Xuchan Bao +5 · 1 citation
Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Analyzing Monotonic Linear Interpolation in Neural Network Loss Landscapes
2021/04/22 by James Lucas, Lucas, James, Juhan Bae +9 · 1 citation
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Stochastic Gradient Optimization Techniques
- Similarity-based cooperative equilibrium
2022/11/26 by Caspar Oesterheld, Johannes Treutlein, Oesterheld, Caspar +7 · 1 citation
Decision Sciences · Social Sciences · #91A10 (Primary) 91A05 91A26 91A35 (Secondary) #Artificial Intelligence (cs.AI) #Computer Science and Game Theory (cs.GT) #Evolutionary Game Theory and Cooperation #Experimental Behavioral Economics Studies #FOS: Computer and information sciences #Game Theory and Applications #I.2.11 #Machine Learning (cs.LG) #Multiagent Systems (cs.MA)
- Forecasting Rare Language Model Behaviors
2025/02/24 by Meg Tong, Jones, Erik, Tong, Meg +16 · 2 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification