Jaehoon Lee
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
2024/03/08 by Gemini Robotics Team, Petko Georgiev, Gemini Team +2277 · 4 voices · 964 citations
Computer Science · #Semantic Web and Ontologies
- Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
2024/08/06 by Charlie Snell, Jaehoon Lee, Jae‐Hoon Lee +6 · 9 voices · 628 citations
Engineering · Physics and Astronomy · #Magnetic confinement fusion research #Nuclear reactor physics and engineering #Particle Accelerators and Free-Electron Lasers #cs.CL #cs.LG
- Wide neural networks of any depth evolve as linear models under gradient descent *
2019/02/18 by Jaehoon Lee, Lechao Xiao, Samuel S. Schoenholz +5 · 2 voices · 51 citations
Computer Science · Mathematics · #Gaussian Processes and Bayesian Inference #Neural Networks and Reservoir Computing #Stochastic Gradient Optimization Techniques #cs.LG #stat.ML
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
2022/06/09 by Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 · 3 voices · 237 citations
#cs.CL #cs.AI #cs.CY #cs.LG #stat.ML
- Deep Neural Networks as Gaussian Processes
2017/11/01 by Jaehoon Lee, Yasaman Bahri, Lee, Jaehoon +9 · 108 citations
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Statistical Mechanics and Entropy #Target Tracking and Data Fusion in Sensor Networks
- Training LLMs over Neurally Compressed Text
2024/04/04 by Brian Lester, Lester, Brian, Jaehoon Lee +12 · 4 voices · 4 citations
Computer Science · #Handwritten Text Recognition Techniques #Mathematics, Computing, and Information Processing #Natural Language Processing Techniques #cs.CL #cs.LG
- Scaling Exponents Across Parameterizations and Optimizers
2024/07/08 by Katie Everett, Everett, Katie, Lechao Xiao +19 · 2 voices · 25 citations
#cs.LG
- Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
2023/12/11 by Avi Singh, Singh, Avi, John D. Co-Reyes +76 · 67 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling
- Dataset Meta-Learning from Kernel Ridge-Regression
2020/10/30 by Timothy Nguyen, Nguyen, Timothy, Zhourong Chen +3 · 29 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Bayesian Deep Convolutional Networks with Many Channels are Gaussian\n Processes
2018/10/11 by Roman Novak, Novak, Roman, Lechao Xiao +16 · 45 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Neural and Evolutionary Computing (cs.NE)
- Small-scale proxies for large-scale Transformer training instabilities
2023/09/25 by Mitchell Wortsman, Peter J. Liu, Wortsman, Mitchell +29 · 42 citations
Computer Science · Decision Sciences · #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Forecasting Techniques and Applications #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG)
- Dataset Distillation with Infinitely Wide Convolutional Networks
2021/07/27 by Timothy Nguyen, Roman Novak, Nguyen, Timothy +5 · 27 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Neural Tangents: Fast and Easy Infinite Neural Networks in Python
2019/12/05 by Roman Novak, Novak, Roman, Lechao Xiao +11 · 18 citations
Physics and Astronomy · Computer Science · #Model Reduction and Neural Networks #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning
- On Empirical Comparisons of Optimizers for Deep Learning
2019/10/11 by Dami Choi, Choi, Dami, Christopher J. Shallue +9 · 17 citations
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Stochastic Gradient Optimization Techniques
- On the infinite width limit of neural networks with a standard\n parameterization
2020/01/20 by Jascha Sohl‐Dickstein, Roman Novak, Sohl-Dickstein, Jascha +5 · 6 citations
Computer Science · Physics and Astronomy · #Neural Networks and Applications #Advanced Neural Network Applications #Model Reduction and Neural Networks
- EXIT: Extrapolation and Interpolation-based Neural Controlled Differential Equations for Time-series Classification and Forecasting
2022/04/19 by Sheo Yon Jhin, Jaehoon Lee, Jhin, Sheo Yon +13 · 4 citations
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications #Time Series Analysis and Forecasting
- Invertible Tabular GANs: Killing Two Birds with OneStone for Tabular Data Synthesis
2022/02/08 by Jaehoon Lee, Lee, Jaehoon, Jihyeon Hyeong +7 · 2 citations
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Digital and Cyber Forensics #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
- Fast Neural Kernel Embeddings for General Activations
2022/09/09 by In‐Su Han, Han, Insu, Amir Zandieh +9 · 2 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Data-Efficient Deep Learning Method for Image Classification Using Data Augmentation, Focal Cosine Loss, and Ensemble
2020/07/15 by Byeongjo Kim, Chanran Kim, Kim, Byeongjo +7 · 2 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Currency Recognition and Detection #FOS: Computer and information sciences #Industrial Vision Systems and Defect Detection
- HFI: A unified framework for training-free detection and implicit watermarking of latent diffusion model generated images
2024/12/30 by Sungik Choi, Lee, Hankook, Choi, Sungik +9 · 4 citations
Computer Science · Engineering · #Advanced Numerical Analysis Techniques #Advanced Steganography and Watermarking Techniques #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Physics Enhanced Artificial Intelligence
2019/03/11 by Patrick O’Driscoll, O'Driscoll, Patrick, Jaehoon Lee +3 · 1 citation
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Time Series Analysis and Forecasting
- Superpixel Tokenization for Vision Transformers: Preserving Semantic Integrity in Visual Tokens
2024/12/06 by Jaihyun Lew, Soohyuk Jang, Lew, Jaihyun +15 · 2 voices · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #cs.CV
- Frontier Language Models are not Robust to Adversarial Arithmetic, or "What do I need to say so you agree 2+2=5?
2023/11/08 by C. Daniel Freeman, Laura Culp, Freeman, C. Daniel +57 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Partial-Multivariate Model for Forecasting
2024/08/19 by Jaehoon Lee, Lee, Jaehoon, Hankook Lee +7 · 1 citation
Decision Sciences · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Forecasting Techniques and Applications
- Training Language Models on the Knowledge Graph: Insights on Hallucinations and Their Detectability
2024/08/14 by Jiri Hron, Laura Culp, Hron, Jiri +59 · 1 citation
Psychology · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mental Health via Writing