Etai Littwin
- Distillation Scaling Laws
2025/02/12 by Dan Busbridge, Amitis Shidani, Busbridge, Dan +9 · 9 voices · 15 citations
Engineering · #Process Optimization and Integration
- What Algorithms can Transformers Learn? A Study in Length Generalization
2023/10/24 by Hattie Zhou, Arwen Bradley, Zhou, Hattie +13 · 2 voices · 21 citations
Computer Science · #cs.LG #cs.AI #cs.CL #stat.ML
- When can transformers reason with abstract symbols?
2023/10/15 by Enric Boix-Adsera, Enric Boix-Adserà, Omid Saremi +12 · 1 voice · 4 citations
Computer Science · #Advanced Text Analysis Techniques #Natural Language Processing Techniques #cs.AI #cs.CL #cs.LG
- LiDAR: Sensing Linear Probing Performance in Joint Embedding SSL Architectures
2023/12/07 by Vimal Thilak, Thilak, Vimal, Chen Huang +13 · 9 citations
Computer Science · #Face and Expression Recognition #Machine Learning and Data Classification #Anomaly Detection Techniques and Applications
- Tensor Programs IIb: Architectural Universality of Neural Tangent Kernel Training Dynamics
2021/05/08 by Greg Yang, Yang, Greg, Etai Littwin +1 · 5 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Probability (math.PR) #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications
- Vanishing Gradients in Reinforcement Finetuning of Language Models
2023/10/31 by Noam Razin, Hattie Zhou, Razin, Noam +13 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Reinforcement Learning in Robotics #Topic Modeling
- Tensor Programs IVb: Adaptive Optimization in the Infinite-Width Limit
2023/08/03 by Greg Yang, Etai Littwin, Yang, Greg +1 · 5 citations
Computer Science · #Parallel Computing and Optimization Techniques #Computational Physics and Python Applications #Stochastic Gradient Optimization Techniques
- How JEPA Avoids Noisy Features: The Implicit Bias of Deep Linear Self Distillation Networks
2024/07/03 by Etai Littwin, Littwin, Etai, Omid Saremi +12 · 1 voice · 5 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #cs.LG
- Enhancing JEPAs with Spatial Conditioning: Robust and Efficient Representation Learning
2024/10/14 by Etai Littwin, Littwin, Etai, Vimal Thilak +3 · 1 voice
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.CV #cs.LG
- Learning Representation from Neural Fisher Kernel with Low-rank Approximation
2022/02/04 by Ruixiang Zhang, Zhang, Ruixiang, Shuangfei Zhai +5 · 1 citation
Computer Science · Mathematics · Physics and Astronomy · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Medical Image Segmentation Techniques #Model Reduction and Neural Networks #Tensor decomposition and applications
- Adaptivity and Modularity for Efficient Generalization Over Task Complexity
2023/10/13 by Samira Abnar, Omid Saremi, Abnar, Samira +19 · 1 citation
Computer Science · #Machine Learning and Data Classification #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- UI-JEPA: Towards Active Perception of User Intent through Onscreen User Activity
2024/09/06 by Yicheng Fu, Fu, Yicheng, Raviteja Anantha +6 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Visualization and Analytics #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Innovative Human-Technology Interaction #Machine Learning (cs.LG) #Virtual Reality Applications and Impacts