Alberto Bietti
- xVal: A Continuous Numerical Tokenization for Scientific Language Models
2023/10/04 by Siavash Golkar, Mariel Pettee, Golkar, Siavash +25 · 2 voices · 3 citations
#stat.ML #cs.AI #cs.CL #cs.LG
- On the Inductive Bias of Neural Tangent Kernels
2019/05/28 by Alberto Bietti, Julien Mairal, Bietti, Alberto +1 · 23 citations
Computer Science · #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #Advanced Neural Network Applications
- Birth of a Transformer: A Memory Viewpoint
2023/06/01 by Alberto Bietti, Bietti, Alberto, Vivien Cabannes +7 · 31 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Multiple Physics Pretraining for Physical Surrogate Models
2023/10/04 by Michael T. McCabe, Bruno Régaldo-Saint Blancard, McCabe, Michael +25 · 18 citations
Physics and Astronomy · Computer Science · Biochemistry, Genetics and Molecular Biology · #Model Reduction and Neural Networks #Generative Adversarial Networks and Image Synthesis #Cell Image Analysis Techniques
- Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models
2024/02/29 by Frederik Künstner, Kunstner, Frederik, Robin Yadav +7 · 16 citations
Computer Science · Social Sciences · #Authorship Attribution and Profiling #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #FOS: Mathematics #Language and cultural evolution #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- When does return-conditioned supervised learning work for offline reinforcement learning?
2022/06/02 by David Brandfonbrener, Brandfonbrener, David, Alberto Bietti +7 · 7 citations
Computer Science · #Reinforcement Learning in Robotics #Machine Learning and Data Classification #Data Stream Mining Techniques
- Aristotle: IMO-level Automated Theorem Proving
2025/10/01 by Tudor Achim, Alex Best, Achim, Tudor +43 · 3 voices · 6 citations
#cs.AI #cs.CL
- A Contextual Bandit Bake-off
2018/02/12 by Alberto Bietti, Bietti, Alberto, Alekh Agarwal +3 · 4 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms
- Convergence and Stability of Graph Convolutional Networks on Large\n Random Graphs
2020/06/02 by Nicolas Keriven, Alberto Bietti, Keriven, Nicolas +3 · 4 citations
Computer Science · Physics and Astronomy · #Advanced Graph Neural Networks #Complex Network Analysis Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Opportunistic and Delay-Tolerant Networks
- Deep Equals Shallow for ReLU Networks in Kernel Regimes
2020/09/30 by Alberto Bietti, Francis Bach, Bietti, Alberto +1 · 4 citations
Computer Science · Physics and Astronomy · #Advanced Graph Neural Networks #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Stochastic Gradient Optimization Techniques
- On Learning Gaussian Multi-index Models with Gradient Flow
2023/10/30 by Alberto Bietti, Bietti, Alberto, Joan Bruna +3 · 5 citations
Mathematics · Physics and Astronomy · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Statistical Mechanics and Entropy #Statistical Methods and Inference
- Distributional Associations vs In-Context Reasoning: A Study of Feed-forward and Attention Layers
2024/06/05 by Lei Chen, Joan Bruna, Chen, Lei +3 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
- Understanding Factual Recall in Transformers via Associative Memories
2024/12/09 by Eshaan Nichani, Jason D. Lee, Nichani, Eshaan +3 · 8 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Learning Compositional Functions with Transformers from Easy-to-Hard Data
2025/05/29 by Zixuan Wang, Wang, Zixuan, Eshaan Nichani +11 · 11 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Advanced Graph Neural Networks
- A Kernel Perspective for Regularizing Deep Neural Networks
2018/09/30 by Alberto Bietti, Grégoire Mialon, Bietti, Alberto +5 · 5 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- On the Universality of Graph Neural Networks on Large Random Graphs
2021/05/27 by Nicolas Keriven, Alberto Bietti, Keriven, Nicolas +3 · 2 citations
Computer Science · Physics and Astronomy · #Advanced Graph Neural Networks #Complex Network Analysis Techniques #FOS: Computer and information sciences #Graph Theory and Algorithms #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Learning Associative Memories with Gradient Descent
2024/02/28 by Vivien Cabannes, Berfin Şimşek, Cabannes, Vivien +3 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Approximation and Learning with Deep Convolutional Models: a Kernel\n Perspective
2021/02/19 by Alberto Bietti, Bietti, Alberto · 3 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Generative Adversarial Networks and Image Synthesis #Advanced Neural Network Applications
- Scaling Laws for Associative Memories
2023/10/04 by Vivien Cabannes, Cabannes, Vivien, Elvis Dohmatob +3 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Error Correcting Code Techniques #FOS: Computer and information sciences #G.1.6 #I.2.6 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
- On learning Gaussian multi‐index models with gradient flow part I: General properties and two‐timescale learning
2025/07/15 by Alberto Bietti, Joan Bruna, Loucas Pillaud‐Vivien · 8 citations
Computer Science · Mathematics · #Neural Networks and Applications #Gaussian Processes and Bayesian Inference #Statistical Methods and Inference
- Physics Steering: Causal Control of Cross-Domain Concepts in a Physics Foundation Model
2025/11/25 by Rio Alexa Fear, Fear, Rio Alexa, Payel Mukhopadhyay +8 · 2 voices · 2 citations
Computer Science · Materials Science · #Explainable Artificial Intelligence (XAI) #Machine Learning in Materials Science #Multimodal Machine Learning Applications #cs.AI #cs.LG #physics.comp-ph
- Contextual Counting: A Mechanistic Study of Transformers on a Quantitative Task
2024/05/30 by Siavash Golkar, Alberto Bietti, Golkar, Siavash +27 · 2 citations
Computer Science · #Neural Networks and Applications
- On Energy-Based Models with Overparametrized Shallow Neural Networks
2021/04/15 by Carles Domingo-Enrich, Domingo-Enrich, Carles, Alberto Bietti +5 · 1 citation
Physics and Astronomy · Computer Science · Materials Science · #Model Reduction and Neural Networks #Generative Adversarial Networks and Image Synthesis #Machine Learning in Materials Science
- On the Sample Complexity of Learning under Invariance and Geometric\n Stability
2021/06/13 by Alberto Bietti, Bietti, Alberto, Luca Venturi +3 · 1 citation
Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference
- Personalization Improves Privacy-Accuracy Tradeoffs in Federated Learning
2022/02/10 by Alberto Bietti, Bietti, Alberto, Chen-Yu Wei +7 · 1 citation
Computer Science · Mathematics · #Advanced Causal Inference Techniques #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Counterfactual Learning of Stochastic Policies with Continuous Actions
2020/04/22 by Houssam Zenati, Alberto Bietti, Zenati, Houssam +9 · 1 citation
Computer Science · Economics, Econometrics and Finance · Mathematics · #Advanced Causal Inference Techniques #Bayesian Modeling and Causal Inference #FOS: Computer and information sciences #Health Systems, Economic Evaluations, Quality of Life #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- In-context denoising with one-layer transformers: connections between attention and associative memory retrieval
2025/02/07 by Matthew Smart, Smart, Matthew, Alberto Bietti +3 · 1 voice · 1 citation
#cs.LG #cond-mat.dis-nn
- AION-1: Omnimodal Foundation Model for Astronomical Sciences
2025/10/20 by Liam Parker, François Lanusse, Parker, Liam +51 · 2 citations
Physics and Astronomy · #Astronomy and Astrophysical Research #Cosmology and Nongalactic Astrophysics (astro-ph.CO) #FOS: Physical sciences #Galaxies: Formation, Evolution, Phenomena #Gamma-ray bursts and supernovae #Instrumentation and Methods for Astrophysics (astro-ph.IM)