Bondaschi, Marco

1. Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains
   2024/02/06 by Makkuva, Ashok Vardhan, Bondaschi, Marco, Girish, Adway +4 · 8 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
2. Transformers on Markov Data: Constant Depth Suffices
   2024/07/25 by Nived Rajaraman, Marco Bondaschi, Rajaraman, Nived +7 · 8 citations
   Computer Science · Mathematics · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Stochastic Gradient Optimization Techniques
3. Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models
   2024/07/22 by Alliot Nagle, Adway Girish, Nagle, Alliot +9 · 3 citations
   Computer Science · #Embedded Systems Design Techniques #Parallel Computing and Optimization Techniques
4. Local to Global: Learning Dynamics and Effect of Initialization for Transformers
   2024/06/05 by Ashok Vardhan Makkuva, Marco Bondaschi, Makkuva, Ashok Vardhan +11 · 3 citations
   Psychology · #FOS: Computer and information sciences #Information Theory (cs.IT) #Innovative Teaching and Learning Methods #Machine Learning (cs.LG) #Machine Learning (stat.ML)
5. From Markov to Laplace: How Mamba In-Context Learns Markov Chains
   2025/02/14 by Bondaschi, Marco, Rajaraman, Nived, Wei, Xiuying +5 · 4 citations
   #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG)
6. LASER: Linear Compression in Wireless Distributed Optimization
   2023/10/19 by Ashok Vardhan Makkuva, Makkuva, Ashok Vardhan, Marco Bondaschi +8 · 1 citation
   Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques