Gastpar, Michael
- Software in the natural world: A computational approach to hierarchical emergence
2024/02/14 by Fernando E. Rosas, Rosas, Fernando E., Bernhard C. Geiger +11 · 6 voices · 4 citations
#nlin.AO
- Compute-and-Forward: Harnessing Interference through Structured Codes
2009/08/14 by Bobak Nazer, Michael Gastpar, Nazer, Bobak +1 · 7 citations
Computer Science · Engineering · #Cooperative Communication and Network Coding #FOS: Computer and information sciences #Full-Duplex Wireless Communications #Information Theory (cs.IT) #Wireless Communication Security Techniques
- Generalization Error Bounds Via R 'enyi-, f-Divergences and Maximal\n Leakage
2019/12/01 by Amedeo Roberto Esposito, Michael Gastpar, Esposito, Amedeo Roberto +3 · 6 citations
Computer Science · Engineering · Mathematics · Physics and Astronomy · #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning and Algorithms #Probability (math.PR) #Sparse and Compressive Sensing Techniques #Statistical Mechanics and Entropy #Statistical Methods and Inference
- Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains
2024/02/06 by Makkuva, Ashok Vardhan, Bondaschi, Marco, Girish, Adway +4 · 9 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Transformers on Markov Data: Constant Depth Suffices
2024/07/25 by Nived Rajaraman, Rajaraman, Nived, Marco Bondaschi +7 · 11 citations
Computer Science · Mathematics · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Stochastic Gradient Optimization Techniques
- Private Retrieval, Computing and Learning: Recent Progress and Future Challenges
2021/07/30 by Ulukus, Sennur, Avestimehr, Salman, Gastpar, Michael +3 · 7 citations
#Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Information Theory (cs.IT) #Parallel #and Cluster Computing (cs.DC)
- Integer-Forcing Linear Receivers
2010/03/31 by Zhan, Jiening, Nazer, Bobak, Erez, Uri +1 · 2 citations
#FOS: Computer and information sciences #Information Theory (cs.IT)
- Computation Over Gaussian Networks With Orthogonal Components
2013/10/26 by Sang-Woon Jeon, Chien-Yi Wang, Jeon, Sang-Woon +3 · 2 citations
Computer Science · Engineering · #Advanced MIMO Systems Optimization #Cooperative Communication and Network Coding #FOS: Computer and information sciences #Information Theory (cs.IT) #Wireless Communication Security Techniques
- Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models
2024/07/22 by Alliot Nagle, Adway Girish, Nagle, Alliot +9 · 3 citations
Computer Science · #Embedded Systems Design Techniques #Parallel Computing and Optimization Techniques
- Learning, compression, and leakage: Minimising classification error via meta-universal compression principles
2020/10/14 by Rosas, Fernando E., Mediano, Pedro A. M., Gastpar, Michael · 2 citations
#FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG)
- Local to Global: Learning Dynamics and Effect of Initialization for Transformers
2024/06/05 by Ashok Vardhan Makkuva, Marco Bondaschi, Makkuva, Ashok Vardhan +11 · 3 citations
Psychology · #FOS: Computer and information sciences #Information Theory (cs.IT) #Innovative Teaching and Learning Methods #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Fantastic Generalization Measures are Nowhere to be Found
2023/09/24 by Gastpar, Michael, Nachum, Ido, Shafer, Jonathan +1 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE)
- From Markov to Laplace: How Mamba In-Context Learns Markov Chains
2025/02/14 by Bondaschi, Marco, Rajaraman, Nived, Wei, Xiuying +5 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG)
- Strengthened Information-theoretic Bounds on the Generalization Error
2019/03/09 by Issa, Ibrahim, Esposito, Amedeo Roberto, Gastpar, Michael · 1 citation
#FOS: Computer and information sciences #Information Theory (cs.IT)
- Characterising directed and undirected metrics of high-order interdependence
2024/04/10 by Fernando E. Rosas, Pedro A. M. Mediano, Rosas, Fernando E. +3 · 2 citations
Business, Management and Accounting · Decision Sciences · Engineering · #Complex Systems and Decision Making #FOS: Computer and information sciences #Information Theory (cs.IT) #Infrastructure Resilience and Vulnerability Analysis #Supply Chain Resilience and Risk Management
- Generalization Error Bounds for Noisy, Iterative Algorithms via Maximal Leakage
2023/02/28 by Issa, Ibrahim, Esposito, Amedeo Roberto, Gastpar, Michael · 1 citation
#FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Lower Bounds on the Bayesian Risk via Information Measures
2023/03/22 by Esposito, Amedeo Roberto, Vandenbroucque, Adrien, Gastpar, Michael · 1 citation
#FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG)
- Properties of the Strong Data Processing Constant for Rényi Divergence
2024/03/15 by Lifu Jin, Amedeo Roberto Esposito, Jin, Lifu +3 · 1 citation
Computer Science · Economics, Econometrics and Finance · Mathematics · #Advanced Mathematical Modeling in Engineering #FOS: Computer and information sciences #Information Theory (cs.IT) #Mathematical Approximation and Integration #Stochastic processes and financial applications
- Characterising high-order interdependence via entropic conjugation
2024/10/14 by Fernando E. Rosas, Rosas, Fernando E., Aaron Gutknecht +5 · 1 citation
Engineering · #Advancements in Semiconductor Devices and Circuit Design #Radiation Effects in Electronics
- Asymmetric Compute-and-Forward with CSIT
2014/01/14 by Jingge Zhu, Michael Gastpar, Zhu, Jingge +1 · 1 citation
Computer Science · Engineering · #Advanced MIMO Systems Optimization #Cooperative Communication and Network Coding #FOS: Computer and information sciences #Information Theory (cs.IT) #Wireless Communication Security Techniques
- zip2zip: Inference-Time Adaptive Tokenization via Online Compression
2025/06/01 by Geng, Saibo, Ranchin, Nathan, yao, Yunzhen +4 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Efficient Algorithms for the Data Exchange Problem
2015/02/21 by Nebojsa Milosavljevic, Milosavljevic, Nebojsa, Sameer Pawar +7 · 1 citation
Computer Science · Engineering · #Cooperative Communication and Network Coding #FOS: Computer and information sciences #Information Theory (cs.IT) #Mobile Ad Hoc Networks #Wireless Communication Security Techniques
- Computation in Multicast Networks: Function Alignment and Converse\n Theorems
2012/09/15 by Changho Suh, Naveen Goela, Suh, Changho +3 · 1 citation
Computer Science · Engineering · #Cooperative Communication and Network Coding #Wireless Communication Security Techniques