Gastaldi, Juan Luis

1. Tokenization and the Noiseless Channel
   2023/06/29 by Zouhar, Vilém, Meister, Clara, Gastaldi, Juan Luis +3 · 8 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Theory (cs.IT)
2. A Formal Perspective on Byte-Pair Encoding
   2023/06/29 by Zouhar, Vilém, Meister, Clara, Gastaldi, Juan Luis +4 · 8 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Optimization and Control (math.OC)
3. From Language Models over Tokens to Language Models over Characters
   2024/12/04 by Tim Vieira, Ben LeBrun, Vieira, Tim +13 · 4 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
4. On the Proper Treatment of Tokenization in Psycholinguistics
   2024/10/03 by Mario Giulianelli, L. Malagutti, Giulianelli, Mario +9 · 2 citations
   Arts and Humanities · #Linguistic research and analysis
5. Language Models over Canonical Byte-Pair Encodings
   2025/06/09 by Tim Vieira, Tianyu Liu, Vieira, Tim +17 · 4 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Formal Languages and Automata Theory (cs.FL) #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
6. The Foundations of Tokenization: Statistical and Computational Concerns
   2024/07/16 by Juan Luis Gastaldi, John Terilla, Gastaldi, Juan Luis +9 · 1 citation
   Biochemistry, Genetics and Molecular Biology · #Genomics and Chromatin Dynamics