Schmidt, Craig W.
- Tokenization Is More Than Compression
2024/02/28 by Craig W. Schmidt, Schmidt, Craig W., Varshini Reddy +11 · 27 citations
Computer Science · #Embedded Systems Design Techniques
- Greed is All You Need: An Evaluation of Tokenizer Inference Methods
2024/03/02 by Omri Uzan, Craig W. Schmidt, Uzan, Omri +5 · 9 citations
Computer Science · #Natural Language Processing Techniques
- How Much is Enough? The Diminishing Returns of Tokenization Training Data
2025/02/27 by Varshini Reddy, Craig W. Schmidt, Reddy, Varshini +6 · 2 voices · 6 citations
Computer Science · Social Sciences · #Natural Language Processing Techniques #Language and cultural evolution #Authorship Attribution and Profiling
- Boundless Byte Pair Encoding: Breaking the Pre-tokenization Barrier
2025/03/31 by Craig W. Schmidt, Varshini Reddy, Schmidt, Craig W. +5 · 11 citations
Computer Science · #Natural Language Processing Techniques #Algorithms and Data Compression #Handwritten Text Recognition Techniques