Craig W. Schmidt
- Tokenization Is More Than Compression
2024/02/28 by Craig W. Schmidt, Varshini Reddy, Schmidt, Craig W. +11 · 20 citations
Computer Science · #Embedded Systems Design Techniques
- Greed is All You Need: An Evaluation of Tokenizer Inference Methods
2024/03/02 by Omri Uzan, Uzan, Omri, Craig W. Schmidt +5 · 7 citations
Computer Science · #Natural Language Processing Techniques
- SEC-QA: A Systematic Evaluation Corpus for Financial QA
2024/06/20 by Viet Dac Lai, Michael Krumdick, Lai, Viet Dac +9 · 6 citations
Decision Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Stock Market Forecasting Methods
- How Much is Enough? The Diminishing Returns of Tokenization Training Data
2025/02/27 by Varshini Reddy, Craig W. Schmidt, Reddy, Varshini +6 · 2 voices · 5 citations
Computer Science · Social Sciences · #Natural Language Processing Techniques #Language and cultural evolution #Authorship Attribution and Profiling
- Boundless Byte Pair Encoding: Breaking the Pre-tokenization Barrier
2025/03/31 by Craig W. Schmidt, Schmidt, Craig W., Varshini Reddy +5 · 6 citations
Computer Science · #Natural Language Processing Techniques #Algorithms and Data Compression #Handwritten Text Recognition Techniques
- Tokenisation via Convex Relaxations
2026/05/21 by Jan Tempus, Philip Whittington, Craig W. Schmidt +2 · 2 voices · 1 citation
#cs.CL #cs.LG
- Joint Optimization for Greedy Longest-match Tokenization
2026/07/25 by Adhiraj Singh, Deepanshu Mody, Ghina Al Shdaifat +4
#cs.CL