vix.ing · top · new · best · stats · spec

Schmidt, Craig W.

  1. Tokenization Is More Than Compression
    2024/02/28 by Craig W. Schmidt, Schmidt, Craig W., Varshini Reddy +11 · 27 citations
    Computer Science · #Embedded Systems Design Techniques
  2. Greed is All You Need: An Evaluation of Tokenizer Inference Methods
    2024/03/02 by Omri Uzan, Craig W. Schmidt, Uzan, Omri +5 · 9 citations
    Computer Science · #Natural Language Processing Techniques
  3. How Much is Enough? The Diminishing Returns of Tokenization Training Data
    2025/02/27 by Varshini Reddy, Craig W. Schmidt, Reddy, Varshini +6 · 2 voices · 6 citations
    Computer Science · Social Sciences · #Natural Language Processing Techniques #Language and cultural evolution #Authorship Attribution and Profiling
  4. Boundless Byte Pair Encoding: Breaking the Pre-tokenization Barrier
    2025/03/31 by Craig W. Schmidt, Varshini Reddy, Schmidt, Craig W. +5 · 11 citations
    Computer Science · #Natural Language Processing Techniques #Algorithms and Data Compression #Handwritten Text Recognition Techniques