Yuval Pinter
- Tokenization Is More Than Compression
2024/02/28 by Craig W. Schmidt, Varshini Reddy, Schmidt, Craig W. +11 · 22 citations
Computer Science · #Embedded Systems Design Techniques
- Greed is All You Need: An Evaluation of Tokenizer Inference Methods
2024/03/02 by Omri Uzan, Craig W. Schmidt, Uzan, Omri +5 · 8 citations
Computer Science · #Natural Language Processing Techniques
- MonoCoder: Domain-Specific Code Language Model for HPC Codes and Tasks
2023/12/20 by Tal Kadosh, Kadosh, Tal, Niranjan Hasabnis +23 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Programming Languages (cs.PL) #Software Engineering (cs.SE) #Software Engineering Research #Topic Modeling
- How Much is Enough? The Diminishing Returns of Tokenization Training Data
2025/02/27 by Varshini Reddy, Craig W. Schmidt, Reddy, Varshini +6 · 2 voices · 6 citations
Computer Science · Social Sciences · #Natural Language Processing Techniques #Language and cultural evolution #Authorship Attribution and Profiling
- Scope is all you need: Transforming LLMs for HPC Code
2023/08/18 by Tal Kadosh, Kadosh, Tal, Niranjan Hasabnis +21 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Programming Languages (cs.PL) #Software Engineering Research #Topic Modeling
- Analyzing Cognitive Plausibility of Subword Tokenization
2023/10/20 by Lisa Beinborn, Beinborn, Lisa, Yuval Pinter +1 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Tokenization Matters: Navigating Data-Scarce Tokenization for Gender Inclusive Language Technologies
2023/12/19 by Anaelia Ovalle, Ovalle, Anaelia, Ninareh Mehrabi +15 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- MPIrigen: MPI Code Generation through Domain-Specific Language Models
2024/02/14 by Nadav Schneider, Niranjan Hasabnis, Schneider, Nadav +21 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model-Driven Software Engineering Techniques #Parallel #Software Engineering (cs.SE) #and Cluster Computing (cs.DC)
- Advising OpenMP Parallelization via a Graph-Based Approach with Transformers
2023/05/16 by Tal Kadosh, Nadav Schneider, Kadosh, Tal +9 · 3 citations
Computer Science · #Software Engineering Research #Software System Performance and Reliability #Topic Modeling
- Boundless Byte Pair Encoding: Breaking the Pre-tokenization Barrier
2025/03/31 by Craig W. Schmidt, Varshini Reddy, Schmidt, Craig W. +5 · 7 citations
Computer Science · #Natural Language Processing Techniques #Algorithms and Data Compression #Handwritten Text Recognition Techniques
- Restoring Hebrew Diacritics Without a Dictionary
2021/05/11 by Elazar Gershuni, Yuval Pinter, Gershuni, Elazar +1 · 2 citations
Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #Digital Humanities and Scholarship #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Natural Language Processing Techniques
- Evaluating Subword Tokenization: Alien Subword Composition and OOV Generalization Challenge
2024/04/20 by Khuyagbaatar Batsuren, Batsuren, Khuyagbaatar, Ekaterina Vylomova +11 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- OMPar: Automatic Parallelization with AI-Driven Source-to-Source Compilation
2024/09/23 by Tal Kadosh, Niranjan Hasabnis, Kadosh, Tal +13 · 3 citations
Computer Science · #Computation and Language (cs.CL) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences
- Quantifying OpenMP: Statistical Insights into Usage and Adoption
2023/08/15 by Tal Kadosh, Niranjan Hasabnis, Kadosh, Tal +7 · 2 citations
Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #Databases (cs.DB) #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Don't Touch My Diacritics
2024/10/31 by Kyle Gorman, Yuval Pinter, Gorman, Kyle +1 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- An Analysis of BPE Vocabulary Trimming in Neural Machine Translation
2024/03/30 by Marco Cognetta, Tatsuya Hiraoka, Cognetta, Marco +7 · 1 citation
Computer Science · #Natural Language Processing Techniques
- Learning to Parallelize in a Shared-Memory Environment with Transformers
2022/04/27 by Re’em Harel, Yuval Pinter, Harel, Re'em +3 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Software Engineering Research #Topic Modeling #and Cluster Computing (cs.DC)
- CharBench: Evaluating the Role of Tokenization in Character-Level Tasks
2025/08/04 by Omri Uzan, Yuval Pinter, Uzan, Omri +1 · 1 voice · 1 citation
#cs.CL
- MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformers
2023/05/16 by Nadav Schneider, Tal Kadosh, Schneider, Nadav +9 · 1 citation
Computer Science · #Advanced Data Storage Technologies #Computation and Language (cs.CL) #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Tokenizing Crosslingual Homographs
2026/07/20 by Rotem Brillant, Yuval Pinter
#cs.CL