Takuya Kato
- Large Vocabulary Size Improves Large Language Models
2024/06/24 by Sho Takase, Takase, Sho, Ryokan Ri +5 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Scaling Laws for Upcycling Mixture-of-Experts Language Models
2025/02/05 by Seng Pei Liew, Takuya Kato, Liew, Seng Pei +2 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling