Kiyono, Shun

1. Lessons on Parameter Sharing across Layers in Transformers
   2021/04/13 by Sho Takase, Takase, Sho, Shun Kiyono +1 · 8 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
2. Spike No More: Stabilizing the Pre-training of Large Language Models
   2023/12/28 by Takase, Sho, Kiyono, Shun, Kobayashi, Sosuke +1 · 10 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
3. B2T Connection: Serving Stability and Performance in Deep Transformers
   2022/06/01 by Sho Takase, Takase, Sho, Shun Kiyono +5 · 2 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
4. Large Vocabulary Size Improves Large Language Models
   2024/06/24 by Takase, Sho, Ri, Ryokan, Kiyono, Shun +1 · 3 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
5. An Empirical Study of Incorporating Pseudo Data into Grammatical Error Correction
   2019/09/02 by Kiyono, Shun, Suzuki, Jun, Mita, Masato +2 · 1 citation
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
6. A Self-Refinement Strategy for Noise Reduction in Grammatical Error Correction
   2020/10/07 by Mita, Masato, Kiyono, Shun, Kaneko, Masahiro +2 · 1 citation
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
7. SHAPE: Shifted Absolute Position Embedding for Transformers
   2021/09/13 by Kiyono, Shun, Kobayashi, Sosuke, Suzuki, Jun +1 · 1 citation
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
8. Efficient Construction of Model Family through Progressive Training Using Model Expansion
   2025/04/01 by Yano, Kazuki, Takase, Sho, Kobayashi, Sosuke +2 · 3 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
9. Diverse Lottery Tickets Boost Ensemble from a Single Pretrained Model
   2022/05/24 by Kobayashi, Sosuke, Kiyono, Shun, Suzuki, Jun +1 · 1 citation
   #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)