Ting-Han Fan

1. KERPLE: Kernelized Relative Positional Embedding for Length Extrapolation
   2022/05/20 by Ta-Chung Chi, Ting-Han Fan, Chi, Ta-Chung +5 · 9 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
2. Latent Positional Information is in the Self-Attention Variance of Transformer Language Models Without Positional Embeddings
   2023/05/23 by Ta-Chung Chi, Chi, Ta-Chung, Ting-Han Fan +7 · 7 citations
   Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Language and cultural evolution #Natural Language Processing Techniques #Topic Modeling
3. LongReason: A Synthetic Long-Context Reasoning Benchmark via Context Expansion
   2025/01/25 by Zhan Ling, Kang Liu, Ling, Zhan +15 · 11 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Recommender Systems and Techniques
4. Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis
   2022/12/20 by Ta-Chung Chi, Chi, Ta-Chung, Ting-Han Fan +4 · 4 citations
   Computer Science · Engineering · Materials Science · #Computation and Language (cs.CL) #Computational Physics and Python Applications #FOS: Computer and information sciences #Magnetic Properties and Applications #Non-Destructive Testing Techniques
5. Virtual Width Networks
   2025/11/14 by Baisheng Li, Seed, Banggu Wu +250 · 2 voices
   Computer Science · #Advanced Neural Network Applications #Generative Adversarial Networks and Image Synthesis #Stochastic Gradient Optimization Techniques #cs.AI #cs.LG
6. Attention Alignment and Flexible Positional Embeddings Improve Transformer Length Extrapolation
   2023/11/01 by Ta-Chung Chi, Ting-Han Fan, Chi, Ta-Chung +3 · 3 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
7. Advancing Regular Language Reasoning in Linear Recurrent Neural Networks
   2023/09/14 by Ting-Han Fan, Fan, Ting-Han, Ta-Chung Chi +3 · 2 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
8. Transformer Working Memory Enables Regular Language Reasoning and Natural Language Length Extrapolation
   2023/05/05 by Ta-Chung Chi, Chi, Ta-Chung, Ting-Han Fan +5 · 1 citation
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling