Shiyi Zhu
- CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending
2023/09/15 by Shiyi Zhu, Zhu, Shiyi, Jing Ye +10 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling