Yao, Jinghan
- SOFT: Softmax-free Transformer with Linear Complexity
2021/10/22 by Jiachen Lu, Jinghan Yao, Lu, Jiachen +15 · 11 citations
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference
2024/01/16 by Yao, Jinghan, Anthony, Quentin, Shafi, Aamir +3 · 9 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Single Pixel Reconstruction for One-stage Instance Segmentation
2019/04/16 by Yu, Jun, Yao, Jinghan, Zhang, Jian +2 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer
2024/08/30 by Jinghan Yao, Yao, Jinghan, Sam Adé Jacobs +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)