Jiang, Youhe
- HexGen: Generative Inference of Large Language Model over Heterogeneous Environment
2023/11/20 by Youhe Jiang, Ran Yan, Jiang, Youhe +8 · 11 citations
Computer Science · Decision Sciences · Engineering · #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Parallel #Simulation Techniques and Applications #and Cluster Computing (cs.DC)
- ThunderServe: High-performance and Cost-efficient LLM Serving in Cloud Environments
2025/02/13 by Youhe Jiang, Fangcheng Fu, Jiang, Youhe +11 · 10 citations
Computer Science · #IoT and Edge/Fog Computing #Cloud Computing and Resource Management #Software System Performance and Reliability
- HexGen-2: Disaggregated Generative Inference of LLMs in Heterogeneous Environment
2025/02/11 by Youhe Jiang, Jiang, Youhe, Ran Yan +3 · 6 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
- Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs
2025/02/02 by Jiang, Youhe, Fu, Fangcheng, Yao, Xiaozhe +6 · 5 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning
2022/09/27 by Youhe Jiang, Jiang, Youhe, Fu, Fangcheng +6 · 2 citations
Computer Science · #Advanced Neural Network Applications #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- HexiScale: Facilitating Large Language Model Training over Heterogeneous Hardware
2024/09/02 by Ran Yan, Youhe Jiang, Yan, Ran +7 · 4 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- Revisiting the Time Cost Model of AllReduce
2024/09/06 by Xiong, Dian, Chen, Li, Jiang, Youhe +3 · 3 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- HEXGEN-FLOW: Optimizing LLM Inference Request Scheduling for Agentic Text-to-SQL
2025/05/08 by Peng, You, Jiang, Youhe, Jiang, Wenqi +2 · 2 citations
#Databases (cs.DB) #FOS: Computer and information sciences
- LMDeploy Accelerates Mixed-Precision LLM Inference with TurboMind
2025/08/21 by Li Zhang, Zhang, Li, Youhe Jiang +13 · 4 citations
Computer Science · Materials Science · #Distributed #FOS: Computer and information sciences #Machine Learning in Materials Science #Natural Language Processing Techniques #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #and Cluster Computing (cs.DC)