Zhonghui Zhang
- Echo: Efficient Co-Scheduling of Hybrid Online-Offline Tasks for Large Language Model Serving
2025/03/01 by Zhibin Wang, Shipeng Li, Wang, Zhibin +16 · 2 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
- Accelerating Mixture-of-Experts Inference by Hiding Offloading Latency with Speculative Decoding
2025/08/29 by Zhibin Wang, Wang, Zhibin, Zhonghui Zhang +18 · 1 citation
Computer Science · #Target Tracking and Data Fusion in Sensor Networks #Anomaly Detection Techniques and Applications #Distributed Sensor Networks and Detection Algorithms