Ke Hong
- A Survey on Efficient Inference for Large Language Models
2024/04/22 by Zixuan Zhou, Xuefei Ning, Zhou, Zixuan +27 · 53 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- TorchSparse++: Efficient Training and Inference Framework for Sparse Convolution on GPUs
2023/10/25 by Haotian Tang, Tang, Haotian, Shang Fa Yang +15 · 20 citations
Computer Science · #Advanced Graph Neural Networks #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Distributed #FOS: Computer and information sciences #Graph Theory and Algorithms #Machine Learning (cs.LG) #Parallel #Performance (cs.PF) #and Cluster Computing (cs.DC)
- FlashDecoding++: Faster Large Language Model Inference on GPUs
2023/11/02 by Ke Hong, Hong, Ke, Guohao Dai +15 · 17 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- MBQ: Modality-Balanced Quantization for Large Vision-Language Models
2024/12/27 by Shiyao Li, Yingchun Hu, Li, Shiyao +22 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- semi-PD: Towards Efficient LLM Serving via Phase-Wise Disaggregated Computation and Unified Storage
2025/04/28 by Ke Hong, Lufang Chen, Hong, Ke +21 · 6 citations
Computer Science · #Parallel Computing and Optimization Techniques #Big Data and Digital Economy #Cloud Computing and Resource Management
- Ada3D : Exploiting the Spatial Redundancy with Adaptive Inference for Efficient 3D Object Detection
2023/07/17 by Tianchen Zhao, Xuefei Ning, Zhao, Tianchen +19 · 1 citation
Computer Science · Engineering · Physics and Astronomy · #Advanced Neural Network Applications #Advanced Optical Sensing Technologies #Autonomous Vehicle Technology and Safety #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences