- HydraInfer: Hybrid Disaggregated Scheduling for Multimodal Large Language Model Serving
2025/05/19 by Tongxuan Liu, Dong, Xianzhe, Liu, Tongxuan +15 · 4 citations
Computer Science · #Advanced Neural Network Applications #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Parallel #and Cluster Computing (cs.DC)
- ZenFlow: Enabling Stall-Free Offloading Training via Asynchronous Updates
2025/05/18 by Lan, Tingfeng, Wu, Yusen, Ma, Bin +7 · 3 citations
#C.1.4 #D.4.7 #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production
2025/05/16 by Jin, Chao, Jiang, Ziheng, Bai, Zhihao +16 · 8 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Arrow: Adaptive Scheduling Mechanisms for Disaggregated LLM Inference Architecture
2025/05/17 by Yu Wu, Wu, Yu, Tongxuan Liu +14 · 4 citations
Computer Science · #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Software System Performance and Reliability #and Cluster Computing (cs.DC)
- Communication-Efficient Hybrid Language Model via Uncertainty-Aware Opportunistic and Compressed Transmission
2025/05/17 by Oh, Seungeun, Kim, Jinhyuk, Park, Jihong +4 · 1 citation
#Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Information Theory (cs.IT) #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #Signal Processing (eess.SP) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- MoE-CAP: Benchmarking Cost, Accuracy and Performance of Sparse Mixture-of-Experts Systems
2025/05/16 by Jiang, Yinsicheng, Fu, Yao, Huang, Yeqi +13 · 2 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- TokenWeave: Efficient Compute-Communication Overlap for Distributed LLM Inference
2025/05/16 by Raja Gond, Gond, Raja, Nipun Kwatra +3 · 6 citations
Computer Science · #Advanced Neural Network Applications #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
- Distributionally Robust Optimization for Aerial Multi-access Edge Computing via Cooperation of UAVs and HAPs
2025/05/15 by Jia, Ziye, Cui, Can, Dong, Chao +4 · 14 citations
#Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Information Theory (cs.IT) #Parallel #Signal Processing (eess.SP) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- AI Greenferencing: Routing AI Inferencing to Green Modular Data Centers with Heron
2025/05/15 by Reddy, Tella Rajashekhar, Palak, Gandhi, Rohan +8 · 2 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- FAST: An Efficient Scheduler for All-to-All GPU Communication
2025/05/14 by Lei, Yiran, Lee, Dongjoo, Zhao, Liangyu +9 · 4 citations
#Distributed #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- ELIS: Efficient LLM Iterative Scheduling System with Response Length Predictor
2025/05/14 by Choi, Seungbeom, Goo, Jeonghoe, Jeon, Eunjoo +2 · 4 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Kudzu: Fast and Simple High-Throughput BFT
2025/05/13 by Shoup, Victor, Sliwinski, Jakub, Vonlanthen, Yann · 2 citations
#Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Distributed Quantum Neural Networks on Distributed Photonic Quantum Computing
2025/05/13 by Chen, Kuan-Cheng, Liu, Chen-Yu, Shang, Yu +2 · 3 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #FOS: Physical sciences #Parallel #Quantum Physics (quant-ph) #and Cluster Computing (cs.DC)
- FlashMLA-ETAP: Efficient Transpose Attention Pipeline for Accelerating MLA Inference on NVIDIA H20 GPUs
2025/05/13 by Pengcuo Dege, Dege, Pengcuo, Luo, Qiuming +4 · 2 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- PrefillOnly: An Inference Engine for Prefill-only Workloads in Large Language Model Applications
2025/05/12 by Kuntai Du, Bowen Wang, Du, Kuntai +19 · 13 citations
Computer Science · Materials Science · #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Machine Learning in Materials Science #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
- Understanding Stragglers in Large Model Training Using What-if Analysis
2025/05/09 by Lin, Jinkun, Jiang, Ziheng, Song, Zuquan +13 · 12 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Empowering Scientific Workflows with Federated Agents
2025/05/08 by Pauloski, J. Gregory, Babuji, Yadu, Chard, Ryan +3 · 7 citations
#Distributed #FOS: Computer and information sciences #Multiagent Systems (cs.MA) #Parallel #and Cluster Computing (cs.DC)
- ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling
2025/05/07 by Xiao Wang, Jong-Youl Choi, Wang, Xiao +33 · 1 citation
Earth and Planetary Sciences · Environmental Science · #Artificial Intelligence (cs.AI) #Atmospheric and Oceanic Physics (physics.ao-ph) #Cryospheric studies and observations #Distributed #Earth and Planetary Astrophysics (astro-ph.EP) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Parallel #Remote Sensing in Agriculture #Urban Heat Island Mitigation #and Cluster Computing (cs.DC)
- Revisiting Lower Bounds for Two-Step Consensus
2025/05/06 by Fedor Ryabinin, Alexey Gotsman, Ryabinin, Fedor +3 · 1 voice
Computer Science · #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC) #cs.DC
- Decentralized Nonconvex Optimization under Heavy-Tailed Noise: Normalization and Optimal Convergence
2025/05/06 by Yu, Shuhua, Jakovetic, Dusan, Kar, Soummya · 2 citations
#Distributed #FOS: Computer and information sciences #FOS: Mathematics #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
- The Tensor-Core Beamformer: A High-Speed Signal-Processing Library for Multidisciplinary Use
2025/05/06 by Oostrum, Leon, Veenboer, Bram, Rook, Ronald +3 · 2 citations
#Distributed #FOS: Computer and information sciences #FOS: Physical sciences #Instrumentation and Methods for Astrophysics (astro-ph.IM) #Parallel #and Cluster Computing (cs.DC)
- MARCO: Multi-Agent Code Optimization with Real-Time Knowledge Integration for High-Performance Computing
2025/05/06 by Asif Rahman, Vanja Cvetković, Rahman, Asif +14 · 4 citations
Computer Science · #Distributed #Distributed and Parallel Computing Systems #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Metaheuristic Optimization Algorithms Research #Parallel #Software Engineering (cs.SE) #and Cluster Computing (cs.DC)
- Can Large Language Models Predict Parallel Code Performance?
2025/05/06 by Gregory Bolet, Bolet, Gregory, Giorgis Georgakoudis +13 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #and Cluster Computing (cs.DC)
- Large Language Model Partitioning for Low-Latency Inference at the Edge
2025/05/05 by Kafetzis, Dimitrios, Khalili, Ramin, Koutsopoulos, Iordanis · 4 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
2025/05/05 by Lin Zheng, Yuxin Zhang, Lin, Zheng +15 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Speech Recognition and Synthesis #Topic Modeling #and Cluster Computing (cs.DC)
- ARC-V: Vertical Resource Adaptivity for HPC Workloads in Containerized Environments
2025/05/05 by Daniel Medeiros, Medeiros, Daniel, Jeremy J. Williams +6 · 1 citation
Computer Science · #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey
2025/05/03 by Liu, Jing, Du, Yao, Yang, Kun +8 · 4 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Privacy Preserving Machine Learning Model Personalization through Federated Personalized Learning
2025/05/03 by Hosain, Md. Tanzib, Zaman, Asif, Sajid, Md. Shahriar +2 · 5 citations
#Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Memory-Centric Computing: Solving Computing's Memory Problem
2025/05/01 by Onur Mutlu, Ataberk Olgun, Mutlu, Onur +3 · 1 voice · 6 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Parallel #and Cluster Computing (cs.DC) #cs.AR #cs.DC
- AI-Based Crypto Tokens: The Illusion of Decentralized AI?
2025/04/29 by Mafrur, Rischan · 3 citations
#Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #Databases (cs.DB) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
prev more