- A Generative Caching System for Large Language Models
2025/03/22 by Iyengar, Arun, Kundu, Ashish, Kompella, Ramana +1 · 2 citations
#Artificial Intelligence (cs.AI) #Databases (cs.DB) #Distributed #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- Distributed LLMs and Multimodal Large Language Models: A Survey on Advances, Challenges, and Future Directions
2025/03/20 by Amini, Hadi, Mia, Md Jueal, Saadati, Yasaman +6 · 7 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- SPIN: Accelerating Large Language Model Inference with Heterogeneous Speculative Models
2025/03/20 by Fahao Chen, Chen, Fahao, Peng Li +7 · 8 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- On the Effectiveness of the 'Follow-the-Sun' Strategy in Mitigating the Carbon Footprint of AI in Cloud Instances
2025/03/20 by Roberto Vergallo, Vergallo, Roberto, Luís Cruz +5 · 1 citation
Computer Science · Decision Sciences · Engineering · #Artificial Intelligence (cs.AI) #Blockchain Technology Applications and Security #Computational Engineering #Distributed #FOS: Computer and information sciences #Finance #I.2.0 #Impact of AI and Big Data on Business and Society #Parallel #Smart Cities and Technologies #Software Engineering (cs.SE) #and Cluster Computing (cs.DC) #and Science (cs.CE)
- ATTENTION2D: Communication Efficient Distributed Self-Attention Mechanism
2025/03/20 by Venmugil Elango, Elango, Venmugil · 1 citation
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Distributed #Emotion and Mood Recognition #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Parallel #Text and Document Classification Technologies #and Cluster Computing (cs.DC)
- RAGO: Systematic Performance Optimization for Retrieval-Augmented Generation Serving
2025/03/18 by Jiang, Wenqi, Subramanian, Suvinay, Graves, Cat +3 · 12 citations
#Artificial Intelligence (cs.AI) #C.1 #C.4 #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #H.3 #Information Retrieval (cs.IR) #Parallel #and Cluster Computing (cs.DC)
- Communication-Efficient Distributed On-Device LLM Inference Over Wireless Networks
2025/03/19 by Kai Zhang, Hengtao He, Zhang, Kai +7 · 4 citations
Computer Science · Engineering · #Distributed #Energy Efficient Wireless Sensor Networks #FOS: Computer and information sciences #FOS: Electrical engineering #Parallel #Signal Processing (eess.SP) #Wireless Body Area Networks #Wireless Networks and Protocols #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- Unified Analysis of Decentralized Gradient Descent: a Contraction Mapping Framework
2025/03/18 by Larsson, Erik G., Michelusi, Nicolo · 2 citations
#Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Parallel #Signal Processing (eess.SP) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- Do Large Language Models Understand Performance Optimization?
2025/03/17 by Cui, Bowen, Ramesh, Tejas, Hernandez, Oscar +1 · 5 citations
#Distributed #FOS: Computer and information sciences #Parallel #Software Engineering (cs.SE) #and Cluster Computing (cs.DC)
- Optimal Expert Selection for Distributed Mixture-of-Experts at the Wireless Edge
2025/03/17 by Qin, Shengling, Wu, Hai, Du, Hongyang +1 · 2 citations
#Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Parallel #Signal Processing (eess.SP) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- Generative AI for Software Architecture. Applications, Challenges, and Future Directions
2025/03/17 by Matteo Esposito, Xiaozhou Li, Esposito, Matteo +12 · 7 citations
Computer Science · #Advanced Software Engineering Methodologies #Artificial Intelligence (cs.AI) #Distributed #Emerging Technologies (cs.ET) #FOS: Computer and information sciences #Parallel #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability #and Cluster Computing (cs.DC)
- LLM & HPC:Benchmarking DeepSeek's Performance in High-Performance Computing Tasks
2025/03/15 by Nader, Noujoud, Diehl, Patrick, Brandt, Steve +1 · 4 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Adaptive Fault Tolerance Mechanisms of Large Language Models in Cloud Computing Environments
2025/03/15 by Jin, Yihong, Yang, Ze, Xu, Xinhe +2 · 9 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- A Survey on Federated Fine-tuning of Large Language Models
2025/03/15 by Wu, Yebo, Tian, Chunlin, Li, Jingguang +7 · 11 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Story of Two GPUs: Characterizing the Resilience of Hopper H100 and Ampere A100 GPUs
2025/03/14 by Shengkun Cui, Archit Patke, Cui, Shengkun +25 · 2 voices · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC) #cs.AI #cs.DC
- Performance Analysis of Decentralized Federated Learning Deployments
2025/03/14 by Jiang, Chengyan, Fan, Jiamin, Halabi, Talal +1 · 1 citation
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- ARCAS: Adaptive Runtime System for Chiplet-Aware Scheduling
2025/03/14 by Alessandro Fogli, Fogli, Alessandro, Zhao, Bo +4 · 1 citation
Computer Science · #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #FOS: Electrical engineering #Hardware Architecture (cs.AR) #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #Systems and Control (eess.SY) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- SPPO:Efficient Long-sequence LLM Training via Adaptive Sequence Pipeline Parallel Offloading
2025/03/13 by Chen, Qiaoling, Li, Shenggui, Gao, Wei +3 · 2 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
2025/03/12 by Zachary Charles, Gabriel Teston, Charles, Zachary +14 · 2 voices · 12 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC) #cs.CL #cs.DC #cs.LG
- Introducing MareNostrum5: A European pre-exascale energy-efficient system designed to serve a broad spectrum of scientific workloads
2025/03/13 by Fabio Banchelli, Banchelli, Fabio, Marta García-Gasulla +17 · 3 citations
Computer Science · #Big Data and Digital Economy #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #and Cluster Computing (cs.DC)
- Collaborative Speculative Inference for Efficient LLM Inference Serving
2025/03/13 by Luyao Gao, Gao, Luyao, Jianchun Liu +9 · 3 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- Parallel Batch-Dynamic Maximal Matching with Constant Work per Update
2025/03/12 by Blelloch, Guy E., Brady, Andrew C. · 2 citations
#Data Structures and Algorithms (cs.DS) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- MoE-Gen: High-Throughput MoE Inference on a Single GPU with Module-Based Batching
2025/03/12 by Xu, Tairan, Xue, Leyang, Lu, Zhan +2 · 2 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Sometimes Painful but Certainly Promising: Feasibility and Trade-offs of Language Model Inference at the Edge
2025/03/12 by Maximilian Abstreiter, Sasu Tarkoma, Abstreiter, Maximilian +3 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Performance (cs.PF) #Topic Modeling #and Cluster Computing (cs.DC)
- Exploiting Unstructured Sparsity in Fully Homomorphic Encrypted DNNs
2025/03/12 by Aidan Ferguson, Perry Gibson, Ferguson, Aidan +13 · 1 voice · 2 citations
Computer Science · #Cryptography and Data Security #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Performance (cs.PF) #Security in Wireless Sensor Networks #and Cluster Computing (cs.DC) #cs.CR #cs.DC #cs.LG #cs.PF
- MILLION: Mastering Long-Context LLM Inference Via Outlier-Immunized KV Product Quantization
2025/03/12 by Zongwu Wang, Wang, Zongwu, Peng Xu +17 · 2 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #I.2.0 #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs
2025/03/12 by Timothée David--Cléris, Guillaume Laibe, David--Cléris, Timothée +3 · 2 citations
Computer Science · Engineering · #Advanced Data Storage Technologies #Distributed #FOS: Computer and information sciences #FOS: Physical sciences #Fluid Dynamics Simulations and Interactions #Instrumentation and Methods for Astrophysics (astro-ph.IM) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
2025/03/11 by Pol G. Recasens, Recasens, Pol G., Yue Zhu +12 · 16 citations
Computer Science · #AI in cancer detection #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
- Detecting Backdoor Attacks in Federated Learning via Direction Alignment Inspection
2025/03/11 by Jiahao Xu, Xu, Jiahao, Zikai Zhang +3 · 10 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Geophysical Methods and Applications #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Will LLMs Scaling Hit the Wall? Breaking Barriers via Distributed Resources on Massive Edge Devices
2025/03/11 by Tao Shen, Shen, Tao, Ziyu Zhao +8 · 7 citations
Engineering · #Advancements in Semiconductor Devices and Circuit Design #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
prev more