- Jenga: Effective Memory Management for Serving LLM with Heterogeneity
2025/03/24 by Zhang, Chen, Du, Kuntai, Liu, Shu +10 · 5 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Monte Cimone v2: Down the Road of RISC-V High-Performance Computers
2025/03/24 by Venieri, Emanuele, Manoni, Simone, Ceccolini, Gabriele +6 · 1 citation
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training
2025/03/23 by Wang, Zheng, Cai, Anna, Xie, Xinfeng +9 · 12 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #I.2.11 #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- A Theoretical Framework for Graph-based Digital Twins for Supply Chain Management and Optimization
2025/03/23 by Azmine Toushik Wasi, Mahfuz Ahmed Anik, Wasi, Azmine Toushik +9 · 2 citations
Business, Management and Accounting · Computer Science · Engineering · #Digital Transformation in Industry #Distributed #FOS: Computer and information sciences #Graph Theory and Algorithms #Machine Learning (cs.LG) #Parallel #Supply Chain Resilience and Risk Management #and Cluster Computing (cs.DC)
- PipeBoost: Resilient Pipelined Architecture for Fast Serverless LLM Scaling
2025/03/22 by Liu, Chongpeng, Liao, Xiaojian, Liu, Hancheng +2 · 2 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Energy Efficiency trends in HPC: what high-energy and astrophysicists need to know
2025/03/21 by Estela Suarez, Jorge Amaya, Suarez, Estela +11 · 1 voice · 3 citations
Computer Science · Physics and Astronomy · #Computational Physics (physics.comp-ph) #Cosmology and Nongalactic Astrophysics (astro-ph.CO) #Distributed #FOS: Computer and information sciences #FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #High Energy Physics - Lattice (hep-lat) #Parallel #Solar and Stellar Astrophysics (astro-ph.SR) #and Cluster Computing (cs.DC) #astro-ph.CO #astro-ph.SR #cs.DC #hep-ex #hep-lat #physics.comp-ph
- Sense4FL: Vehicular Crowdsensing Enhanced Federated Learning for Object Detection in Autonomous Driving
2025/03/22 by Yanan Ma, Ma, Yanan, Senkang Hu +9 · 2 citations
Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Mobile Crowdsensing and Crowdsourcing #Parallel #Privacy-Preserving Technologies in Data #Robotics (cs.RO) #Traffic Prediction and Management Techniques #and Cluster Computing (cs.DC)
- A Generative Caching System for Large Language Models
2025/03/22 by Iyengar, Arun, Kundu, Ashish, Kompella, Ramana +1 · 2 citations
#Artificial Intelligence (cs.AI) #Databases (cs.DB) #Distributed #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- Distributed LLMs and Multimodal Large Language Models: A Survey on Advances, Challenges, and Future Directions
2025/03/20 by Amini, Hadi, Mia, Md Jueal, Saadati, Yasaman +6 · 7 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- SPIN: Accelerating Large Language Model Inference with Heterogeneous Speculative Models
2025/03/20 by Fahao Chen, Peng Li, Chen, Fahao +7 · 8 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- On the Effectiveness of the 'Follow-the-Sun' Strategy in Mitigating the Carbon Footprint of AI in Cloud Instances
2025/03/20 by Vergallo, Roberto, Cruz, Luís, Errico, Alessio +1 · 1 citation
#Artificial Intelligence (cs.AI) #Computational Engineering #Distributed #FOS: Computer and information sciences #Finance #I.2.0 #Parallel #Software Engineering (cs.SE) #and Cluster Computing (cs.DC) #and Science (cs.CE)
- ATTENTION2D: Communication Efficient Distributed Self-Attention Mechanism
2025/03/20 by Venmugil Elango, Elango, Venmugil · 1 citation
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Distributed #Emotion and Mood Recognition #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Parallel #Text and Document Classification Technologies #and Cluster Computing (cs.DC)
- RAGO: Systematic Performance Optimization for Retrieval-Augmented Generation Serving
2025/03/18 by Jiang, Wenqi, Subramanian, Suvinay, Graves, Cat +3 · 10 citations
#Artificial Intelligence (cs.AI) #C.1 #C.4 #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #H.3 #Information Retrieval (cs.IR) #Parallel #and Cluster Computing (cs.DC)
- Communication-Efficient Distributed On-Device LLM Inference Over Wireless Networks
2025/03/19 by Kai Zhang, Zhang, Kai, Hengtao He +7 · 3 citations
Computer Science · Engineering · #Distributed #Energy Efficient Wireless Sensor Networks #FOS: Computer and information sciences #FOS: Electrical engineering #Parallel #Signal Processing (eess.SP) #Wireless Body Area Networks #Wireless Networks and Protocols #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- Unified Analysis of Decentralized Gradient Descent: a Contraction Mapping Framework
2025/03/18 by Larsson, Erik G., Michelusi, Nicolo · 2 citations
#Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Parallel #Signal Processing (eess.SP) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- Do Large Language Models Understand Performance Optimization?
2025/03/17 by Cui, Bowen, Ramesh, Tejas, Hernandez, Oscar +1 · 5 citations
#Distributed #FOS: Computer and information sciences #Parallel #Software Engineering (cs.SE) #and Cluster Computing (cs.DC)
- Optimal Expert Selection for Distributed Mixture-of-Experts at the Wireless Edge
2025/03/17 by Qin, Shengling, Wu, Hai, Du, Hongyang +1 · 2 citations
#Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Parallel #Signal Processing (eess.SP) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- Generative AI for Software Architecture. Applications, Challenges, and Future Directions
2025/03/17 by Matteo Esposito, Xiaozhou Li, Esposito, Matteo +12 · 5 citations
Computer Science · #Advanced Software Engineering Methodologies #Artificial Intelligence (cs.AI) #Distributed #Emerging Technologies (cs.ET) #FOS: Computer and information sciences #Parallel #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability #and Cluster Computing (cs.DC)
- LLM & HPC:Benchmarking DeepSeek's Performance in High-Performance Computing Tasks
2025/03/15 by Nader, Noujoud, Diehl, Patrick, Brandt, Steve +1 · 4 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Adaptive Fault Tolerance Mechanisms of Large Language Models in Cloud Computing Environments
2025/03/15 by Jin, Yihong, Yang, Ze, Xu, Xinhe +2 · 9 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Story of Two GPUs: Characterizing the Resilience of Hopper H100 and Ampere A100 GPUs
2025/03/14 by Shengkun Cui, Cui, Shengkun, Archit Patke +25 · 2 voices · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC) #cs.AI #cs.DC
- A Survey on Federated Fine-tuning of Large Language Models
2025/03/15 by Wu, Yebo, Tian, Chunlin, Li, Jingguang +7 · 10 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Performance Analysis of Decentralized Federated Learning Deployments
2025/03/14 by Jiang, Chengyan, Fan, Jiamin, Halabi, Talal +1 · 1 citation
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- ARCAS: Adaptive Runtime System for Chiplet-Aware Scheduling
2025/03/14 by Alessandro Fogli, Fogli, Alessandro, Peter Pietzuch +4 · 1 citation
Computer Science · #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #FOS: Electrical engineering #Hardware Architecture (cs.AR) #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #Systems and Control (eess.SY) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- SPPO:Efficient Long-sequence LLM Training via Adaptive Sequence Pipeline Parallel Offloading
2025/03/13 by Chen, Qiaoling, Li, Shenggui, Gao, Wei +3 · 2 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
2025/03/12 by Zachary Charles, Gabriel Teston, Charles, Zachary +14 · 2 voices · 12 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC) #cs.CL #cs.DC #cs.LG
- Introducing MareNostrum5: A European pre-exascale energy-efficient system designed to serve a broad spectrum of scientific workloads
2025/03/13 by Fabio Banchelli, Marta García-Gasulla, Banchelli, Fabio +17 · 3 citations
Computer Science · #Big Data and Digital Economy #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #and Cluster Computing (cs.DC)
- Collaborative Speculative Inference for Efficient LLM Inference Serving
2025/03/13 by Luyao Gao, Jianchun Liu, Gao, Luyao +9 · 3 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- Parallel Batch-Dynamic Maximal Matching with Constant Work per Update
2025/03/12 by Blelloch, Guy E., Brady, Andrew C. · 2 citations
#Data Structures and Algorithms (cs.DS) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- MoE-Gen: High-Throughput MoE Inference on a Single GPU with Module-Based Batching
2025/03/12 by Xu, Tairan, Xue, Leyang, Lu, Zhan +2 · 2 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
prev more