- ByteScale: Efficient Scaling of LLM Training with a 2048K Context Length on More Than 12,000 GPUs
2025/02/28 by Ge, Hao, Feng, Junda, Huang, Qi +6 · 5 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Elastic Restaking Networks
2025/02/28 by Roi Bar-Zur, Ittay Eyal, Bar-Zur, Roi +1 · 1 voice · 3 citations
Computer Science · #Computer Science and Game Theory (cs.GT) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.GT
- LADs: Leveraging LLMs for AI-Driven DevOps
2025/02/28 by Ahmad Faraz Khan, Azal Ahmad Khan, Khan, Ahmad Faraz +17 · 1 voice · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Software Engineering (cs.SE) #and Cluster Computing (cs.DC) #cs.AI #cs.DC #cs.LG #cs.SE
- TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrieval
2025/02/28 by Lin, Chien-Yu, Kamahori, Keisuke, Liu, Yiyu +11 · 4 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- SPD: Sync-Point Drop for Efficient Tensor Parallelism of Large Language Models
2025/02/28 by Kim, Han-Byul, Hoang, Duc, Kundu, Arnav +2 · 4 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- SkyStore: Cost-Optimized Object Storage Across Regions and Clouds
2025/02/28 by Liu, Shu, Mo, Xiangxi, Hershcovitch, Moshik +11 · 2 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Deep RC: A Scalable Data Engineering and Deep Learning Pipeline
2025/02/28 by Sarker, Arup Kumar, Alsaadi, Aymen, Halpern, Alexander James +7 · 2 citations
#D.2.2 #D.2.7 #Distributed #FOS: Computer and information sciences #H.2.4 #Parallel #and Cluster Computing (cs.DC)
- Methodology for GPU Frequency Switching Latency Measurement
2025/02/27 by Daniel Velicka, Velicka, Daniel, Ondřej Vysocký +3 · 4 citations
Computer Science · #Big Data and Digital Economy #Distributed #Embedded Systems Design Techniques #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Building a Theory of Distributed Systems: Work by Nancy Lynch and Collaborators
2025/02/27 by Nancy Lynch, Lynch, Nancy · 2 voices
Computer Science · #Distributed #Distributed systems and fault tolerance #FOS: Computer and information sciences #Formal Methods in Verification #Optimization and Search Problems #Parallel #and Cluster Computing (cs.DC) #cs.DC
- SkipPipe: Partial and Reordered Pipelining Framework for Training LLMs in Heterogeneous Networks
2025/02/27 by Nikolay Blagoev, Blagoev, Nikolay, Lydia Y. Chen +3 · 3 citations
Computer Science · #Advanced Neural Network Applications #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- Systems and Algorithms for Convolutional Multi-Hybrid Language Models at Scale
2025/02/25 by Jerome Ku, Ku, Jerome, Eric Nguyen +29 · 1 voice · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC) #cs.AI #cs.CL #cs.DC #cs.LG
- Efficient Federated Search for Retrieval-Augmented Generation
2025/02/26 by Guerraoui, Rachid, Kermarrec, Anne-Marie, Petrescu, Diana +3 · 1 citation
#Distributed #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Kitsune: Enabling Dataflow Execution on GPUs
2025/02/25 by Michael A. Davies, Michael Davies, Davies, Michael +6 · 2 voices
Computer Science · #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC) #cs.AR #cs.DC
- Differentially Private Federated Learning With Time-Adaptive Privacy Spending
2025/02/25 by Shahrzad Kiani, Kiani, Shahrzad, Nupur Kulkarni +7 · 4 citations
Computer Science · Social Sciences · #Cryptography and Security (cs.CR) #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- GPUArmor: A Hardware-Software Co-design for Efficient and Scalable Memory Safety on GPUs
2025/02/25 by Ziad, Mohamed Tarek Ibn, Damani, Sana, Stephenson, Mark +2 · 1 citation
#Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Parallel #Systems and Control (eess.SY) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- Can Tensor Cores Benefit Memory-Bound Kernels? (No!)
2025/02/24 by Lingqi Zhang, Jiajun Huang, Zhang, Lingqi +7 · 3 citations
Computer Science · Mathematics · #Computational Physics and Python Applications #Distributed #FOS: Computer and information sciences #Parallel #Performance (cs.PF) #Tensor decomposition and applications #and Cluster Computing (cs.DC)
- Robust Federated Learning in Unreliable Wireless Networks: A Client Selection Approach
2025/02/24 by Yanmeng Wang, Wang, Yanmeng, Wenkang Ji +7 · 3 citations
Computer Science · Engineering · #Advanced Data and IoT Technologies #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Opportunistic and Delay-Tolerant Networks #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure
2025/02/22 by The AIBrix Team, Jiaxin Shan, Varun Gupta +55 · 1 voice · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Software System Performance and Reliability #and Cluster Computing (cs.DC) #cs.AI #cs.DC
- PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing System
2025/02/21 by He, Yintao, Mao, Haiyu, Giannoula, Christina +6 · 15 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Revolutionizing Datacenter Networks via Reconfigurable Topologies
2025/02/22 by Chen Avin, Avin, Chen, Stefan Schmid +1 · 2 citations
Computer Science · #Cloud Computing and Resource Management #Distributed #Embedded Systems Design Techniques #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI) #Parallel #Software System Performance and Reliability #and Cluster Computing (cs.DC)
- Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning
2025/02/21 by Singhal, Raghav, Ponkshe, Kaustubh, Vartak, Rohit +2 · 7 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- HydraServe: Minimizing Cold Start Latency for Serverless LLM Serving in Public Clouds
2025/02/21 by Chiheng Lou, Lou, Chiheng, Sheng Qi +13 · 8 citations
Computer Science · #Caching and Content Delivery #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Parallel #Software-Defined Networks and 5G #and Cluster Computing (cs.DC)
- Minions: Cost-efficient Collaboration Between On-device and Cloud Language Models
2025/02/21 by Avanika Narayan, Dan Biderman, Narayan, Avanika +11 · 10 citations
Computer Science · #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Cloud Computing and Resource Management #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Blockchain-based Framework for Scalable and Incentivized Federated Learning
2025/02/20 by Bo Wu, Oshani Seneviratne, Wu, Bijun +1 · 2 citations
Computer Science · #Blockchain Technology Applications and Security #Cryptography and Data Security #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- Optimizing the Longhorn Cloud-native Software Defined Storage Engine for High Performance
2025/02/20 by Konstantinos Kampadais, Antony Chazapis, Kampadais, Konstantinos +3 · 1 citation
Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- LLM4FaaS: No-Code Application Development using LLMs and FaaS
2025/02/20 by Minghe Wang, Tobias Pfandzelter, Wang, Minghe +5 · 2 citations
Computer Science · #Advanced Computational Techniques and Applications #Distributed #FOS: Computer and information sciences #Parallel #Software Engineering (cs.SE) #and Cluster Computing (cs.DC)
- GenAI at the Edge: Comprehensive Survey on Empowering Edge Devices
2025/02/19 by Mozhgan Navardi, Navardi, Mozhgan, Romina Aalishah +10 · 8 citations
Computer Science · Engineering · #Advanced Semiconductor Detectors and Materials #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Parallel #and Cluster Computing (cs.DC)
- CarbonEdge: Leveraging Mesoscale Spatial Carbon-Intensity Variations for Low Carbon Edge Computing
2025/02/19 by Wu Li, Walid A. Hanafy, Wu, Li +12 · 3 citations
Computer Science · #Computer Graphics and Visualization Techniques #Data Visualization and Analytics #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- The Early Days of the Ethereum Blob Fee Market and Lessons Learnt
2025/02/18 by Lioba Heimbach, Jason Milionis, Heimbach, Lioba +1 · 5 citations
Computer Science · Engineering · #Advanced Optical Network Technologies #Blockchain Technology Applications and Security #Computational Engineering #Cryptography and Security (cs.CR) #Distributed #Emerging Technologies (cs.ET) #FOS: Computer and information sciences #FOS: Economics and business #Finance #General Economics (econ.GN) #Parallel #Peer-to-Peer Network Technologies #and Cluster Computing (cs.DC) #and Science (cs.CE)
- Min-Max Correlation Clustering via Neighborhood Similarity
2025/02/18 by Cao, Nairen, Roche, Steven, Su, Hsin-Hao · 1 citation
#Data Structures and Algorithms (cs.DS) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
prev more