1. Kascade: A Practical Sparse Attention Method for Long-Context LLM Inference
   2025/12/18 by Deshmukh, Dhruv, Goyal, Saurabh, Kwatra, Nipun +1 · 4 citations
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Parallel #and Cluster Computing (cs.DC)
2. Efficient CPU-GPU Collaborative Inference for MoE-based LLMs on Memory-Limited Systems
   2025/12/18 by Huang, En-Ming, Lin, Li-Shang, Lee, Chun-Yi · 1 citation
   Computer Science · #Big Data and Digital Economy #Distributed #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
3. ELANA: A Simple Energy and Latency Analyzer for LLMs
   2025/12/07 by Chiang, Hung-Yueh, Wang, Bokun, Marculescu, Diana · 1 citation
   #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
4. Agentic Operator Generation for ML ASICs
   2025/12/03 by Hammond, Alec M., Markosyan, Aram, Dontula, Aman +15 · 2 citations
   #Distributed #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Parallel #Programming Languages (cs.PL) #and Cluster Computing (cs.DC)
5. A lasso-alternative to Dijkstra's algorithm for identifying short paths in networks
   2025/11/27 by Dong, Anqi, Taghvaei, Amirhossein, Georgiou, Tryphon T. · 1 citation
   #05C38 #05C50 #05C85 #62J07 #90C25 #Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Image and Video Processing (eess.IV) #Optimization and Control (math.OC) #Parallel #Social and Information Networks (cs.SI) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
6. ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels
   2025/11/17 by Sul, Stuart H., Arora, Simran, Spector, Benjamin F. +1 · 2 citations
   #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
7. Inside VOLT: Designing an Open-Source GPU Compiler
   2025/11/13 by Jeong, Shinnung, Ahn, Chihyo, Pu, Huanzhi +3 · 1 voice
   #C.1.2 #D.3.4 #Distributed #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Parallel #Programming Languages (cs.PL) #and Cluster Computing (cs.DC)
8. PRAGMA: A Profiling-Reasoned Multi-Agent Framework for Automatic Kernel Optimization
   2025/11/09 by Lei, Kelun, Yang, Hailong, Zhang, Huaitao +5 · 1 citation
   #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
9. Universal Quantum Simulation of 50 Qubits on Europe`s First Exascale Supercomputer Harnessing Its Heterogeneous CPU-GPU Architecture
   2025/11/05 by De Raedt, Hans, Kraus, Jiri, Herten, Andreas +5 · 6 citations
   #Computational Physics (physics.comp-ph) #Distributed #FOS: Computer and information sciences #FOS: Physical sciences #Parallel #Quantum Physics (quant-ph) #and Cluster Computing (cs.DC)
10. Glia: A Human-Inspired AI for Automated Systems Design and Optimization
    2025/10/31 by Hamadanian, Pouya, Karimi, Pantea, Nasr-Esfahany, Arash +5 · 2 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
11. FlowMesh: A Service Fabric for Composable LLM Workflows
    2025/10/30 by Shen, Junyi, Wadlom, Noppanat, Zhou, Lingfeng +4 · 1 citation
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
12. CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization
    2025/10/23 by Zijian Zhang, Rong Wang, Zhang, Zijian +8 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
13. Tokencake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications
    2025/10/21 by Bian, Zhuohang, Wu, Feiyang, Ma, Teng +1 · 1 citation
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
14. MTraining: Distributed Dynamic Sparse Attention for Efficient Ultra-Long Context Training
    2025/10/21 by W. G. Li, Chengruidong Zhang, Li, Wenxuan +9 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Multimodal Machine Learning Applications #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
15. Service-Level Energy Modeling and Experimentation for Cloud-Native Microservices
    2025/10/15 by Legler, Julian, Werner, Sebastian, Borges, Maria C. +1 · 1 citation
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
16. Laminar: A Scalable Asynchronous RL Post-Training Framework
    2025/10/14 by Sheng, Guangming, Tong, Yuxuan, Wan, Borui +10 · 5 citations
    #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
17. SP-MoE: Speculative Decoding and Prefetching for Accelerating MoE-based Model Inference
    2025/10/11 by Chen, Liangkun, Wen, Zijian, Wu, Tian +2 · 1 citation
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
18. SPAD: Specialized Prefill and Decode Hardware for Disaggregated LLM Inference
    2025/10/09 by Hengrui Zhang, Zhang, Hengrui, Pratyush Patel +5 · 2 citations
    Computer Science · #Advanced Graph Neural Networks #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
19. Speculative Actions: A Lossless Framework for Faster Agentic Systems
    2025/10/05 by Naimeng Ye, Ye, Naimeng, Georgios Liargkovas +8 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Multi-Agent Systems and Negotiation #Multiagent Systems (cs.MA) #Parallel #and Cluster Computing (cs.DC)
20. TeraAgent: A Distributed Agent-Based Simulation Engine for Simulating Half a Trillion Agents
    2025/09/28 by Lukas Breitwieser, Breitwieser, Lukas, Ahmad Hesam +9 · 1 voice
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Computational Engineering #Distributed #FOS: Biological sciences #FOS: Computer and information sciences #Finance #Multiagent Systems (cs.MA) #Parallel #Performance (cs.PF) #Quantitative Methods (q-bio.QM) #and Cluster Computing (cs.DC) #and Science (cs.CE) #cs.CE #cs.DC #cs.MA #cs.PF #q-bio.QM
21. Multiple Concurrent Proposers: Why and How
    2025/09/28 by Pranav Garimidi, Joachim Neu, Garimidi, Pranav +3 · 3 citations
    Computer Science · Engineering · #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Manufacturing Process and Optimization #Model-Driven Software Engineering Techniques #Modular Robots and Swarm Intelligence #Parallel #and Cluster Computing (cs.DC)
22. SysMoBench: Evaluating AI on Formally Modeling Complex Real-World Systems
    2025/09/27 by Cheng, Qian, Tang, Ruize, Ma, Emilie +7 · 1 citation
    #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #Software Engineering (cs.SE) #and Cluster Computing (cs.DC)
23. RollPacker: Mitigating Long-Tail Rollouts for Fast, Synchronous RL Post-Training
    2025/09/25 by Wei Gao, Gao, Wei, Yuheng Zhao +24 · 7 citations
    Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Real-Time Systems Scheduling #Real-time simulation and control systems #Software Reliability and Analysis Research #and Cluster Computing (cs.DC)
24. BurstEngine: an Efficient Distributed Framework for Training Transformers on Extremely Long Sequences of over 1M Tokens
    2025/09/24 by Sun, Ao, Zhao, Weilin, Han, Xu +4 · 2 citations
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
25. Gyges: Dynamic Cross-Instance Parallelism Transformation for Efficient LLM Inference
    2025/09/24 by Chen, Haoyu, Li, Xue, Qian, Kun +3 · 1 citation
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
26. Robust LLM Training Infrastructure at ByteDance
    2025/09/19 by Wan, Borui, Liu, Gaohong, Song, Zuquan +32 · 5 citations
    #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
27. RLinf: Flexible and Efficient Large-scale Reinforcement Learning via Macro-to-Micro Flow Transformation
    2025/09/19 by Chao Yu, Yuanqing Wang, Yu, Chao +52 · 7 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Reinforcement Learning in Robotics #and Cluster Computing (cs.DC)
28. How Exclusive are Ethereum Transactions? Evidence from non-winning blocks
    2025/09/19 by Vabuk Pahari, Andrea Canidio, Pahari, Vabuk +1 · 1 citation
    Business, Management and Accounting · #Corporate Finance and Governance #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #FOS: Economics and business #General Economics (econ.GN) #Parallel #Private Equity and Venture Capital #and Cluster Computing (cs.DC)
29. Characterizing the Efficiency of Distributed Training: A Power, Performance, and Thermal Perspective
    2025/09/12 by Go, Seokjin, Park, Joongun, More, Spandan +5 · 4 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
30. Astra: A Multi-Agent System for GPU Kernel Performance Optimization
    2025/09/09 by Anjiang Wei, Wei, Anjiang, Yogesh Seenichamy +12 · 11 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Software Engineering (cs.SE) #and Cluster Computing (cs.DC)

more