1. Challenges and Research Directions for Large Language Model Inference Hardware
   2026/01/08 by Xiaoyu Ma, David Patterson · 13 voices · 3 citations
   Computer Science · Materials Science · #Advanced Neural Network Applications #Architecture #Big Data and Digital Economy #Focus (optics) #Inference #Interconnection #Language model #Machine Learning in Materials Science #Memory bandwidth #Mobile device #Speedup
2. Demystifying ARM SME to Optimize General Matrix Multiplications
   2025/12/25 by Chencheng Deng, Weiling Yang, Deng, Chencheng +5 · 11 voices
   Computer Science · Engineering · #Exploit #Kernel (algebra) #Key (lock) #Linear algebra #Low-power high-performance VLSI design #Matrix (chemical analysis) #Matrix multiplication #Numerical Methods and Algorithms #Parallel Computing and Optimization Techniques #Scalability #Speedup #cs.DC
3. Sparse-LaViDa: Sparse Multimodal Discrete Diffusion Language Models
   2025/12/16 by Shufan Li, Li, Shufan, Jiuxiang Gu +11 · 3 citations
   Computer Science · #Consistency (knowledge bases) #Domain Adaptation and Few-Shot Learning #Generative Adversarial Networks and Image Synthesis #Inference #Language model #Multimodal Machine Learning Applications #Process (computing) #Range (aeronautics) #Sampling (signal processing) #Speedup #cs.CV
4. InstantSfM: Towards GPU-Native SfM for the Deep Learning Era
   2025/10/15 by Jiankun Zhong, Zitong Zhan, Zhong, Jiankun +15 · 2 citations
   Computer Science · Engineering · #Advanced Materials and Mechanics #Bundle #Bundle adjustment #Computation #Computational Geometry and Mesh Generation #Implementation #Modular Robots and Swarm Intelligence #Overhead (engineering) #Pipeline (software) #Scale (ratio) #Speedup
5. ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inference
   2025/09/28 by Haojie Ouyang, Ouyang, Haojie, Jianwei Lv +10 · 7 voices
   Computer Science · #Adapter (computing) #Benchmark (surveying) #Cache #Feature selection #Handwritten Text Recognition Techniques #Inference #Natural Language Processing Techniques #Security token #Speedup #Topic Modeling #Transformer
6. Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generation
   2025/09/23 by Shufan Li, Li, Shufan, Jiuxiang Gu +11 · 5 citations
   Computer Science · #Autoregressive model #Boosting (machine learning) #Cognitive neuroscience of visual object recognition #Domain Adaptation and Few-Shot Learning #Generative Adversarial Networks and Image Synthesis #Image (mathematics) #Multimodal Machine Learning Applications #Object (grammar) #Range (aeronautics) #Scalability #Security token #Speedup #cs.CV
7. Fantastic Pretraining Optimizers and Where to Find Them
   2025/09/02 by Kaiyue Wen, David Hall, Wen, Kaiyue +5 · 5 voices · 31 citations
   Computer Science · Mathematics · #Hyperparameter #Hyperparameter optimization #Language model #Machine Learning and Data Classification #Natural Language Processing Techniques #Outcome (game theory) #Range (aeronautics) #Speedup #Topic Modeling #cs.AI #cs.LG #stat.ML
8. M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models
   2025/04/14 by Junxiong Wang, Wang, Junxiong, Weizhong Li +11 · 3 voices · 15 citations
   Computer Science · #Automated reasoning #Computation #Context (archaeology) #Formal Methods in Verification #Inference #Logic, Reasoning, and Knowledge #Logic, programming, and type systems #Quadratic equation #Scalability #Scaling #Speedup
9. MVDRAM: Enabling GeMV Execution in Unmodified DRAM for Low-Bit LLM Acceleration
   2025/03/31 by Tatsuya Kubo, Kubo, Tatsuya, Daichi Tokuda +11 · 14 voices · 1 citation
   Computer Science · Engineering · #Bottleneck #Dram #Efficient energy use #Energy consumption #Ferroelectric and Negative Capacitance Devices #Inference #Latency (audio) #Low-power high-performance VLSI design #Parallel Computing and Optimization Techniques #Pipeline (software) #Speedup #cs.AR #cs.DC
10. Distributed quantum approximate optimization algorithm on a quantum-centric supercomputing architecture
    2024/07/29 by Seongmin Kim, Kim, Seongmin, Vincent R. Pascuzzi +10 · 6 citations
    Computer Science · Mathematics · #Algorithm #Computational science #Computer science #Convergence (economics) #Distributed computing #Mathematical optimization #Mathematics #Neural Networks and Reservoir Computing #Optimization algorithm #Optimization problem #Parallel computing #Physics #Quantum #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum algorithm #Quantum computer #Quantum mechanics #Qubit #Scalability #Scale (ratio) #Speedup #Supercomputer
11. DeepCache: Accelerating Diffusion Models for Free
    2023/12/01 by Xinyin Ma, Ma, Xinyin, Gongfan Fang +3 · 1 voice · 111 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · Physics and Astronomy · #Algorithm #Artificial intelligence #Cell Image Analysis Techniques #Computation #Computer science #Generative Adversarial Networks and Image Synthesis #Machine learning #Model Reduction and Neural Networks #Noise reduction #Parallel computing #Redundancy (engineering) #Retraining #Reuse #Speedup #cs.AI #cs.CV
12. TRAVOLTA: GPU acceleration and algorithmic improvements for constructing quantum optimal control fields in photo-excited systems
    2023/11/22 by José M. Rodríguez-Borbón, José Rodríguez-Borbón, Xian Wang +4 · 2 citations
    Computer Science · Physics and Astronomy · #Acceleration #Algorithm #CUDA #Computational science #Computer science #Parallel computing #Physics #Quantum #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum computer #SIMD #Software #Spectroscopy and Quantum Chemical Studies #Speedup
13. Exponentially Faster Language Modelling
    2023/11/15 by Peter Belcak, Belcak, Peter, Roger Wattenhofer +1 · 5 voices · 1 citation
    Computer Science · #Advanced Neural Network Applications #Artificial intelligence #Artificial neural network #Benchmarking #Code (set theory) #Computer science #Feed forward #Feedforward neural network #Inference #Natural Language Processing Techniques #Parallel computing #Programming language #Speedup #Topic Modeling
14. On the accuracy and efficiency of group-wise clipping in differentially private optimization
    2023/10/30 by Zhiqi Bu, Bu, Zhiqi, Ruixuan Liu +7 · 1 citation
    Computer Science · #Algorithm #Clipping (morphology) #Computational Complexity (cs.CC) #Computer science #Convergence (economics) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Granularity #Key (lock) #Layer (electronics) #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and ELM #Materials science #Parallel computing #Speedup #Stochastic Gradient Optimization Techniques
15. Rethinking SIGN Training: Provable Nonconvex Acceleration without First- and Second-Order Gradient Lipschitz
    2023/10/23 by Tao Sun, Congliang Chen, Sun, Tao +9 · 1 citation
    Computer Science · Engineering · Mathematics · #Acceleration #Algorithm #Applied mathematics #Artificial intelligence #Artificial neural network #Computer science #Convergence (economics) #FOS: Computer and information sciences #Lipschitz continuity #Machine Learning (cs.LG) #Mathematical analysis #Mathematical optimization #Mathematics #Privacy-Preserving Technologies in Data #Sign (mathematics) #Smoothness #Sparse and Compressive Sensing Techniques #Speedup #Stochastic Gradient Optimization Techniques
16. HyperAttention: Long-context Attention in Near-Linear Time
    2023/10/09 by In‐Su Han, Insu Han, Han, Insu +10 · 1 voice · 24 citations
    Computer Science · Mathematics · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Computer science #Context (archaeology) #Domain Adaptation and Few-Shot Learning #Hash function #Inference #Mathematics #Matrix (chemical analysis) #Matrix completion #Multimodal Machine Learning Applications #Parallel computing #Quadratic equation #Rank (graph theory) #Speedup #Theoretical computer science #Time complexity #cs.AI #cs.LG
17. Efficient Streaming Language Models with Attention Sinks
    2023/09/29 by Guangxuan Xiao, Xiao, Guangxuan, Yuandong Tian +7 · 5 voices · 645 citations
    Computer Science · #Algorithm #Artificial intelligence #Cache #Computer network #Computer science #Decoding methods #Language model #Natural Language Processing Techniques #Parallel computing #Security token #Sequence (biology) #Sink (geography) #Sliding window protocol #Speech Recognition and Synthesis #Speedup #Topic Modeling #Window (computing) #World Wide Web
18. SIMD Everywhere Optimization from ARM NEON to RISC-V Vector Extensions
    2023/09/28 by Ju-Hung Li, Jocelyn Li, Jhih-Kuan Lin +15 · 2 voices · 2 citations
    Computer Science · #Code (set theory) #Compiler #Computer science #Intrinsics #Overhead (engineering) #Parallel Computing and Optimization Techniques #Parallel computing #Programming language #SIMD #Security and Verification in Computing #Set (abstract data type) #Software #Software Testing and Debugging Techniques #Solver #Speedup #Vectorization (mathematics) #cs.DC #cs.PL #x86
19. Matrix Multiplication Using Only Addition
    2023/07/04 by Daniel Cussen, Cussen, Daniel, Jeffrey D. Ullman +1 · 1 voice
    Computer Science · Mathematics · #Algorithm #Arithmetic #Chip #Computer science #Mathematics #Matrix (chemical analysis) #Matrix multiplication #Multiplication (music) #Multiplier (economics) #Parallel Computing and Optimization Techniques #Parallel computing #Physics #Quantum Computing Algorithms and Architecture #Quantum-Dot Cellular Automata #Scalar (mathematics) #Scalar multiplication #Speedup #Telecommunications #cs.DS
20. Training Energy-Based Normalizing Flow with Score-Matching Objectives
    2023/05/24 by Chen-Hao Chao, Chao, Chen-Hao, Weifang Sun +7 · 2 citations
    Computer Science · Mathematics · Physics and Astronomy · #Algorithm #Applied mathematics #Computation #Computer science #FOS: Computer and information sciences #Feature (linguistics) #Flow (mathematics) #Generative Adversarial Networks and Image Synthesis #Jacobian matrix and determinant #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine learning #Margin (machine learning) #Matching (statistics) #Mathematics #Model Reduction and Neural Networks #Music and Audio Processing #Speedup #Stability (learning theory) #Statistics #Training (meteorology)
21. Opening the Black Box inside Grover’s Algorithm
    2023/03/20 by E. Miles Stoudenmire, E. M. Stoudenmire, Xavier Waintal · 2 voices · 7 citations
    Computer Science · Mathematics · #Algorithm #Computability, Logic, AI Algorithms #Computer science #Gas meter prover #Mathematical proof #Mathematics #Oracle #Parallel computing #Physics #Programming language #Quantum #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum algorithm #Quantum circuit #Quantum computer #Quantum error correction #Quantum mechanics #Quantum phase estimation algorithm #Quantum sort #Qubit #Speedup #Theoretical computer science
22. PyPose: A Library for Robot Learning with Physics-based Optimization
    2022/09/30 by Chen Wang, Dasong Gao, Kuan Xu +34 · 13 citations
    Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial intelligence #Computer science #Deep learning #Human–computer interaction #Robot #Robotics #Robotics and Sensor-Based Localization #Speedup
23. ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization
    2022/08/30 by Cong Guo, Chen Zhang, Guo, Cong +13 · 16 citations
    Computer Science · Mathematics · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Artificial neural network #Computation #Computer engineering #Computer science #Exploit #FOS: Computer and information sciences #Floating point #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Parallel computing #Quantization (signal processing) #Speedup #Tensor decomposition and applications
24. Quantum vs. Classical Algorithms for Solving the Heat Equation
    2022/08/24 by Noah Linden, Ashley Montanaro, Changpeng Shao · 21 citations
    Computer Science · Mathematics · #Algorithm #Computer science #Dimension (graph theory) #Geometry #Heat equation #Mathematical analysis #Mathematics #Physics #Pure mathematics #Quadratic equation #Quantum #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum algorithm #Quantum mechanics #Speedup #Stochastic Gradient Optimization Techniques
25. General Cutting Planes for Bound-Propagation-Based Neural Network Verification
    2022/08/11 by Huan Zhang, Zhang, Huan, Shiqi Wang +13 · 18 citations
    Computer Science · Mathematics · Physics and Astronomy · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Algorithm #Artificial intelligence #Artificial neural network #Benchmark (surveying) #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Correctness #Cryptography and Security (cs.CR) #Cutting-plane method #FOS: Computer and information sciences #FOS: Mathematics #Integer programming #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Mathematical optimization #Mathematics #Model Reduction and Neural Networks #Optimization and Control (math.OC) #Parallel computing #Solver #Speedup #Upper and lower bounds
26. Computing elementary functions using multi-prime argument reduction
    2022/07/06 by Fredrik Johansson, Johansson, Fredrik · 2 citations
    Computer Science · Mathematics · #Algorithm #Combinatorics #Computation #Computer science #Cryptography and Residue Arithmetic #Diophantine equation #Discrete logarithm #Discrete mathematics #Elementary function #FOS: Mathematics #Integer (computer science) #Logarithm #Mathematics #Number Theory (math.NT) #Numerical Analysis (math.NA) #Numerical Methods and Algorithms #Parallel computing #Polynomial and algebraic computation #Precomputation #Prime (order theory) #Prime factor #Reduction (mathematics) #Set (abstract data type) #Speedup #State (computer science)
27. FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
    2022/05/27 by Tri Dao, Dao, Tri, Daniel Y. Fu +7 · 8 voices · 1125 citations
    Computer Science · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Computer science #Domain Adaptation and Few-Shot Learning #FLOPS #Language model #Machine Learning and Data Classification #Memory bandwidth #Parallel computing #Perplexity #Speedup #cs.LG
28. The Larger The Fairer? Small Neural Networks Can Achieve Fairness for Edge Devices
    2022/02/23 by Yi Sheng, Sheng, Yi, Junhuan Yang +13 · 2 citations
    Computer Science · Engineering · Medicine · #Architecture #Artificial intelligence #Artificial neural network #Computer engineering #Computer science #Computers and Society (cs.CY) #Cutaneous Melanoma Detection and Management #Deep neural networks #Edge device #Engineering #Enhanced Data Rates for GSM Evolution #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile device #Operating system #Parallel computing #Range (aeronautics) #Speedup #cs.CY #cs.LG
29. Quantum solutions to possible challenges of Blockchain technology
    2021/10/11 by Nivedita Dey, Dey, Nivedita, Mrityunjay Ghosh +3 · 1 citation
    Computer Science · #Blockchain #Blockchain Technology Applications and Security #Computer science #Computer security #Cryptography #Cryptography and Data Security #Cryptography and Security (cs.CR) #Cryptosystem #Database #Distributed computing #Emerging Technologies (cs.ET) #FOS: Computer and information sciences #Hash function #Parallel computing #Quantum #Quantum Computing Algorithms and Architecture #Quantum computer #Scalability #Speedup #Theoretical computer science #cs.CR #cs.ET
30. An improved chain of spheres for exchange algorithm
    2021/09/13 by Benjamin Helmich-Paris, Benjamin Helmich‐Paris, Bernardo de Souza +2 · 65 citations
    Chemistry · Mathematics · Physics and Astronomy · #Advanced Chemical Physics Studies #Advanced NMR Techniques and Applications #Algorithm #Basis (linear algebra) #Chemistry #Computation #Computer science #Geometry #Grid #Mathematics #Matrix (chemical analysis) #Parallel computing #Physics #SPHERES #Spectroscopy and Quantum Chemical Studies #Speedup #Statistical physics

more