- Challenges and Research Directions for Large Language Model Inference Hardware
2026/01/08 by Xiaoyu Ma, David Patterson · 13 voices · 2 citations
Computer Science · Materials Science · #Advanced Neural Network Applications #Architecture #Big Data and Digital Economy #Focus (optics) #Inference #Interconnection #Language model #Machine Learning in Materials Science #Memory bandwidth #Mobile device #Speedup
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
2022/05/27 by Tri Dao, Daniel Y. Fu, Dao, Tri +7 · 8 voices · 1081 citations
Computer Science · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Computer science #Domain Adaptation and Few-Shot Learning #FLOPS #Language model #Machine Learning and Data Classification #Memory bandwidth #Parallel computing #Perplexity #Speedup #cs.LG
- Shuhai: A Tool for Benchmarking High Bandwidth Memory on FPGAs
2021/04/28 by Hongjing Huang, Zeke Wang, Jie Zhang +4 · 3 citations
Computer Science · #Advanced Data Storage Technologies #Bandwidth (computing) #Benchmark (surveying) #Benchmarking #Bottleneck #Cache #Computer architecture #Computer engineering #Computer science #Embedded system #Field-programmable gate array #Memory bandwidth #Memory hierarchy #Network Packet Processing and Optimization #Parallel Computing and Optimization Techniques #Parallel computing
- ZEFR: A GPU-accelerated high-order solver for compressible viscous flows using the flux reconstruction method
2020/01/28 by Joshua Romero, J. Romero, J. Crabill +5 · 3 citations
Engineering · #Advanced Numerical Methods in Computational Mathematics #CUDA #Computational Fluid Dynamics and Aerodynamics #Computational science #Computer science #Lattice Boltzmann Simulation Studies #Memory bandwidth #Parallel computing #SIMD #Scalability #Solver
- TicToc: Enabling Bandwidth-Efficient DRAM Caching for both Hits and Misses in Hybrid Memory Systems
2019/07/03 by Vinson Young, Zeshan Chishti, Young, Vinson +3 · 1 citation
Computer Science · Engineering · #Advanced Data Storage Technologies #Advanced Memory and Neural Computing #Bandwidth (computing) #CAS latency #Cache #Computer hardware #Computer network #Computer science #Dram #Embedded system #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Instruction prefetch #Latency (audio) #Memory bandwidth #Memory controller #Metadata #Operating system #Parallel Computing and Optimization Techniques #Parallel computing #Semiconductor memory #Telecommunications #cs.AR
- CRAM: Efficient Hardware-Based Memory Compression for Bandwidth Enhancement
2018/07/19 by Vinson Young, Sanjay Kariyappa, Young, Vinson +3 · 2 voices
Computer Science · #Advanced Data Storage Technologies #Algorithm #Algorithms and Data Compression #Bandwidth (computing) #Compression (physics) #Computer hardware #Computer network #Computer science #Data compression #Embedded system #Memory bandwidth #Metadata #Operating system #Parallel Computing and Optimization Techniques #Parallel computing #cs.AR