2017/10/01 by Di Yan, Tao Wu, Ying Liu +1 · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies #Stochastic Gradient Optimization Techniques #Computer science #Sparse matrix #Speedup #Parallel computing #Matrix multiplication #Kernel (algebra) #Multi-core processor #Scalability #Block (permutation group theory) #FLOPS #Multiplication (music) #Computation #Computational science #Algorithm #Operating system
paper · doi:10.1109/icct.2017.8359956
openalex publication_date 2017/10/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/29
Deep Neural Network (DNN) is currently widely used in various applications, such as speech recognition, computer vision, etc. The computation kernel of DNN-based applications is large sparse-dense matrix multiplication. As the performance of existing methods and software libraries for sparse matrix multiplication is not as good as expected, real-time recognition process has not been achieved yet. Therefore, we propose a novel sparse matrix storage format, block-based CSR (compressed storage format) and COO (coordinate format), called BCSR&BCOO, and a thread-scalable computing kernel for sparse-dense matrix multiplication, called BSpMM. We evaluate the performance of our proposed data structure and computing kernel in a real application in DNN-based online speech recognition. The experimental results demonstrate up to 4x speedup over Intel MKL on a typical CPU-based multicore system. Significant improvement in FLOPS is observed as well.