2021/04/29 by Yao Wang, Xingyu Zhou, Wang, Yao +9 · 1 citation
Computer Science · Mathematics · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Tensor decomposition and applications #and Cluster Computing (cs.DC) #cs.DC
paper · pdf · doi:10.48550/arxiv.2104.14641
openalex publication_date 2021/04/29 · arxiv created 2021/05/16 · arxiv updated 2021/05/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
We introduce Tuna, a static analysis approach to optimizing deep neural network programs. The optimization of tensor operations such as convolutions and matrix multiplications is the key to improving the performance of deep neural networks. Many deep learning model optimization mechanisms today use dynamic analysis, which relies on experimental execution on a target device to build a data-driven cost model of the program. The reliance on dynamic profiling not only requires access to target hardware at compilation time but also incurs significant cost in machine resources. We introduce an approach that profiles the program by constructing features based on the target hardware characteristics in order. We use static analysis of the relative performance of tensor operations to optimize the deep learning program. Experiments show that our approach can achieve up to 11x performance compared to dynamic profiling based methods with the same compilation time.