vix.ing · top · new · best · stats · spec

Tackling the Matrix Multiplication Micro-kernel Generation with Exo

2023/10/26 by Adrián Castelló, Julian Bellavita, Castelló, Adrián +7 · 1 citation
Computer Science · Engineering · #Advanced Data Storage Technologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Low-power high-performance VLSI design #Mathematical Software (cs.MS) #Parallel Computing and Optimization Techniques #Performance (cs.PF)

paper · pdf · doi:10.48550/arxiv.2310.17408

openalex publication_date 2023/10/26 · openalex created_date 2023/10/28 · openalex updated_date 2026/08/01

Abstract

The optimization of the matrix multiplication (or GEMM) has been a need during the last decades. This operation is considered the flagship of current linear algebra libraries such as BLIS, OpenBLAS, or Intel OneAPI because of its widespread use in a large variety of scientific applications. The GEMM is usually implemented following the GotoBLAS philosophy, which tiles the GEMM operands and uses a series of nested loops for performance improvement. These approaches extract the maximum computational power of the architectures through small pieces of hardware-oriented, high-performance code called micro-kernel. However, this approach forces developers to generate, with a non-negligible effort, a dedicated micro-kernel for each new hardware. In this work, we present a step-by-step procedure for generating micro-kernels with the Exo compiler that performs close to (or even better than) manually developed microkernels written with intrinsic functions or assembly language. Our solution also improves the portability of the generated code, since a hardware target is fully specified by a concise library-based description of its instructions.

Cited by

Related