2025/10/08 by Baraq Lipshitz, B. Lipshitz, Alessio Melone +7 · 1 voice
Computer Science · Engineering · Physics and Astronomy · #Computational Geometry and Mesh Generation #Electromagnetic Scattering and Analysis #Electromagnetic Simulation and Numerical Methods #cs.LG #cs.PF
paper · pdf · doi:10.48550/arxiv.2510.06957
arxiv published 2025/10/08 · arxiv updated 2025/10/13
Sparse Ternary General Matrix-Matrix Multiplication (GEMM) remains under-optimized in existing libraries for Apple Silicon CPUs. We present a Sparse Ternary GEMM kernel optimized specifically for Apple's M-series processors. We propose a set of architecture-aware optimizations, including a novel blocked and interleaved sparse data format to improve memory locality, strategies to increase Instruction-Level Parallelism (ILP), and NEON-based Single Instruction Multiple Data (SIMD) vectorization to exploit data-level parallelism. Our scalar implementation achieves up to a 5.98x performance increase over a traditional Ternary Compressed Sparse Column (TCSC) baseline for large matrices with 50% ternary nonzero values (sparsity), reaching up to a 50.2% of the processor's theoretical peak performance, and remains stable across varying sparsity levels. Our vectorized implementation delivers up to a 5.59x performance increase for large matrices with 25% sparsity, and remains stable across varying sparsity levels.