vix.ing · top · new · best · stats · spec

Performance Implications of Multi-Chiplet Neural Processing Units on Autonomous Driving Perception

2024/11/24 by Mohanad Odema, Odema, Mohanad, Hyoukjun Kwon +4
Computer Science · Engineering · Neuroscience · #Neural Networks and Applications #Autonomous Vehicle Technology and Safety #Brain Tumor Detection and Classification

paper · pdf · doi:10.48550/arxiv.2411.16007

Abstract

We study the application of emerging chiplet-based Neural Processing Units to accelerate vehicular AI perception workloads in constrained automotive settings. The motivation stems from how chiplets technology is becoming integral to emerging vehicular architectures, providing a cost-effective trade-off between performance, modularity, and customization; and from perception models being the most computationally demanding workloads in a autonomous driving system. Using the Tesla Autopilot perception pipeline as a case study, we first breakdown its constituent models and profile their performance on different chiplet accelerators. From the insights, we propose a novel scheduling strategy to efficiently deploy perception workloads on multi-chip AI accelerators. Our experiments using a standard DNN performance simulator, MAESTRO, show our approach realizes 82% and 2.8x increase in throughput and processing engines utilization compared to monolithic accelerator designs.

Related