2018/01/19 by Yuhao Zhu, Zhu, Yuhao, Matthew Mattina +4 · 1 voice · 4 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #CCD and CMOS Imaging Sensors #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #cs.AR #cs.LG #cs.NE
paper · pdf · doi:10.48550/arxiv.1801.06274
openalex publication_date 2018/01/19 · arxiv published 2018/01/19 · arxiv created 2018/02/01 · openalex created_date 2018/02/02 · arxiv updated 2018/02/05 · openalex updated_date 2026/07/28
Machine learning is playing an increasingly significant role in emerging mobile application domains such as AR/VR, ADAS, etc. Accordingly, hardware architects have designed customized hardware for machine learning algorithms, especially neural networks, to improve compute efficiency. However, machine learning is typically just one processing stage in complex end-to-end applications, involving multiple components in a mobile Systems-on-a-chip (SoC). Focusing only on ML accelerators loses bigger optimization opportunity at the system (SoC) level. This paper argues that hardware architects should expand the optimization scope to the entire SoC. We demonstrate one particular case-study in the domain of continuous computer vision where camera sensor, image signal processor (ISP), memory, and NN accelerator are synergistically co-designed to achieve optimal system-level efficiency.