vix.ing · top · new · best · stats · spec

OpenHLS: High-Level Synthesis for Low-Latency Deep Neural Networks for Experimental Science

2023/02/13 by Maksim Levental, Arham Khan, Levental, Maksim +9
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #Advanced Electron Microscopy Techniques and Applications #CCD and CMOS Imaging Sensors #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Neural Networks and Reservoir Computing

paper · pdf · doi:10.48550/arxiv.2302.06751

openalex publication_date 2023/02/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In many experiment-driven scientific domains, such as high-energy physics, material science, and cosmology, high data rate experiments impose hard constraints on data acquisition systems: collected data must either be indiscriminately stored for post-processing and analysis, thereby necessitating large storage capacity, or accurately filtered in real-time, thereby necessitating low-latency processing. Deep neural networks, effective in other filtering tasks, have not been widely employed in such data acquisition systems, due to design and deployment difficulties. We present an open source, lightweight, compiler framework, without any proprietary dependencies, OpenHLS, based on high-level synthesis techniques, for translating high-level representations of deep neural networks to low-level representations, suitable for deployment to near-sensor devices such as field-programmable gate arrays. We evaluate OpenHLS on various workloads and present a case-study implementation of a deep neural network for Bragg peak detection in the context of high-energy diffraction microscopy. We show OpenHLS is able to produce an implementation of the network with a throughput 4.8 μs/sample, which is approximately a 4× improvement over the existing implementation

Related