vix.ing · top · new · best · stats · spec

Low-Energy Convolutional Neural Networks (CNNs) using Hadamard Method

2022/09/06 by Varun Mannam, Mannam, Varun
Computer Science · Engineering · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #CCD and CMOS Imaging Sensors #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Industrial Vision Systems and Defect Detection #Machine Learning (cs.LG) #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2209.09106

openalex publication_date 2022/09/06 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The growing demand for the internet of things (IoT) makes it necessary to implement computer vision tasks such as object recognition in low-power devices. Convolutional neural networks (CNNs) are a potential approach for object recognition and detection. However, the convolutional layer in CNN consumes significant energy compared to the fully connected layers. To mitigate this problem, a new approach based on the Hadamard transformation as an alternative to the convolution operation is demonstrated using two fundamental datasets, MNIST and CIFAR10. The mathematical expression of the Hadamard method shows the clear potential to save energy consumption compared to convolutional layers, which are helpful with BigData applications. In addition, to the test accuracy of the MNIST dataset, the Hadamard method performs similarly to the convolution method. In contrast, with the CIFAR10 dataset, test data accuracy is dropped (due to complex data and multiple channels) compared to the convolution method. Finally, the demonstrated method is helpful for other computer vision tasks when the kernel size is smaller than the input image size.

Related