2020/01/01 by Lulu Ge, Keshab K. Parhi · 219 citations
Computer Science · Engineering · Physics and Astronomy · #Advanced Memory and Neural Computing #Classifier (UML) #Cognitive computing #Data redundancy #Data type #External Data Representation #Feature extraction #Ferroelectric and Negative Capacitance Devices #Field (mathematics) #Magnetic properties of thin films #Orthogonality #Pattern recognition (psychology) #Redundancy (engineering) #cs.AI #cs.CL #cs.LG #cs.NE #eess.SP
paper · pdf · doi:10.1109/mcas.2020.2988388
published in IEEE Circuits and Systems Magazine 20(2), 30-47 (Institute of Electrical and Electronics Engineers) · IEEE Circuits and Systems Magazine (2020)
openalex publication_date 2020/01/01 · arxiv created 2020/04/19 · openalex created_date 2020/05/01 · arxiv updated 2020/06/08 · openalex updated_date 2026/08/06
Hyperdimensional (HD) computing is built upon its unique data type referred to as hypervectors. The dimension of these hypervectors is typically in the range of tens of thousands. Proposed to solve cognitive tasks, HD computing aims at calculating similarity among its data. Data transformation is realized by three operations, including addition, multiplication and permutation. Its ultra-wide data representation introduces redundancy against noise. Since information is evenly distributed over every bit of the hypervectors, HD computing is inherently robust. Additionally, due to the nature of those three operations, HD computing leads to fast learning ability, high energy efficiency and acceptable accuracy in learning and classification tasks. This paper introduces the background of HD computing, and reviews the data representation, data transformation, and similarity measurement. The orthogonality in high dimensions presents opportunities for flexible computing. To balance the tradeoff between accuracy and efficiency, strategies include but are not limited to encoding, retraining, binarization and hardware acceleration. Evaluations indicate that HD computing shows great potential in addressing problems using data in the form of letters, signals and images. HD computing especially shows significant promise to replace machine learning algorithms as a light-weight classifier in the field of internet of things (IoTs).