vix.ing · top · new · best · stats · spec

NeuroHash: A Hyperdimensional Neuro-Symbolic Framework for Spatially-Aware Image Hashing and Retrieval

2024/04/17 by Sanggeon Yun, Ryozo Masukawa, Yun, Sanggeon +5 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences

paper · pdf · doi:10.48550/arxiv.2404.11025

openalex publication_date 2024/04/17 · openalex created_date 2024/04/19 · openalex updated_date 2026/07/28

Abstract

Customizable image retrieval from large datasets remains a critical challenge, particularly when preserving spatial relationships within images. Traditional hashing methods, primarily based on deep learning, often fail to capture spatial information adequately and lack transparency. In this paper, we introduce NeuroHash, a novel neuro-symbolic framework leveraging Hyperdimensional Computing (HDC) to enable highly customizable, spatially-aware image retrieval. NeuroHash combines pre-trained deep neural network models with HDC-based symbolic models, allowing for flexible manipulation of hash values to support conditional image retrieval. Our method includes a self-supervised context-aware HDC encoder and novel loss terms for optimizing lower-dimensional bipolar hashing using multilinear hyperplanes. We evaluate NeuroHash on two benchmark datasets, demonstrating superior performance compared to state-of-the-art hashing methods, as measured by mAP@5K scores and our newly introduced metric, mAP@5Kr, which assesses spatial alignment. The results highlight NeuroHash's ability to achieve competitive performance while offering significant advantages in flexibility and customization, paving the way for more advanced and versatile image retrieval systems.

Cited by

Related