2022/07/16 by Wei Wu, Wu, Wei, Junlin He +9 · 6 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Data Management and Algorithms #Databases (cs.DB) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications
paper · pdf · doi:10.48550/arxiv.2207.07940
openalex publication_date 2022/07/16 · openalex created_date 2022/07/21 · openalex updated_date 2026/07/28
The in-memory approximate nearest neighbor search (ANNS) algorithms have achieved great success for fast high-recall query processing, but are extremely inefficient when handling hybrid queries with unstructured (i.e., feature vectors) and structured (i.e., related attributes) constraints. In this paper, we present HQANN, a simple yet highly efficient hybrid query processing framework which can be easily embedded into existing proximity graph-based ANNS algorithms. We guarantee both low latency and high recall by leveraging navigation sense among attributes and fusing vector similarity search with attribute filtering. Experimental results on both public and in-house datasets demonstrate that HQANN is 10x faster than the state-of-the-art hybrid ANNS solutions to reach the same recall quality and its performance is hardly affected by the complexity of attributes. It can reach 99% recall@10 in just around 50 microseconds On GLOVE-1.2M with thousands of attribute constraints.