2021/07/06 by Nikhil Varma Keetha, Nikhil Keetha, Michael Milford +4 · 3 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Indoor and Outdoor Localization Technologies #Remote-Sensing Image Classification #Robotics (cs.RO) #cs.CV #cs.RO
paper · pdf · doi:10.48550/arxiv.2107.02440
Accepted to IEEE Robotics and Automation Letters (RA-L) and IROS 2021
arxiv created 2021/07/06 · openalex publication_date 2021/07/06 · arxiv updated 2021/07/07 · openalex created_date 2022/07/25 · openalex updated_date 2026/07/28
Visual Place Recognition (VPR) approaches have typically attempted to match places by identifying visual cues, image regions or landmarks that have high ``utility'' in identifying a specific place. But this concept of utility is not singular - rather it can take a range of forms. In this paper, we present a novel approach to deduce two key types of utility for VPR: the utility of visual cues `specific' to an environment, and to a particular place. We employ contrastive learning principles to estimate both the environment- and place-specific utility of Vector of Locally Aggregated Descriptors (VLAD) clusters in an unsupervised manner, which is then used to guide local feature matching through keypoint selection. By combining these two utility measures, our approach achieves state-of-the-art performance on three challenging benchmark datasets, while simultaneously reducing the required storage and compute time. We provide further analysis demonstrating that unsupervised cluster selection results in semantically meaningful results, that finer grained categorization often has higher utility for VPR than high level semantic categorization (e.g. building, road), and characterise how these two utility measures vary across different places and environments. Source code is made publicly available at https://github.com/Nik-V9/HEAPUtil.