vix.ing · top · new · best · stats · spec

Mismatched: Evaluating the Limits of Image Matching Approaches and Benchmarks

2024/08/29 by Sierra Bonilla, Bonilla, Sierra, Chiara Di Vece +11 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning in Healthcare

paper · pdf · doi:10.48550/arxiv.2408.16445

openalex publication_date 2024/08/29 · openalex created_date 2024/10/23 · openalex updated_date 2026/08/01

Abstract

Three-dimensional (3D) reconstruction from two-dimensional images is an active research field in computer vision, with applications ranging from navigation and object tracking to segmentation and three-dimensional modeling. Traditionally, parametric techniques have been employed for this task. However, recent advancements have seen a shift towards learning-based methods. Given the rapid pace of research and the frequent introduction of new image matching methods, it is essential to evaluate them. In this paper, we present a comprehensive evaluation of various image matching methods using a structure-from-motion pipeline. We assess the performance of these methods on both in-domain and out-of-domain datasets, identifying key limitations in both the methods and benchmarks. We also investigate the impact of edge detection as a pre-processing step. Our analysis reveals that image matching for 3D reconstruction remains an open challenge, necessitating careful selection and tuning of models for specific scenarios, while also highlighting mismatches in how metrics currently represent method performance.

Cited by

Related