2017/02/23 by Yuanxin Ye, Jie Shan, Lorenzo Bruzzone +1 · 474 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Feature (linguistics) #Feature extraction #Histogram #Image registration #Medical Image Segmentation Techniques #Metric (unit) #Pattern recognition (psychology) #Phase congruency #Remote-Sensing Image Classification #Similarity (geometry) #Synthetic aperture radar #cs.CV
paper · pdf · doi:10.1109/tgrs.2017.2656380
published in IEEE Transactions on Geoscience and Remote Sensing 55(5), 2941-2958 (Institute of Electrical and Electronics Engineers)
openalex publication_date 2017/02/23 · openalex created_date 2017/03/03 · arxiv created 2021/03/31 · arxiv updated 2021/04/01 · openalex updated_date 2026/08/05
Automatic registration of multimodal remote sensing data [e.g., optical, light detection and ranging (LiDAR), and synthetic aperture radar (SAR)] is a challenging task due to the significant nonlinear radiometric differences between these data. To address this problem, this paper proposes a novel feature descriptor named the histogram of orientated phase congruency (HOPC), which is based on the structural properties of images. Furthermore, a similarity metric named HOPCncc is defined, which uses the normalized correlation coefficient (NCC) of the HOPC descriptors for multimodal registration. In the definition of the proposed similarity metric, we first extend the phase congruency model to generate its orientation representation and use the extended model to build HOPCncc. Then, a fast template matching scheme for this metric is designed to detect the control points between images. The proposed HOPCncc aims to capture the structural similarity between images and has been tested with a variety of optical, LiDAR, SAR, and map data. The results show that HOPCncc is robust against complex nonlinear radiometric differences and outperforms the state-of-the-art similarities metrics (i.e., NCC and mutual information) in matching performance. Moreover, a robust registration method is also proposed in this paper based on HOPCncc, which is evaluated using six pairs of multimodal remote sensing images. The experimental results demonstrate the effectiveness of the proposed method for multimodal image registration.