Deep Cross-Modal Hashing

2016/02/06 by Qing-Yuan Jiang, Jiang, Qing-Yuan, Wu-Jun Li +1 · 11 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Video Analysis and Summarization #Video Surveillance and Tracking Methods #cs.IR

paper · pdf · doi:10.48550/arxiv.1602.02255

12 pages

openalex publication_date 2016/02/06 · arxiv created 2016/02/15 · arxiv updated 2016/02/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Due to its low storage cost and fast query speed, cross-modal hashing (CMH) has been widely used for similarity search in multimedia retrieval applications. However, almost all existing CMH methods are based on hand-crafted features which might not be optimally compatible with the hash-code learning procedure. As a result, existing CMH methods with handcrafted features may not achieve satisfactory performance. In this paper, we propose a novel cross-modal hashing method, called deep crossmodal hashing (DCMH), by integrating feature learning and hash-code learning into the same framework. DCMH is an end-to-end learning framework with deep neural networks, one for each modality, to perform feature learning from scratch. Experiments on two real datasets with text-image modalities show that DCMH can outperform other baselines to achieve the state-of-the-art performance in cross-modal retrieval applications.

Citations

• Practical and Optimal LSH for Angular Distance
• ImageNet classification with deep convolutional neural networks

Cited by

• DSCH-Loss: A Dynamic Semantic Channel Objective for Deep Semantic Hashing
• Enhancing Medical Cross-Modal Hashing Retrieval using Dropout-Voting Mixture-of-Experts Fusion
• Codebook-Centric Deep Hashing: End-to-End Joint Learning of Semantic Hash Centers and Neural Hash Function
• Semantic-Consistent Bidirectional Contrastive Hashing for Noisy Multi-Label Cross-Modal Retrieval
• Semantic-Cohesive Knowledge Distillation for Deep Cross-modal Hashing
• Cross-Modal Retrieval with Cauchy-Schwarz Divergence
• Weakly Supervised Deep Image Hashing through Tag Embeddings
• Zero-Shot Sketch-Image Hashing
• Learning Shared Semantic Space with Correlation Alignment for Cross-modal Event Retrieval
• Transitive Hashing Network for Heterogeneous Multimedia Retrieval
• Audio-Visual Embedding for Cross-Modal MusicVideo Retrieval through Supervised Deep CCA

Related

• Correlation Hashing Network for Efficient Cross-Modal Retrieval
• Deep Cross-Modal Hashing with Hashing Functions and Unified Hash Codes Jointly Learning
• Multimodal similarity-preserving hashing
• Fusion-supervised Deep Cross-modal Hashing
• Triplet-Based Deep Hashing Network for Cross-Modal Retrieval