An Attention-Based Deep Net for Learning to Rank

2017/02/20 by Baiyang Wang, Wang, Baiyang, Diego Klabjan +1
Computer Science · #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques #Domain Adaptation and Few-Shot Learning

paper · pdf · doi:10.48550/arxiv.1702.06106

Abstract

In information retrieval, learning to rank constructs a machine-based ranking model which given a query, sorts the search results by their degree of relevance or importance to the query. Neural networks have been successfully applied to this problem, and in this paper, we propose an attention-based deep neural network which better incorporates different embeddings of the queries and search results with an attention-based mechanism. This model also applies a decoder mechanism to learn the ranks of the search results in a listwise fashion. The embeddings are trained with convolutional neural networks or the word2vec model. We demonstrate the performance of this model with image retrieval and text querying data sets.

Citations

• Gradient-based learning applied to document recognition

Related

• Deep Neural Network for Learning to Rank Query-Text Pairs
• A Deep Look into Neural Ranking Models for Information Retrieval
• Neural Ranking Models with Weak Supervision
• Neural Models for Information Retrieval
• Images Don't Lie: Transferring Deep Visual Semantic Features to Large-Scale Multimodal Learning to Rank