2020/03/09 by Xixi Zhou, Zhou, Xixi, Chengxi Li +11 · 2 citations
Computer Science · Mathematics · #Artificial intelligence #Artificial neural network #Computation and Language (cs.CL) #Computer science #FOS: Computer and information sciences #Identification (biology) #Inference #Information extraction #Machine learning #Matching (statistics) #Mathematics #Mutual information #Natural Language Processing Techniques #Natural language processing #Paraphrase #Pattern recognition (psychology) #Representation (politics) #Text and Document Classification Technologies #Topic Modeling #cs.CL
paper · pdf · doi:10.48550/arxiv.2003.11521
published in arXiv (Cornell University) (Cornell University)
arxiv created 2020/03/09 · openalex publication_date 2020/03/09 · arxiv updated 2020/03/26 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Text matching is a core natural language processing research problem. How to retain sufficient information on both content and structure information is one important challenge. In this paper, we present a neural approach for general-purpose text matching with deep mutual information estimation incorporated. Our approach, Text matching with Deep Info Max (TIM), is integrated with a procedure of unsupervised learning of representations by maximizing the mutual information between text matching neural network's input and output. We use both global and local mutual information to learn text representations. We evaluate our text matching approach on several tasks including natural language inference, paraphrase identification, and answer selection. Compared to the state-of-the-art approaches, the experiments show that our method integrated with mutual information estimation learns better text representation and achieves better experimental results of text matching tasks without exploiting pretraining on external data.