2020/04/28 by Adam Tsakalidis, Maria Liakata, Tsakalidis, Adam +1
Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Language and cultural evolution #Natural Language Processing Techniques #Topic Modeling
paper · pdf · doi:10.48550/arxiv.2004.13703
openalex publication_date 2020/04/28 · openalex created_date 2020/05/13 · openalex updated_date 2026/07/28
Semantic change detection concerns the task of identifying words whose meaning has changed over time. The current state-of-the-art detects the level of semantic change in a word by comparing its vector representation in two distinct time periods, without considering its evolution through time. In this work, we propose three variants of sequential models for detecting semantically shifted words, effectively accounting for the changes in the word representations over time, in a temporally sensitive manner. Through extensive experimentation under various settings with both synthetic and real data we showcase the importance of sequential modelling of word vectors through time for detecting the words whose semantics have changed the most. Finally, we take a step towards comparing different approaches in a quantitative manner, demonstrating that the temporal modelling of word representations yields a clear-cut advantage in performance.