2023/02/03 by Hamed Rahimi, Rahimi, Hamed, Hubert Naacke +5 · 1 citation
Computer Science · Decision Sciences · #Advanced Text Analysis Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Scientific Computing and Data Management #Social and Information Networks (cs.SI) #Topic Modeling
paper · pdf · doi:10.48550/arxiv.2302.01501
openalex publication_date 2023/02/03 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
This paper presents an algorithmic family of dynamic topic models called Aligned Neural Topic Models (ANTM), which combine novel data mining algorithms to provide a modular framework for discovering evolving topics. ANTM maintains the temporal continuity of evolving topics by extracting time-aware features from documents using advanced pre-trained Large Language Models (LLMs) and employing an overlapping sliding window algorithm for sequential document clustering. This overlapping sliding window algorithm identifies a different number of topics within each time frame and aligns semantically similar document clusters across time periods. This process captures emerging and fading trends across different periods and allows for a more interpretable representation of evolving topics. Experiments on four distinct datasets show that ANTM outperforms probabilistic dynamic topic models in terms of topic coherence and diversity metrics. Moreover, it improves the scalability and flexibility of dynamic topic models by being accessible and adaptable to different types of algorithms. Additionally, a Python package is developed for researchers and scientists who wish to study the trends and evolving patterns of topics in large-scale textual data.