vix.ing · top · new · best · stats · spec

On Estimation and Selection for Topic Models

2011/09/21 by Taddy, Matthew A.
#Applications (stat.AP) #FOS: Computer and information sciences

paper · doi:10.48550/arxiv.1109.4518

Abstract

This article describes posterior maximization for topic models, identifying computational and conceptual gains from inference under a non-standard parametrization. We then show that fitted parameters can be used as the basis for a novel approach to marginal likelihood estimation, via block-diagonal approximation to the information matrix,that facilitates choosing the number of latent topics. This likelihood-based model selection is complemented with a goodness-of-fit analysis built around estimated residual dispersion. Examples are provided to illustrate model selection as well as to compare our estimation against standard alternative techniques.

Related