vix.ing · top · new · best · stats

Towards a continuous modeling of natural language domains

2016/10/28 by Sebastian Ruder, Ruder, Sebastian, Parsa Ghaffari +3
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling #cs.CL #cs.LG

paper · pdf · doi:10.48550/arxiv.1610.09158

5 pages, 3 figures, published in Uphill Battles in Language Processing workshop, EMNLP 2016

arxiv created 2016/10/28 · openalex publication_date 2016/10/28 · arxiv updated 2016/10/31 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Humans continuously adapt their style and language to a variety of domains. However, a reliable definition of `domain' has eluded researchers thus far. Additionally, the notion of discrete domains stands in contrast to the multiplicity of heterogeneous domains that humans navigate, many of which overlap. In order to better understand the change and variation of human language, we draw on research in domain adaptation and extend the notion of discrete domains to the continuous spectrum. We propose representation learning-based models that can adapt to continuous domains and detail how these can be used to investigate variation in language. To this end, we propose to use dialogue modeling as a test bed due to its proximity to language modeling and its social component.

Citations

Related