Building a Swedish Open-Domain Conversational Language Model

2021/04/12 by Tobias Norlund, Norlund, Tobias, Agnes Stenbom +1
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2104.05277

openalex publication_date 2021/04/12 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We present on-going work of evaluating the, to our knowledge, first large generative language model trained to converse in Swedish, using data from the online discussion forum Flashback. We conduct a human evaluation pilot study that indicates the model is often able to respond to conversations in both a human-like and informative manner, on a diverse set of topics. While data from online forums can be useful to build conversational systems, we reflect on the negative consequences that incautious application might have, and the need for taking active measures to safeguard against them.

Related

• Småprat: DialoGPT for Natural Language Generation of Swedish Dialogue by Transfer Learning
• Neural Conversation Models and How to Rein Them in: A Survey of Failures and Fixes
• Evaluating Large Language Models with Human Feedback: Establishing a Swedish Benchmark
• Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practice
• FinChat: Corpus and evaluation setup for Finnish chat conversations on everyday topics