Teuken-7B-Base & Teuken-7B-Instruct: Towards European LLMs
2024/09/30 by Mehdi Ali, Michael Fromm, Ali, Mehdi +82 · 18 voices · 6 citations
Computer Science · #Library Science and Information Systems #cs.AI #cs.CL #cs.LG
paper · pdf · doi:10.48550/arxiv.2410.03730
openalex publication_date 2024/09/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/30
Abstract
We present two multilingual LLMs, Teuken 7B-base and Teuken 7B-instruct, designed to embrace Europe's linguistic diversity by supporting all 24 official languages of the European Union. Trained on a dataset comprising around 60% non-English data and utilizing a custom multilingual tokenizer, our models address the limitations of existing LLMs that predominantly focus on English or a few high-resource languages. We detail the models' development principles, i.e., data composition, tokenizer optimization, and training methodologies. The models demonstrate strong performance across multilingual benchmarks, as evidenced by their performance on European versions of ARC, HellaSwag, and TruthfulQA.
Cited by
Discussions
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs (2024) [hn, 248 points, 95 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs [hn, 7 points, 0 comments]
- Teuken-7B-Base & Teuken-7B-Instruct: Open LLM by OpenGPT-X arxiv.org/pdf/2410.03730 [bsky, 1 points, 0 comments]
- "Trained on a dataset comprising around 60% non-English data and utilizing a custom multilingual tokenizer, our models address the limitations of existing LLMs that predominantly focus on English or a [bsky, 1 points, 0 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs [bsky, 0 points, 0 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs #HackerNews https://arxiv.org/abs/2410.03730 [bsky, 0 points, 0 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs https://arxiv.org/abs/2410.03730 https://news.ycombinator.com/item?id=43690955 [bsky, 0 points, 0 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs https://arxiv.org/abs/2410.03730 [bsky, 0 points, 0 comments]
- teuken-7b models paving the way for european ai business innovations arxiv.org [bsky, 0 points, 0 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs https://arxiv.org/abs/2410.03730 (https://news.ycombinator.com/item?id=43690955) [bsky, 0 points, 0 comments]
- ⚡ Hackernews Top story: Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs [bsky, 0 points, 0 comments]
- https://bsky.app/profile/news.ycombinator.com.web.brid.gy/post/3lmudhwivdvm2 [bsky, 0 points, 0 comments]
- Teuken-7B-Base & Teuken-7B-Instruct: Towards European LLMs #news #worldnews [bsky, 0 points, 0 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs https://arxiv.org/abs/2410.03730 (http://news.ycombinator.com/item?id=43690955) [bsky, 0 points, 0 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs view on hacker news [bsky, 0 points, 0 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs https:// arxiv.org/abs/2410.03730 # arxiv # llm # llms [mastodon, 0 points, 0 comments]
- "Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs" New AI models from Europe show promise for better understanding in multiple languages, though performance varies. There's still a long wa [bsky, 0 points, 0 comments]
- Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs https://arxiv.org/abs/2410.03730 (https://news.ycombinator.com/item?id=43690955) [bsky, 0 points, 0 comments]
Related