LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models

2024/11/20 by Salvatore Carta, Stefano Chessa, Carta, Salvatore Mario +41
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques

paper · pdf · doi:10.48550/arxiv.2411.13453

openalex publication_date 2024/11/20 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Minority languages are vital to preserving cultural heritage, yet they face growing risks of extinction due to limited digital resources and the dominance of artificial intelligence models trained on high-resource languages. This white paper proposes a framework to generate linguistic tools for low-resource languages, focusing on data creation to support the development of language models that can aid in preservation efforts. Sardinian, an endangered language, serves as the case study to demonstrate the framework's effectiveness. By addressing the data scarcity that hinders intelligent applications for such languages, we contribute to promoting linguistic diversity and support ongoing efforts in language standardization and revitalization through modern technologies.

Related

• Revitalizing Endangered Languages: AI-powered language learning as a catalyst for language appreciation
• Hire a Linguist!: Learning Endangered Languages with In-Context Linguistic Descriptions
• Fine Tuning Methods for Low-resource Languages
• Harnessing the Power of Artificial Intelligence to Vitalize Endangered Indigenous Languages: Technologies and Experiences
• Not always about you: Prioritizing community needs when developing endangered language technology