The African Stopwords project: curating stopwords for African languages

2023/03/21 by Chris Chinenye Emezue, Hellina Hailu Nigatu, Emezue, Chris +41 · 2 citations
Computer Science · #ICT in Developing Communities #Web Data Mining and Analysis #Information Retrieval and Search Behavior

paper · pdf · doi:10.48550/arxiv.2304.12155

Abstract

Stopwords are fundamental in Natural Language Processing (NLP) techniques for information retrieval. One of the common tasks in preprocessing of text data is the removal of stopwords. Currently, while high-resource languages like English benefit from the availability of several stopwords, low-resource languages, such as those found in the African continent, have none that are standardized and available for use in NLP packages. Stopwords in the context of African languages are understudied and can reveal information about the crossover between languages. The African Stopwords project aims to study and curate stopwords for African languages. In this paper, we present our current progress on ten African languages as well as future plans for the project.

Cited by

• Evaluating Machine Translation Datasets for Low-Web Data Languages: A Gendered Lens
• A Case Against Implicit Standards: Homophone Normalization in Machine Translation for Languages that use the Ge'ez Script

Related

• Text Categorization Can Enhance Domain-Agnostic Stopword Extraction
• Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Ahead
• The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP
• Masakhane -- Machine Translation For Africa
• Bridging Gaps in Natural Language Processing for Yorùbá: A Systematic Review of a Decade of Progress and Prospects