vix.ing · top · new · best · stats

The Challenges of Persian User-generated Textual Content: A Machine Learning-Based Approach

2021/01/20 by Mohammad Kasra Habib, Habib, Mohammad Kasra
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Sentiment Analysis and Opinion Mining #Topic Modeling #cs.CL

paper · pdf · doi:10.48550/arxiv.2101.08087

12 Pages bib inc., 5 Figures and 5 Tables

arxiv created 2021/01/20 · openalex publication_date 2021/01/20 · arxiv updated 2021/01/21 · openalex created_date 2021/02/01 · openalex updated_date 2026/07/28

Abstract

Over recent years a lot of research papers and studies have been published on the development of effective approaches that benefit from a large amount of user-generated content and build intelligent predictive models on top of them. This research applies machine learning-based approaches to tackle the hurdles that come with Persian user-generated textual content. Unfortunately, there is still inadequate research in exploiting machine learning approaches to classify/cluster Persian text. Further, analyzing Persian text suffers from a lack of resources; specifically from datasets and text manipulation tools. Since the syntax and semantics of the Persian language is different from English and other languages, the available resources from these languages are not instantly usable for Persian. In addition, recognition of nouns and pronouns, parts of speech tagging, finding words' boundary, stemming or character manipulations for Persian language are still unsolved issues that require further studying. Therefore, efforts have been made in this research to address some of the challenges. This presented approach uses a machine-translated datasets to conduct sentiment analysis for the Persian language. Finally, the dataset has been rehearsed with different classifiers and feature engineering approaches. The results of the experiments have shown promising state-of-the-art performance in contrast to the previous efforts; the best classifier was Support Vector Machines which achieved a precision of 91.22%, recall of 91.71%, and F1 score of 91.46%.

Related