cs60075_team2 at SemEval-2021 Task 1 : Lexical Complexity Prediction\n using Transformer-based Language Models pre-trained on various text corpora

2021/06/04 by Abhilash Nandy, Nandy, Abhilash, Sayantan Adak +5
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2106.02340

openalex publication_date 2021/06/04 · openalex created_date 2022/07/25 · openalex updated_date 2026/07/28

Abstract

This paper describes the performance of the team cs60075_team2 at SemEval\n2021 Task 1 - Lexical Complexity Prediction. The main contribution of this\npaper is to fine-tune transformer-based language models pre-trained on several\ntext corpora, some being general (E.g., Wikipedia, BooksCorpus), some being the\ncorpora from which the CompLex Dataset was extracted, and others being from\nother specific domains such as Finance, Law, etc. We perform ablation studies\non selecting the transformer models and how their individual complexity scores\nare aggregated to get the resulting complexity scores. Our method achieves a\nbest Pearson Correlation of 0.784 in sub-task 1 (single word) and 0.836 in\nsub-task 2 (multiple word expressions).\n

Related

• SemEval-2021 Task 1: Lexical Complexity Prediction
• OCHADAI-KYOTO at SemEval-2021 Task 1: Enhancing Model Generalization and Robustness for Lexical Complexity Prediction
• LCP-RIT at SemEval-2021 Task 1: Exploring Linguistic Features for\n Lexical Complexity Prediction
• UPB at SemEval-2021 Task 1: Combining Deep Learning and Hand-Crafted\n Features for Lexical Complexity Prediction
• IITK@LCP at SemEval 2021 Task 1: Classification for Lexical Complexity\n Regression Task