2018/04/18 by Christos Baziotis, Baziotis, Christos, Nikos Athanasiou +11 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Sentiment Analysis and Opinion Mining #Topic Modeling
paper · pdf · doi:10.48550/arxiv.1804.06659
openalex publication_date 2018/04/18 · openalex created_date 2022/10/01 · openalex updated_date 2026/07/28
In this paper we present two deep-learning systems that competed at\nSemEval-2018 Task 3 "Irony detection in English tweets". We design and ensemble\ntwo independent models, based on recurrent neural networks (Bi-LSTM), which\noperate at the word and character level, in order to capture both the semantic\nand syntactic information in tweets. Our models are augmented with a\nself-attention mechanism, in order to identify the most informative words. The\nembedding layer of our word-level model is initialized with word2vec word\nembeddings, pretrained on a collection of 550 million English tweets. We did\nnot utilize any handcrafted features, lexicons or external datasets as prior\ninformation and our models are trained end-to-end using back propagation on\nconstrained data. Furthermore, we provide visualizations of tweets with\nannotations for the salient tokens of the attention layer that can help to\ninterpret the inner workings of the proposed models. We ranked 2nd out of 42\nteams in Subtask A and 2nd out of 31 teams in Subtask B. However,\npost-task-completion enhancements of our models achieve state-of-the-art\nresults ranking 1st for both subtasks.\n