vix.ing · top · new · best · stats · spec

Use of Weighted Finite State Transducers in Part of Speech Tagging

1997/10/10 by Evelyne Tzoukermann, Tzoukermann, Evelyne, Dragomir Radev +2
Computer Science · #Algorithms and Data Compression #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #cmp-lg #cs.CL

paper · pdf · doi:10.48550/arxiv.cmp-lg/9710001

uses psfig, ipamacs

arxiv created 1997/10/10 · openalex publication_date 1997/10/10 · arxiv updated 2009/11/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper addresses issues in part of speech disambiguation using finite-state transducers and presents two main contributions to the field. One of them is the use of finite-state machines for part of speech tagging. Linguistic and statistical information is represented in terms of weights on transitions in weighted finite-state transducers. Another contribution is the successful combination of techniques -- linguistic and statistical -- for word disambiguation, compounded with the notion of word classes.

Related