2000/10/26 by Steven Bird, Bird, Steven, Mark Liberman +1
Computer Science · #A.1 #Computation and Language (cs.CL) #Data Structures and Algorithms (cs.DS) #Databases (cs.DB) #E.2 #FOS: Computer and information sciences #H.2.1 #H.3.3 #H.3.7 #I.2.7 #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling #cs.CL #cs.DB #cs.DS
paper · pdf · doi:10.48550/arxiv.cs/0010033
29 pages, 20 figures, to appear in Speech Communication, An earlier version appeared as cs.CL/9903003
arxiv created 2000/10/26 · openalex publication_date 2000/10/26 · arxiv updated 2009/11/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
`Linguistic annotation' covers any descriptive or analytic notations applied to raw language data. The basic data may be in the form of time functions - audio, video and/or physiological recordings - or it may be textual. The added notations may include transcriptions of all sorts (from phonetic features to discourse structures), part-of-speech and sense tagging, syntactic analysis, `named entity' identification, co-reference annotation, and so on. While there are several ongoing efforts to provide formats and tools for such annotations and to publish annotated linguistic databases, the lack of widely accepted standards is becoming a critical problem. Proposed standards, to the extent they exist, have focused on file formats. This paper focuses instead on the logical structure of linguistic annotations. We survey a wide variety of existing annotation formats and demonstrate a common conceptual core, the annotation graph. This provides a formal framework for constructing, maintaining and searching linguistic annotations, while remaining consistent with many alternative data structures and file formats.