vix.ing · top · new · best · stats · spec

LDC Arabic Treebanks and Associated Corpora: Data Divisions Manual

2013/09/22 by Mona Diab, Nizar Habash, Diab, Mona +6 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Mathematics, Computing, and Information Processing #Natural Language Processing Techniques #cs.CL

paper · pdf · doi:10.48550/arxiv.1309.5652

14 pages; one cover

arxiv created 2013/09/22 · openalex publication_date 2013/09/22 · arxiv updated 2013/09/24 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The Linguistic Data Consortium (LDC) has developed hundreds of data corpora for natural language processing (NLP) research. Among these are a number of annotated treebank corpora for Arabic. Typically, these corpora consist of a single collection of annotated documents. NLP research, however, usually requires multiple data sets for the purposes of training models, developing techniques, and final evaluation. Therefore it becomes necessary to divide the corpora used into the required data sets (divisions). This document details a set of rules that have been defined to enable consistent divisions for old and new Arabic treebanks (ATB) and related corpora.

Cited by

Related