2022/07/08 by Saad S. M. Hassan, Matthew Seita, Hassan, Saad +11
Computer Science · Neuroscience · Psychology · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Hearing Impairment and Communication #Tactile and Sensory Interactions
paper · pdf · doi:10.48550/arxiv.2207.04021
openalex publication_date 2022/07/08 · openalex created_date 2022/07/12 · openalex updated_date 2026/07/28
We are releasing a dataset containing videos of both fluent and non-fluent signers using American Sign Language (ASL), which were collected using a Kinect v2 sensor. This dataset was collected as a part of a project to develop and evaluate computer vision algorithms to support new technologies for automatic detection of ASL fluency attributes. A total of 45 fluent and non-fluent participants were asked to perform signing homework assignments that are similar to the assignments used in introductory or intermediate level ASL courses. The data is annotated to identify several aspects of signing including grammatical features and non-manual markers. Sign language recognition is currently very data-driven and this dataset can support the design of recognition technologies, especially technologies that can benefit ASL learners. This dataset might also be interesting to ASL education researchers who want to contrast fluent and non-fluent signing.