vix.ing · top · new · best · stats · spec

Deep Models for Engagement Assessment With Scarce Label Information

2016/09/28 by Feng Li, Guangfan Zhang, Wei Wang +6
Computer Science · Decision Sciences · Psychology · #Advanced Bandit Algorithms Research #Computer science #Data science #Intelligent Tutoring Systems and Adaptive Learning #Psychology #Reinforcement Learning in Robotics #cs.CV

paper · pdf · doi:10.1109/thms.2016.2608933

9 pages, 8 figures and 3 tables

openalex publication_date 2016/09/28 · arxiv created 2016/10/21 · arxiv updated 2016/10/24 · openalex created_date 2020/11/23 · openalex updated_date 2026/08/05

Abstract

Task engagement is delined as loadings on energetic arousal (affect), task motivation, and concentration (cognition) [1]. It is usually challenging and expensive to label cognitive state data, and traditional computational models trained with limited label information for engagement assessment do not perform well because of overlitting. In this paper, we proposed two deep models (i.e., a deep classilier and a deep autoencoder) for engagement assessment with scarce label information. We recruited 15 pilots to conduct a 4-h flight simulation from Seattle to Chicago and recorded their electroencephalograph (EEG) signals during the simulation. Experts carefully examined the EEG signals and labeled 20 min of the EEG data for each pilot. The EEG signals were preprocessed and power spectral features were extracted. The deep models were pretrained by the unlabeled data and were line-tuned by a different proportion of the labeled data (top 1%, 3%, 5%, 10%, 15%, and 20%) to learn new representations for engagement assessment. The models were then tested on the remaining labeled data. We compared performances of the new data representations with the original EEG features for engagement assessment. Experimental results show that the representations learned by the deep models yielded better accuracies for the six scenarios (77.09%, 80.45%, 83.32%, 85.74%, 85.78%, and 86.52%), based on different proportions of the labeled data for training, as compared with the corresponding accuracies (62.73%, 67.19%, 73.38%, 79.18%, 81.47%, and 84.92%) achieved by the original EEG features. Deep models are effective for engagement assessment especially when less label information was used for training.

Citations