2025/05/05 by Ebrahim Babaei, Tilman Dingler, Benjamin Tag +1
Decision Sciences · Medicine · Psychology · #Healthcare Technology and Patient Monitoring #Human-Automation Interaction and Safety #Personal Information Management and User Behavior
paper · doi:10.1016/j.ijhcs.2025.103515
openalex publication_date 2025/05/05 · crossref created 2025/05/05 · crossref deposited 2025/05/21 · crossref issued 2025/06/01 · crossref published 2025/06/01 · crossref published-print 2025/06/01 · openalex created_date 2025/10/10 · crossref indexed 2026/07/30 · openalex updated_date 2026/07/31
Mental Workload (MWL) is a construct widely used in HCI to assess the cognitive demand users must exert to perform a task. Research in human factors, however, has suggested several issues regarding its definitions, scales, and applications. This paper, first, introduces debates surrounding the MWL concept and its most popular measure, the NASA-TLX. We present a systematic review of CHI papers involving MWL and highlight severe issues in its application. Finally, through a validation experiment, we assess the convergent validity and sensitivity of two MWL instruments—NASA-TLX and MRQ. Our findings reveal disagreements in the definitions of MWL and severe drawbacks in NASA-TLX and its applications. Our validation study also presents evidence for a lack of convergent validity and sensitivity of MWL subjective scales in HCI tasks. Our findings recommend caution when employing NASA-TLX in user studies and highlight the need for an MWL definition that is agreed upon within the HCI community.