vix.ing · top · new · best · stats

The eyes and hearts of UAV pilots: observations of physiological responses in real-life scenarios

2022/10/26 by Alexandre Duval, Duval, Alexandre, Anita Paas +5
Engineering · Psychology · #Aerospace and Aviation Technology #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human-Automation Interaction and Safety #Human-Computer Interaction (cs.HC) #Infrared Target Detection Methodologies #Machine Learning (cs.LG) #Robotics (cs.RO)

paper · pdf · doi:10.48550/arxiv.2210.14910

openalex publication_date 2022/10/26 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The drone industry is diversifying and the number of pilots increases rapidly. In this context, flight schools need adapted tools to train pilots, most importantly with regard to their own awareness of their physiological and cognitive limits. In civil and military aviation, pilots can train themselves on realistic simulators to tune their reaction and reflexes, but also to gather data on their piloting behavior and physiological states. It helps them to improve their performances. Opposed to cockpit scenarios, drone teleoperation is conducted outdoor in the field, thus with only limited potential from desktop simulation training. This work aims to provide a solution to gather pilots behavior out in the field and help them increase their performance. We combined advance object detection from a frontal camera to gaze and heart-rate variability measurements. We observed pilots and analyze their behavior over three flight challenges. We believe this tool can support pilots both in their training and in their regular flight tasks. A demonstration video is available on https://www.youtube.com/watch?v=eePhjd2qNiI

Related