2021/07/28 by Sławomir Tadeja, Sławomir Konrad Tadeja, Krzysztof Kutt +10
Computer Science · #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Natural Language Processing Techniques #Speech and dialogue systems #cs.HC
paper · pdf · doi:10.48550/arxiv.2107.13403
arxiv created 2021/07/28 · openalex publication_date 2021/07/28 · arxiv updated 2021/07/29 · openalex created_date 2021/08/02 · openalex updated_date 2026/07/28
In this paper, we present a Virtual Reality (VR) based environment where the engineer interacts with incoming data from a fleet of aeroengines. This data takes the form of 3D computer-aided design (CAD) engine models coupled with characteristic plots for the subsystems of each engine. Both the plots and models can be interacted with and manipulated using speech or gestural input. The characteristic data is ported to a knowledge-based system underpinned by a knowledge-graph storing complex domain knowledge. This permits the system to respond to queries about the current state and health of each aeroengine asset. Responses to these questions require some degree of analysis, which is handled by a semantic knowledge representation layer managing information on aeroengine subsystems. This paper represents a significant step forward for aeroengine analysis in a bespoke VR environment and brings us a step closer to a Jarvis-like system for aeroengine analytics.