2020/11/18 by Markus Friedrich, Friedrich, Markus, Stefan Langer +3 · 3 citations
Computer Science · Engineering · Neuroscience · #Computational Geometry (cs.CG) #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Human-Computer Interaction (cs.HC) #Robot Manipulation and Learning #Tactile and Sensory Interactions
paper · pdf · doi:10.48550/arxiv.2011.09138
openalex publication_date 2020/11/18 · openalex created_date 2022/07/25 · openalex updated_date 2026/07/28
Modeling 3D objects in domains like Computer Aided Design (CAD) is\ntime-consuming and comes with a steep learning curve needed to master the\ndesign process as well as tool complexities. In order to simplify the modeling\nprocess, we designed and implemented a prototypical system that leverages the\nstrengths of Virtual Reality (VR) hand gesture recognition in combination with\nthe expressiveness of a voice-based interface for the task of 3D modeling.\nFurthermore, we use the Constructive Solid Geometry (CSG) tree representation\nfor 3D models within the VR environment to let the user manipulate objects from\nthe ground up, giving an intuitive understanding of how the underlying basic\nshapes connect. The system uses standard mid-air 3D object manipulation\ntechniques and adds a set of voice commands to help mitigate the deficiencies\nof current hand gesture recognition techniques. A user study was conducted to\nevaluate the proposed prototype. The combination of our hybrid input paradigm\nshows to be a promising step towards easier to use CAD modeling.\n