2025/11/07 by Kyaw, Alexander Htet, Ma, Haotian, Zivkovic, Sasa +1
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Augmented Reality Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #H.5.1 #H.5.2 #Human-Computer Interaction (cs.HC) #I.2.6 #I.4.8 #Manufacturing Process and Optimization #Robot Manipulation and Learning
paper · doi:10.48550/arxiv.2511.05394
openalex publication_date 2025/11/07 · openalex created_date 2025/12/05 · openalex updated_date 2026/07/28
We present an AI-assisted Augmented Reality assembly workflow that uses deep learning-based object recognition to identify different assembly components and display step-by-step instructions. For each assembly step, the system displays a bounding box around the corresponding components in the physical space, and where the component should be placed. By connecting assembly instructions with the real-time location of relevant components, the system eliminates the need for manual searching, sorting, or labeling of different components before each assembly. To demonstrate the feasibility of using object recognition for AR-assisted assembly, we highlight a case study involving the assembly of LEGO sculptures.