2024/09/27 by Alexander Htet Kyaw, Miana Smith, Kyaw, Alexander Htet +5 · 4 citations
Engineering · #Advanced Manufacturing and Logistics Optimization #BIM and Construction Integration #Innovations in Concrete and Construction Materials
paper · pdf · doi:10.48550/arxiv.2409.18390
We present a system that transforms speech into physical objects using 3D generative AI and discrete robotic assembly. By leveraging natural language, the system makes design and manufacturing more accessible to people without expertise in 3D modeling or robotic programming. While generative AI models can produce a wide range of 3D meshes, AI-generated meshes are not directly suitable for robotic assembly or account for fabrication constraints. To address this, we contribute a workflow that integrates natural language, 3D generative AI, geometric processing, and discrete robotic assembly. The system discretizes the AI-generated geometry and modifies it to meet fabrication constraints such as component count, overhangs, and connectivity to ensure feasible physical assembly. The results are demonstrated through the assembly of various objects, ranging from chairs to shelves, which are prompted via speech and realized within 5 minutes using a robotic arm.