vix.ing · top · new · best · stats · spec

Learning the Latent Space of Robot Dynamics for Cutting Interaction Inference

2020/07/21 by Sahand Rezaei-Shoshtari, David Meger, Rezaei-Shoshtari, Sahand +3 · 1 citation
Computer Science · #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition #Image Processing and 3D Reconstruction #Machine Learning (cs.LG) #Robotics (cs.RO) #cs.LG #cs.RO

paper · pdf · doi:10.48550/arxiv.2007.11167

IROS2020. Copyright 20xx IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

openalex publication_date 2020/07/21 · arxiv created 2020/07/22 · arxiv updated 2020/07/23 · openalex created_date 2022/07/26 · openalex updated_date 2026/07/28

Abstract

Utilization of latent space to capture a lower-dimensional representation of a complex dynamics model is explored in this work. The targeted application is of a robotic manipulator executing a complex environment interaction task, in particular, cutting a wooden object. We train two flavours of Variational Autoencoders---standard and Vector-Quantised---to learn the latent space which is then used to infer certain properties of the cutting operation, such as whether the robot is cutting or not, as well as, material and geometry of the object being cut. The two VAE models are evaluated with reconstruction, prediction and a combined reconstruction/prediction decoders. The results demonstrate the expressiveness of the latent space for robotic interaction inference and the competitive prediction performance against recurrent neural networks.

Cited by

Related