DOFS: A Real-world 3D Deformable Object Dataset with Full Spatial Information for Dynamics Model Learning

2024/10/29 by Zhen Zhang, Zhang, Zhen, Xiangyu Chu +5 · 1 citation
Earth and Planetary Sciences · Engineering · #3D Surveying and Cultural Heritage #Robotics and Sensor-Based Localization #3D Shape Modeling and Analysis

paper · pdf · doi:10.48550/arxiv.2410.21758

Abstract

This work proposes DOFS, a pilot dataset of 3D deformable objects (DOs) (e.g., elasto-plastic objects) with full spatial information (i.e., top, side, and bottom information) using a novel and low-cost data collection platform with a transparent operating plane. The dataset consists of active manipulation action, multi-view RGB-D images, well-registered point clouds, 3D deformed mesh, and 3D occupancy with semantics, using a pinching strategy with a two-parallel-finger gripper. In addition, we trained a neural network with the down-sampled 3D occupancy and action as input to model the dynamics of an elasto-plastic object. Our dataset and all CADs of the data collection system will be released soon on our website.

Cited by

• Manipulating Elasto-Plastic Objects With 3D Occupancy and Learning-Based Predictive Control

Related

• PokeFlex: Towards a Real-World Dataset of Deformable Objects for Robotic Manipulation
• DeformerNet: A Deep Learning Approach to 3D Deformable Object Manipulation
• PokeFlex: A Real-World Dataset of Volumetric Deformable Objects for Robotics
• DeformNet: Free-Form Deformation Network for 3D Shape Reconstruction from a Single Image
• DeformNet: Latent Space Modeling and Dynamics Prediction for Deformable Object Manipulation