Kit-Net: Self-Supervised Learning to Kit Novel 3D Objects into Novel 3D Cavities
Shivin Devgon, Jeffrey Ichnowski, Michael Danielczuk et al. · 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE) · 2021
In industrial part kitting, 3D objects are inserted into cavities for transportation or subsequent assembly. Kitting is a critical step as it can decrease downstream processing and handling times and enable lower storage and shipping costs. We present Kit-Net, a framework for kitting previously unseen 3D objects into cavities given depth images of both the target cavity and an object held by a gripper in an unknown initial orientation. Kit-Net uses self-supervised deep learning and data-augmentation to train a convolutional neural network (CNN) to robustly estimate 3D rotations between objects and matching concave or convex cavities using a large training dataset of simulated depth images pairs. Kit-Net then uses the trained CNN to implement a controller to orient and position novel objects for insertion into novel prismatic and conformal 3D cavities. Experiments in simulation suggest that Kit-Net can orient objects to have a 98.9% average intersection volume between the object mesh and that of the target cavity. Physical experiments with industrial objects succeed in 18 % of trials using a baseline method and in 63% of trials with Kit-Net. Video, code, and data are available at https://github.com/BerkeleyAutomation/Kit-Net.
Cited by 9 works. doi:10.1109/case49439.2021.9551395 Open-access PDF
Authors
- Shivin Devgon
- Jeffrey Ichnowski
- Michael Danielczuk
- Daniel S. Brown
- Ashwin Balakrishna
- Shirin Joshi
- Eduardo M.C. Rocha
- Eugen Solowjow
- Ken Y. Goldberg
References
- PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
- Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metrics
- Orienting polygonal parts without sensors
- Learning ambidextrous robot grasping policies
- Regrasping
- Extrinsic dexterity: In-hand manipulation with external forces
- Deep Global Registration
- Relative Camera Pose Estimation Using Convolutional Neural Networks
- 6-DOF Grasping for Target-driven Object Manipulation in Clutter
- PoseRBPF: A Rao–Blackwellized Particle Filter for 6-D Object Pose Tracking