Adversarial Grasp Objects
David Wang, David Tai Hee Tseng, Pusong Li et al. · 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE) · 2019
Learning-based approaches to robust robot grasp planning can grasp a wide variety of objects, but may be prone to failure on some objects. Inspired by recent results in computer vision, we define a class of “adversarial grasp objects that are physically similar to a given object but significantly less ”graspable” in terms of a specified robot grasping policy. We present three algorithms for synthesizing adversarial grasp objects under the grasp reliability measure of Dex-Net 1.0 for parallel-jaw grippers: 1) two analytic algorithms that perturb vertices on antipodal faces (one that uses random perturbations and one that uses systematic perturbations), and 2) a deep-learning-based approach using a variation of the Cross-Entropy Method (CEM) augmented with a generative adversarial network (GAN) to synthesize classes of adversarial grasp objects represented by discrete Signed Distance Functions. The random perturbation algorithm reduces graspability by 32%, 12%, and 32% for intersected cylinders, intersected prisms, and ShapeNet bottles, respectively, while maintaining shape similarity using geometric constraints. The systematic perturbation algorithm reduces graspability by 32%, 11%, and 21%; and the GAN reduces graspability by 22%, 36%, and 17%, on the same objects. We use the algorithms to generate and 3D print adversarial grasp objects. Simulation and physical experiments confirm that all algorithms are effective at reducing graspability.
Cited by 29 works. doi:10.1109/coase.2019.8843059
Authors
- David Tai Hee Tseng
- Pusong Li
- Yiding Jiang
- Menglong Guo
- Michael Danielczuk
- Jeffrey Mahler
- Jeffrey Ichnowski
- Ken Y. Goldberg
References
- Auto-Encoding Variational Bayes
- Intriguing properties of neural networks
- Level Set Methods and Dynamic Implicit Surfaces
- 3D ShapeNets: A deep representation for volumetric shapes
- Adversarial Examples in the Physical World
- Generative Adversarial Networks
- Pixel Recurrent Neural Networks
- Spectral Normalization for Generative Adversarial Networks
- Generative Adversarial Networks
- ShapeNet: An Information-Rich 3D Model Repository