Deformable Convolutional Networks
Jifeng Dai, Haozhi Qi, Yuwen Xiong et al. · IEEE International Conference on Computer Vision (ICCV) · 2017
Convolutional neural networks (CNNs) are inherently limited to model geometric transformations due to the fixed geometric structures in their building modules. In this work, we introduce two new modules to enhance the transformation modeling capability of CNNs, namely, deformable convolution and deformable RoI pooling. Both are based on the idea of augmenting the spatial sampling locations in the modules with additional offsets and learning the offsets from the target tasks, without additional supervision. The new modules can readily replace their plain counterparts in existing CNNs and can be easily trained end-to-end by standard back-propagation, giving rise to deformable convolutional networks. Extensive experiments validate the performance of our approach. For the first time, we show that learning dense spatial transformation in deep CNNs is effective for sophisticated vision tasks such as object detection and semantic segmentation. The code is released at https://github.com/msracver/Deformable-ConvNets.
Cited by 7,148 works. doi:10.1109/iccv.2017.89 Open-access PDF
Authors
References
- Deep Residual Learning for Image Recognition
- ImageNet classification with deep convolutional neural networks
- ImageNet: A large-scale hierarchical image database
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- Fully convolutional networks for semantic segmentation
- Microsoft COCO: Common Objects in Context
- You Only Look Once: Unified, Real-Time Object Detection
- The Pascal Visual Object Classes (VOC) Challenge
- Object recognition from local scale-invariant features