Deep Feature Flow for Video Recognition
Xizhou Zhu, Yuwen Xiong, Jifeng Dai et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017
Deep convolutional neutral networks have achieved great success on image recognition tasks. Yet, it is non-trivial to transfer the state-of-the-art image recognition networks to videos as per-frame evaluation is too slow and unaffordable. We present deep feature flow, a fast and accurate framework for video recognition. It runs the expensive convolutional sub-network only on sparse key frames and propagates their deep feature maps to other frames via a flow field. It achieves significant speedup as flow computation is relatively fast. The end-to-end training of the whole architecture significantly boosts the recognition accuracy. Deep feature flow is flexible and general. It is validated on two recent large scale video datasets. It makes a large step towards practical video recognition. Code would be released.
Cited by 653 works. doi:10.1109/cvpr.2017.441 Open-access PDF
Authors
References
- Deep Residual Learning for Image Recognition
- ImageNet classification with deep convolutional neural networks
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
- Going deeper with convolutions
- ImageNet Large Scale Visual Recognition Challenge
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- Fully convolutional networks for semantic segmentation
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
- Fast R-CNN