Roto++
Wenbin Li, Fabio Viola, J. Starck et al. · ACM Transactions on Graphics · 2016
Rotoscoping (cutting out different characters/objects/layers in raw video footage) is a ubiquitous task in modern post-production and represents a significant investment in person-hours. In this work, we study the particular task of professional rotoscoping for high-end, live action movies and propose a new framework that works with roto-artists to accelerate the workflow and improve their productivity. Working with the existing keyframing paradigm, our first contribution is the development of a shape model that is updated as artists add successive keyframes. This model is used to improve the output of traditional interpolation and tracking techniques, reducing the number of keyframes that need to be specified by the artist. Our second contribution is to use the same shape model to provide a new interactive tool that allows an artist to reduce the time spent editing each keyframe. The more keyframes that are edited, the better the interactive tool becomes, accelerating the process and making the artist more efficient without compromising their control. Finally, we also provide a new, professionally rotoscoped dataset that enables truly representative, real-world evaluation of rotoscoping methods. We used this dataset to perform a number of experiments, including an expert study with professional roto-artists, to show, quantitatively, the advantages of our approach.
Cited by 45 works. doi:10.1145/2897824.2925973
Authors
References
- An Iterative Image Registration Technique with an Application to Stereo Vision
- Gaussian Processes for Machine Learning
- Active Shape Models-Their Training and Application
- "GrabCut"
- Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images
- Lucas-Kanade 20 Years On: A Unifying Framework
- Graphcut textures
- Intelligent scissors for image composition
- An efficient method for contour tracking using active shape models
- Blue screen matting