Physically-valid view synthesis by image interpolation
Steven M. Seitz, Charles R. Dyer · 2002
Image warping is a popular tool for smoothly transforming one image to another. "Morphing" techniques based on geometric image interpolation create compelling visual effects, but the validity of such transformations has not been established. In particular, does 2D interpolation of two views of the same scene produce a sequence of physically valid in-between views of that scene? We describe a simple image rectification procedure which guarantees that interpolation does in fact produce valid views, under generic assumptions about visibility and the projection process. Towards this end, it is first shown that two basis views are sufficient to predict the appearance of the scene within a specific range of new viewpoints. Second, it is demonstrated that interpolation of the rectified basis images produces exactly this range of views. Finally, it is shown that generating this range of views is a theoretically well-posed problem, requiring neither knowledge of camera positions nor 3D scene reconstruction. A scanline algorithm for view interpolation is presented that requires only four user-provided feature correspondences to produce valid orthographic views. The quality of the resulting images is demonstrated with interpolations of real imagery.
Cited by 144 works. doi:10.1109/wvrs.1995.476848
Authors
References
- Computational vision and regularization theory
- Shape and motion from image streams under orthography: a factorization method
- Recognition by linear combinations of models
- Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming
- View interpolation for image synthesis
- Affine structure from motion
- Depth from edge and intensity based stereo
- Feature-based image metamorphosis
- Example Based Image Analysis and Synthesis
- 3-D Scene Representation as a Collection of Images and Fundamental Matrices