Motion estimation using a complex-valued wavelet transform
Julian F. Magarey, N. G. Kingsbury · IEEE Transactions on Signal Processing · 1998
This paper describes a new motion estimation algorithm that is potentially useful for both computer vision and video compression applications. It is hierarchical in structure, using a separable two-dimensional (2-D) discrete wavelet transform (DWT) on each frame to efficiently construct a multiresolution pyramid of subimages. The DWT is based on a complex-valued pair of four-tap FIR filters with Gabor-like characteristics. The resulting complex DWT (CDWT) effectively implements an analysis by an ensemble of Gabor-like filters with a variety of orientations and scales. The phase difference between the subband coefficients of each frame at a given subpel bears a predictable relation to a local translation in the region of the reference frame subtended by that subpel. That relation is used to estimate the displacement field at the coarsest scale of the multiresolution pyramid. Each estimate is accompanied by a directional confidence measure in the form of the parameters of a quadratic matching surface. The initial estimate field is progressively refined by a coarse-to fine strategy in which finer scale information is appropriately incorporated at each stage. The accuracy, efficiency, and robustness of the new algorithm are demonstrated in comparison testing against hierarchical implementations of intensity gradient-based and fractional-precision block matching motion estimators.
Cited by 181 works. doi:10.1109/78.668557
Authors
References
- Digital communications
- A theory for multiresolution signal decomposition: the wavelet representation
- The Laplacian Pyramid as a Compact Image Code
- An Iterative Image Registration Technique with an Application to Stereo Vision
- Determining optical flow
- Determining Optical Flow
- Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters
- Digital Communication
- Shiftable multiscale transforms
- Performance of optical flow techniques