| Perspective invariant movie analysis for depth recovery (2007) | |||||||||||||
Abstract | |||||||||||||
| Processing entire movies and taking advantage of the inter-frame redundancy is the key of shape-from-motion analysis. Thus, recovering the depth of a fixed scene from an image sequence can be viewed as a movie processing problem: how to focus the redundant depth information of a noisy image sequence into a perfect depth-coherent movie? We present a natural set of axioms in agreement with the depth recovery, in the simple case of a straight movement of the camera parallel to the focal plane. According to these axioms, we show that there is a unique depth-coherent way of processing movies, described by a nonlinear partial differential equation. The corresponding multiscale analysis has the property of smoothing the motion field of a movie, leading naturally to a perfect motion field compatible with a depth interpretation. Moreover, in the case of an ideal movie, i.e. coherent with the observation of a fixed 3D scene, this analysis can be viewed as a simple filtering of the camera movement preserving the depth interpretation given by the movie, and is thereby perspective invariant. Last, we study a numerical scheme, compatible with the theoritical axioms, and produce some experiments on synthetic noisy movies. key-words: shape from motion, image sequence processing, perspective invariance, multiscale analysis. | |||||||||||||
Publication details | |||||||||||||
| |||||||||||||