Joint surface patch motion and texture modelling for video segmentation and multiview video rendering.

This project will develop a mathematical framework for modelling local 3D motion of textured surface patches in a video sequence along with the texture paramters of the surface. There is a dependancy between the motion of the surface, its local orientation and the time variation of its projected texture so it is natural to model these as a joint random process. Also there is a strong correlation between motion and texture parameter discontinuties so again a cooperative model is a natural choice. A traditional Markov random field approach involving local potentials will be used along with a piecewise planar surface patch model. Parameter estimation within the model will be investigated along with suitable optimisation algorithms to recover local motion, 3D orientation and texture parameters.