TY - CONF
T1 - 3D face reconstruction from video using a generic model
T2 - Multimedia and Expo, 2002. ICME '02. Proceedings. 2002 IEEE International Conference on
Y1 - 2002
A1 - Chowdhury, A.R.
A1 - Chellapa, Rama
A1 - Krishnamurthy, S.
A1 - Vo, T.
KW - 3D
KW - algorithm;
KW - algorithms;
KW - analysis;
KW - Carlo
KW - chain
KW - Computer
KW - Face
KW - from
KW - function;
KW - generic
KW - human
KW - image
KW - Markov
KW - MCMC
KW - methods;
KW - model;
KW - Monte
KW - MOTION
KW - optimisation;
KW - OPTIMIZATION
KW - processes;
KW - processing;
KW - recognition;
KW - reconstruction
KW - reconstruction;
KW - sampling;
KW - sequence;
KW - sequences;
KW - SfM
KW - signal
KW - structure
KW - surveillance;
KW - video
KW - vision;
AB - Reconstructing a 3D model of a human face from a video sequence is an important problem in computer vision, with applications to recognition, surveillance, multimedia etc. However, the quality of 3D reconstructions using structure from motion (SfM) algorithms is often not satisfactory. One common method of overcoming this problem is to use a generic model of a face. Existing work using this approach initializes the reconstruction algorithm with this generic model. The problem with this approach is that the algorithm can converge to a solution very close to this initial value, resulting in a reconstruction which resembles the generic model rather than the particular face in the video which needs to be modeled. We propose a method of 3D reconstruction of a human face from video in which the 3D reconstruction algorithm and the generic model are handled separately. A 3D estimate is obtained purely from the video sequence using SfM algorithms without use of the generic model. The final 3D model is obtained after combining the SfM estimate and the generic model using an energy function that corrects for the errors in the estimate by comparing local regions in the two models. The optimization is done using a Markov chain Monte Carlo (MCMC) sampling strategy. The main advantage of our algorithm over others is that it is able to retain the specific features of the face in the video sequence even when these features are different from those of the generic model. The evolution of the 3D model through the various stages of the algorithm is presented.
JA - Multimedia and Expo, 2002. ICME '02. Proceedings. 2002 IEEE International Conference on
VL - 1
M3 - 10.1109/ICME.2002.1035815
ER -