High-quality passive performance capture using anchor frames

Abstract

High-quality passive performance capture using anchor frames derives in part from a robust tracking algorithm. Tracking is performed in image space and uses an integrated result to propagate a single reference mesh to performances represented in the image space. Image-space tracking is computed for each camera in multi-camera setups. Thus, multiple hypotheses can be propagated forward in time. If one flow computation develops inaccuracies, the others can compensate. This yields results superior to mesh-based tracking techniques because image data typically contains much more detail, facilitating more accurate tracking. Moreover, the problem of error propagation due to inaccurate tracking in image space can be dealt with in the same domain in which it occurs. Therefore, there is less complication of distortion due to parameterization, a technique used frequently in mesh processing algorithms.