Device, system and method for improving motion estimation using a human motion model

Abstract

A device, system and method is provided for estimating movement based on a human movement model in a virtual, augmented or mixed reality environment. In an offline phase, a human movement model may be stored that assigns a non-uniform probability of spatiotemporal representations of movements that occur in a human body. In an online phase, a user's movements may be recorded. The user's movements may be estimated by spatiotemporal representations of a plurality of (N) degrees of freedom (DOF) that maximize a joint probability comprising a first probability that the measured movements match the estimated movements and a second probability that the human movement model assigns to the spatiotemporal representations of the estimated movements. A virtual, augmented or mixed reality image may be displayed that is rendered based on the NDOF spatiotemporal representations of the estimated movements.