Machine learning models for generative human motion simulation

Abstract

Systems and methods are disclosed relating to receiving at least one of a text prompt or a kinematic constraint, generating, by a motion model including a first model and a second model, human motion data of a human character by applying a random noise and the at least one of the text prompt or the kinematic constraint into the motion model. Generating the human motion data includes, for each iteration of diffusion determining, using the first model, global root motion by applying noisy global root motion and noisy local joint motion as inputs into the first model and determining, using the second model, local joint motion by applying the noisy local joint motion and local root motion as inputs into the second model. The local root motion is determined based on the global root motion. The human motion data includes the local joint motion and the global root motion.