Nvidia Corporation

Evgeny Aleksandrovich Tumanov

Alexey Solovey

Yan Breek

Prakash Gurumurthy

Dmitry Korobchenko

Simon Yuen

Kevin Margo

Personalized coaching is provided to users of an application, such as players of an electronic gaming application. Data can be obtained that demonstrates how skilled users utilize an application, such as how professional players play a game. This data can be used to train a machine learning model for the game. Gameplay data for an identified player can be obtained, and related information provided as input to the trained model. The model can infer one or more actions or strategies to be taken by the player in order to achieve a determined goal. The information can be conveyed to the player using visual, audio, or haptic guidance during gameplay, or can be provided offline, such as with video or rendered replay of the game session. The types of advice or coaching given can vary depending upon factors such as the goals, skill level, and preferences of the player, and can update over time.

Gamer training using neural networks

In various examples, animations may be generated using audio-driven body animation synthesized with voice tempo. For example, full body animation may be driven from an audio input representative of recorded speech, where voice tempo (e.g., a number of phonemes per unit time) may be used to generate a 1D audio signal for comparing to datasets including data samples that each include an animation and a corresponding 1D audio signal. One or more loss functions may be used to compare the 1D audio signal from the input audio to the audio signals of the datasets, as well as to compare joint information of joints of an actor between animations of two or more data samples, in order to identify optimal transition points between the animations. The animations may then be stitched together—e.g., using interpolation and/or a neural network trained to seamlessly stitch sequences together—using the transition points.

Synthetic audio-driven body animation using voice tempo

Growing community of inventors

Moscow, Russia

Evgeny Aleksandrovich Tumanov