Capital One Services, LLC

Gm Cruise Holdings LLC

Chen Shen

Amanda Legge

Hariprasad Govardhanam

Matthew Koehler

The disclosed technology provides solutions for generating synthetic scenes based on sensor data and in particular, for generating synthetic representations of entities using splines. A process of the disclosed technology can include steps for extracting trajectory data associated with movement of an entity in an environment, generating splines based on the trajectory data, and generating a synthetic scene based on the splines. Systems and machine-readable media are also provided.

Synthetic scene generation using spline representations of entity trajectories

The disclosed technology provides solutions for generating synthetic objects and in particular, for generating three-dimensional objects using known geometries that can be queried from a database using feature vector information. A process of the disclosed technology can include steps for receiving sensor data including a detected object, wherein the sensor data represents one or more three-dimensional (3D) attributes of the detected object, processing the sensor data to identify at least one intrinsic attribute associated with the detected object, and querying an object database, based on the at least one intrinsic attribute, to identify a stored object that is similar to the detected object. In some aspects, the process can further include steps for modifying one or more attributes of the stored object based on the one or more 3D attributes of the detected object to generate a synthetic object. Systems and machine-readable media are also provided.

Generating synthetic three-dimensional objects

In some embodiments, the present disclosure provides an exemplary technically improved system and method for controlling the body movements and facial expressions of a digital character in real time by using: a body-motion capture system comprising a headset configured to be worn on a head of a user and comprising controllers and sensors that can be used to track at least one head or body motion of the user (including arms and hands); and correspondingly control at least one head or body motion (including arms and hands) of a digital character in real time based, at least in part, on the captured motion data; a mobile computing device configured to track and capture facial expression data relating to at least one facial expression of the user, and use at least that data to correspondingly control at least one facial expression of the digital character in real time; a microphone configured to capture an audio output of the user, and control an audio output of the digital character in real-time based, at least in part, on the captured audio output; an integration computing device configured to integrate the audio output, the motion data and the facial expression data to control the audio output, the motion, and the facial expression of the digital character; a vest configured to be worn on an body of the user and a structural member attached to the vest and configured to hold the mobile computing device at a predetermined distance from a face of the user so that the mobile computing device can track and capture the at least one facial expression of the user.

Systems configured to control digital characters utilizing real-time facial and/or body motion capture and methods of use thereof

A processor of an AR device may receive a plurality of points within a coordinate system corresponding to points in space. The plurality of points may define a path between a starting location within the coordinate system and a navigation destination within the coordinate system. The processor may determine that the AR device is at the starting location. The processor may receive camera data from a camera of the AR device. The camera data may represent at least a portion of the points in space. The processor may generate an AR display. The generating may include overlaying a graphic illustrating the position of at least a portion of the points within the coordinate system over equivalent points in space illustrated by the camera data.

Growing community of inventors

Albany, CA, United States of America

Chen Shen