True Meeting Inc.

Cavendish Capital LLC

Tal Perl

Ran Oz

Yuval Gronau

Osnat Goren-Peyser

Michael Rabinovich

Erez Posner

Amir Bassan-Eskenazi

A method for creating a variable model of a face of a person, the method comprises: obtaining a non-riggable model of the face of the person; performing a first approximation process that comprises generating an intermediate variable model that approximates the non-riggable model, using an interactive variable model infrastructure; wherein the generating comprises iteratively changing shape parameters of the intermediate model until fulfilling a proximity condition; and performing a second approximation process that comprises generating the variable model, by iteratively modifying vertices.

Method for creating a variable model of a face of a person

A method for creating a non-riggable model of a face of a person, the method includes obtaining video and depth information regarding the face of the person, wherein different images of the video are acquired by a camera at different camera locations; and for each image of the different images repeating the steps of: separating face information from background information; determining translation and rotation parameters that represent the different camera locations; and generating the non-riggable model of the face of the person based on the face information and the translation and rotation parameters.

Creating a non-riggable model of a face of a person

A method for updating a current three dimensional (3D) model of a person, that method may include calculating current locations, within a two-dimensional (2D) space, of current face landmark points of a face of a person within a first image; the calculating is based on the current 3D model, and one or more current acquisition parameters of a 2D camera; wherein the current 3D model of the person is located within a 3D space; calculating second locations, within the 2D space, of second face landmark points of the face of the person within a second image that follows the first image; calculating correspondences between the current locations and the second locations; calculating, based on the correspondences, locations of the second face landmark points within the 3D space; and modifying the current 3D model based on the locations of the second face landmark points within the 3D space.

Updating 3D models of persons

A method for generating a texture map used during a video conference, the method may include obtaining multiple texture maps of multiple areas of at least a portion of a three-dimensional (3D) object in which the multiple texture maps comprise a first texture map of a first area and of a first resolution, and a second texture map of a second area and of a second resolution, in which the first area differs from the second area and the first resolution differs from the second resolution; generating a texture map of the at least portion of the 3D object. The generating is based on the multiple texture maps; and utilizing the visual representation of the at least portion of the 3D object based on the texture map of the at least portion of the 3D object during the video conference.

3D video conferencing

A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include receiving initial 3D participant representation information for generating the 3D representation of the participant under different circumstances; receiving, by a user device of a first participant and during the 3D video conference call, second participant circumstances metadata indicative of one or more current circumstances regarding a second participant; and updating, by the user device of the first participant, a 3D participant representation of the second participant, within a first representation of virtual 3D video conference environment.

Circumstances based 3D representations of participants of virtual 3D communications

A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include receiving direction of gaze information regarding a direction of gaze of each participant within a representation of a virtual 3D video conference environment that is associated with the participant; determining, for each participant, updated 3D participant representation information within the virtual 3D video conference environment, that reflects the direction of gaze of the participant; and generating, for at least one participant, an updated representation of virtual 3D video conference environment, the updated representation of virtual 3D video conference environment represents the updated 3D participant representation information for at least some of the multiple participants.

Method and system for virtual 3D communications

A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include receiving second participant metadata and first viewpoint metadata by a first unit that is associated with a first participant, wherein the second participant metadata is indicative of a pose of a second participant and an expression of the second participant, wherein the first viewpoint metadata is indicative of a virtual position from which the first participant requests to view an avatar of the second participant; generating, by the first unit, and based on the second participant metadata and the first viewpoint metadata, a second participant representation information; wherein the second participant representation information comprises a compact 3D model of the second participant and a second participant texture map; and determining, for the first participant and during the 3D video conference, a representation of virtual 3D video conference environment, wherein the determining is based on the second participant representation information.

Virtual 3D communications with participant viewpoint adjustment

A method for generating a three dimensional (3D) visual representation of a sensed object that is three dimensional, the method comprises obtaining at least one 3D visual representation parameter, the visual representation parameters is selected out of a size parameter, a resolution parameter, and a resource consumption parameter; obtaining object information that represents the sensed object; selecting, based on the at least one parameter, a neural network for generating the visual representation of the sensed object; and generating the 3D visual representation of the 3D object by the selected neural network.

Generating a 3D visual representation of the 3D object using a neural network selected out of multiple neural networks

A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include determining, for each participant, updated 3D participant representation information within the virtual 3D video conference environment, that represents participants; wherein the determining comprises estimating 3D participant representation information of one or more hidden areas of a face of a participant that are hidden from the camera that captures at least one visible area of the face of the participant; and generating, for at least one participant, an updated representation of virtual 3D video conference environment, the updated representation of virtual 3D video conference environment represents the updated 3D participant representation information for at least some of the multiple participants.

Virtual 3D communications that include reconstruction of hidden face areas

A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include determining, for each participant, updated 3D participant representation information within the virtual 3D video conference environment, that represents participant; wherein the determining comprises compensating for difference between an actual optical axis of a camera that acquires images of the participant and a desired optical axis of a virtual camera; and generating, for at least one participant, an updated representation of virtual 3D video conference environment, the updated representation of virtual 3D video conference environment represents the updated 3D participant representation information for at least some of the multiple participants.

Virtual 3D communications with actual to virtual cameras optical axes compensation

A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include determining, for each participant and multiple times during the 3D video conference, updated 3D participant representation information within the virtual 3D video conference environment; and generating, for at least one participant and multiple times during the 3D video conference, an updated representation of a virtual 3D video conference environment, the updated representation of virtual 3D video conference environment represents the updated 3D participant representation information for at least some of the multiple participants; and wherein the 3D participant representation information comprises a 3D model and one or more texture maps.

Virtual 3D communications using models and texture maps of participants

A method for generating a texture map used during a video conference, the method may include obtaining multiple texture maps of multiple areas of at least a portion of a three-dimensional (3D) object; wherein the multiple texture maps comprise a first texture map of a first area and of a first resolution, and a second texture map of a second area and of a second resolution, wherein the first area differs from the first area and the first resolution differs from the second resolution; and generating a texture map of the at least portion of the 3D object, the generating is based on the multiple texture maps; and utilizing the visual representation of the at least portion of the 3D object based on the texture map of the at least portion of the 3D object during the video conference.

Growing community of inventors

Los Altos, CA, United States of America

Tal Perl