Apple Inc.

Graham L Fyffe

Yang Song

Olivier Soares

Gilles M Cadet

Shaobo Guan

Andrew P Mason

Rendering an avatar for a user in a communication session includes obtaining one or more identity textures for the user for the session and obtaining, throughout the session, shading latents for the user. The shading latents are derived from lighting and other information and are utilized as input into a decoder to obtain one or more neural maps. A target texture is generated by warping the identity textures based on the neural maps. The target texture is used for rendering the avatar.

Neural shading

Various implementations disclosed herein include devices, systems, and methods that present a view of a device user's face portion, that would otherwise be blocked by an electronic device positioned in front of the face, on an outward-facing display of the user's device. The view of the user's face portion may be configured to enable observers to see the user's eyes and facial expressions as if they were seeing through a clear device at the user's actual eyes and facial expressions. Various techniques are used to provide views of the user's face that are realistic, that show the user's current facial appearance, and/or that present the face portion with 3D spatial accuracy, e.g., each eye appearing to be in its actual 3D position. Some implementations combine live data with previously-obtained data, e.g., combining live data with enrollment data.

Rendering of enrolled user's face for external display

Various implementations disclosed herein include devices, systems, and methods that present a view of a device user's face portion, that would otherwise be blocked by an electronic device positioned in front of the face, on an outward-facing display of the user's device. The view of the user's face portion may be configured to enable observers to see the user's eyes and facial expressions as if they were seeing through a clear device at the user's actual eyes and facial expressions. Various techniques are used to provide views of the user's face that are realistic, that show the user's current facial appearance, and/or that present the face portion with 3D spatial accuracy, e.g., each eye appearing to be in its actual 3D position.

Growing community of inventors

Playa Vista, CA, United States of America

Graham L Fyffe