Sony Interactive Entertainment Inc.

Deepali Arya

Rathish Krishnan

Jason Naxin Wang

Hung-Ju Lee

Eric Hsuming Chen

Manoj Srivastava

Seema Kataria

An image of a computer game player wearing a headset that occludes part of the face is input to a trained machine learning (ML) model, which outputs in response a full-face image that is not occluded for use in, e.g., social network settings related to the game.

Reconstruction of occluded regions of a face using machine learning

A machine learning (ML) model is trained using pairs of images. Each pair includes an image of a human face and a duplicate of the image with a computer game headset overlaid on the face using computer graphics. The ML model subsequently can be used to receive an image of a gamer wearing a headset and output a full-face image of the gamer for use in, e.g., social network settings related to the game.

Training a machine learning model for reconstructing occluded regions of a face

Video stream data is selectively scaled so that sections within regions of interest (ROI) maintain high resolution while areas not within the region of interest are down-scaled to reduce bandwidth cost of transmission. A low compression encoder compresses sections of a video frame corresponding to one or more ROI without motion search or prediction mode decision to generate low-compression section data. The video frame is downscaled and a high compression encoder compresses the resulting downscaled video frame with prediction mode decision to generate high-compression frame data.

Foveated video link for VR with gaze tracking

Gaze tracking data is analyzed to determine one or more regions of interest within an image of a video stream. The video stream data is selectively scaled so that sections within the regions of interest maintain high resolution while areas not within the region of interest are down-scaled to reduce bandwidth cost of transmission. A scheme for reduction of motion sickness by reducing the size of the high resolution area is also claimed.

Growing community of inventors

San Francisco, CA, United States of America

Deepali Arya