Tencent America LLC

Ethan Schur

Shan Liu

Xiaozhong Xu

Xiang Zhang

A method and apparatus that renders a mesh from one or more virtual camera views of an object, the one or more virtual camera views being projections of the mesh onto a plurality of 2D planes; inputs the one or more virtual camera views into a fully-convolutional model for real-time segmentation; generates one or more 2D pixel-wise masks based on the fully-convolutional model, the 2D pixel-wise masks being associated with one or more segmented elements; performs remeshing and mesh optimization using the one or more 2D pixel-wise masks; and generates an output mesh based on the remeshing and mesh optimization.

Mesh optimization using novel segmentation

Aspects of the disclosure provide methods and apparatuses for gaze matching. In some examples, processing circuitry determines a position of an object of interest for a first user, and receives first one or more images of the first user that is taken by a camera at a camera position different from the position of the object of interest. The processing circuitry detects a first vergence of eyes of the first user, calculates a mismatch of the first vergence for viewing the object of interest, and performs a gaze correction of the first one or more images based on the mismatch of the first vergence for viewing the object of interest.

Growing community of inventors

San Jose, CA, United States of America

Ethan Schur