Tencent America LLC

Thuong Nguyen Canh

Shan Liu

Xiaozhong Xu

Xiang Zhang

Chao Huang

Fang-yi Chao

Xiang Li

Guichun Li

Jun Tian

A method performed by at least one processor of an encoder includes bounding a mesh via a bounding box; partitioning the mesh via a global symmetry plane that partitions the mesh into a first side and a second side that is opposite to the first side; dividing the mesh into a plurality of slices; determining a local symmetry plane for each slice based on the global symmetry plane; based on a determination that a vertex merging condition is satisfied for a first slice from the plurality of slices that shares a boundary with a second slice from the plurality of slices, merging one or more vertices in the boundary of the second slice with one or more vertices in the boundary of the first slice; and encoding each slice from the plurality of slices as a respective sub-mesh of the mesh.

Method and apparatus to encode symmetry mesh with multiple symmetry planes

A method and apparatus comprising computer code configured to cause a processor or processors to obtain an input mesh corresponding to volumetric data of at least one three-dimensional (3D) visual content, derive a curve of a mesh sequence from the input mesh corresponding to volumetric data, the curve including a plurality of vertices of the input mesh of the mesh sequence, subdivide the derived curve of the mesh sequence by adding subdivided vertices, computing a displacement vector for each of the plurality of subdivided vertices; and entropy code the volumetric data based on the displacement vector from at least one of the subdivided vertices.

Mesh vertex displacements coding

A method and apparatus comprising computer code configured to cause a processor or processors to obtain an input mesh corresponding to volumetric data of at least one three-dimensional (3D) visual content, partitioning the input mesh into a plurality of submeshes, each of the submeshes comprising a respective one of instances of objects, determine a similarity between at least two of the instance of objects, grouping the submeshes based on the determined similarity, and code the volumetric data based on grouping the submeshes.

Methods for instance-based mesh coding

A method of encoding includes receiving a polygon mesh comprising a plurality of original vertices. The method further includes deriving an initial base mesh from the polygon mesh, the initial base mesh including a first set of base mesh vertices. The method further includes performing a symmetrize process on the initial base mesh to generate a symmetrical base mesh that includes a first side having the first set of base mesh vertices and a second side having a second set of base mesh vertices, each base mesh vertex in the first set of base mesh vertices having a corresponding symmetric vertex in the second set of base mesh vertices. The method further includes determining a first displacement between each original vertex in the polygon mesh located on the second side of the symmetrical base mesh and a nearest vertex included in the second set of base mesh vertices.

Base mesh coding by using surface reflection symmetry

A method comprising segmenting an input symmetry mesh into multiple non-connected UV segments; partitioning at least one UV segment via a plane that partitions the at least one UV segment into a first side and a second side; reorganizing the plurality of vertices included in the first side of the at least one UV segment; perform a 2D symmetry detection on the at least one UV segment to find a symmetry transform; determining a predicted vertex for each vertex on the second side of the at least one UV segment based on the symmetry transform of a corresponding vertex on the first side of the at least one UV segment to find a predicted vertex on the first side of the at least one UV segment; and encoding a bitstream that comprises at least the vertices within the first side of the at least one UV segment.

Method and apparatus for UV attributes coding for symmetry mesh

A method and apparatus comprising computer code configured to cause a processor or processors to obtain an input mesh comprising volumetric data of at least one three-dimensional (3D) visual content, derive a plurality of submeshes of the input mesh from a frame of the volumetric data, set bitdepths to a first submesh and a second submesh from the submeshes, a first bitdepth being different than a second bitdepth, quantize the first submesh and the second submesh based on respective ones of the first bitdepth and the second bitdepth, and signal a result of quantizing the first submesh and the second submesh.

Adaptive quantization for instance-based mesh coding

A method performed by at least one processor of an encoder comprises: performing, on an input 3D mesh, a symmetry detection process to estimate a partition plane. The method further comprises partitioning the input 3D mesh into a first side and a second side based on the partition plane, where the first side is opposite to the second side, and where a first vertex on the first side is symmetric to a second vertex on the second side. The method further comprises quantizing the first vertex and the second vertex in pairs to reduce a quantization error and symmetry prediction error associated with the first vertex and the second vertex.

Method and apparatus for adaptive quantization for symmetry mesh

A method performed by encoder comprises partitioning a mesh into a first side and a second side; determining, for a first vertex located on the first side, whether a first perpendicular line extending from the first vertex intersects with two or more surfaces of the mesh on the second side, each intersection of the first perpendicular line corresponding to an intersected vertex on the second side; based on the determination the first perpendicular line intersects with two or more surfaces of the mesh on the second side, selecting one of the intersected vertices on the second side as a second vertex corresponding to the first vertex based on a shortest distance between each intersected vertex and a predicted vertex on the second side that is symmetric to the first vertex; and generating a new connection in the mesh.

Method and apparatus to symmetrize a mesh cross-reference to related application

A method and apparatus comprising computer code configured to cause a processor or processors to obtain volumetric data of at least one three-dimensional (3D) visual content, derive a mesh from a frame of the volumetric data, the mesh including a plurality of base mesh vertices, determine a displacement of at least one vertex, that is not of the base mesh vertices, based on a series of projections from at least one of the plurality of base mesh vertices that is a neighboring one of the plurality of base mesh vertices to the at least one vertex, predicting the at least one vertex based at least on the determined displacement, and encode the volumetric data based on the predicted at least one vertex.

Displacement coding for mesh compression

Aspects of the disclosure provide methods and apparatuses for video processing. In some examples, an apparatus for video processing includes processing circuitry. The processing circuitry determines one or more parameters of a temporal filter based on video contents in an uncompressed video. The uncompressed video includes a sequence of frames. Then, the processing circuitry applies the temporal filter with the determined parameter on a first pixel in a first frame to determine a filtered value for the first pixel based on the first pixel in the first frame and second pixels in a group of reference frames for the first frame. Further, the processing circuitry encodes a filtered video that includes the filtered value for the first pixel in the first frame to generate a coded video bitstream that carries the filtered video.

Growing community of inventors

Palo Alto, CA, United States of America

Thuong Nguyen Canh