Lg Electronics Inc.

Apple Inc.

Hfi Innovation Inc.

Mediatek Corporation

Korea Institute of Science and Technology

Jungsun Kim

Byeongmoon Jeon

Joonyoung Park

Yongjoon Jeon

Seungwook Park

Jaehyun Lim

Hendry Hendry

Chulkeun Kim

Younghee Choi

Jaewon Sung

Naeri Park

Alexandros Michael Tourapis

Khaled Mammou

Fabrice A Robinet

Yeping Su

Sangoh Jeong

Valery G Valentin

Shan Liu

Tzu-Der Chuang

David William Singer

Jing Ye

Wang-Lin Lai

Yu-Chen Sun

Xiaozhong Xu

Hsi-Jung Wu

Jingyeong Kim

Taeil Chung

Sangchul Kim

Ching-Yeh Chen

Yi-Wen Chen

Wang Lin Lai

Yu-Wen Huang

Jinpil Kim

Shaw-Min Lei

Kyungho Kim

Krishnakanth Rapaka

Sang Oh Jeong

Marius Preda

Dimitri Podborski

Byeong Moon Jeon

Yu Wang

Guy Cote

Jim Chen Chou

Weijia Zhu

Dae-Young Lee

David Flynn

Dominik Mehlem

Chao Cao

Beyongmoon Jeon

Liviu Traian Christian Tulvan

A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.

Point cloud compression with supplemental information messages

A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

Bit stream structure for compressed point cloud data

A system comprises an encoder configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder determines a compressed base mesh bit stream and a compressed motion bitstream. A network abstraction layer syntax defined for the compressed base mesh bit stream and the compressed motion bitstream, allows for various parameters to be defined and applied to both bit streams, such as timing information and faceIDs for faces of polygons of the mesh.

Base mesh data and motion information sub-stream format for video-based dynamic mesh compression

A method of compressing a 3D textured mesh M(i), the 3D textured mesh being defined by connectivity C(i), geometry G(i), texture coordinates T(i), and texture connectivity CT(i), wherein the mesh is associated with one or more 2D image attribute maps A(i) describing attributes associated with the mesh surface, can include pre-processing 3D textured mesh M(i) and attribute maps A(i) to generate a base mesh m(i) and displacement field d(i); and processing 3D textured mesh M(i), attribute maps A(i), base mesh m(i), and the displacement field d(i) to generate a compressed bitstream b(i).

Image/video-based mesh compression

A three-dimensional (3D) mesh encoder is provided. The 3D mesh encoder can include a pre-processing stage configured to generate the mesh M by re-sampling the mesh M and computing a new atlas of parametrization with a fewer number of patches and relatively lower parameterization distortion. The 3D mesh encoder may include an attribute transfer stage for transferring attributes to the re-sampled mesh M.

Attribute transfer for efficient dynamic mesh coding

A video dynamic mesh coding (v-DMC) decoding system, includes a de-multiplexer that receives and demultiplexes an encoded v-DMC bitstream into: a parameter set and mesh data, geometry, atlas data, and attribute video substreams. The decoding system also includes: a mesh data substream decoder; a video decoder that decodes the geometry data substream; an atlas data substream decoder; a mesh subdivision component that subdivides the one or more base meshes into one or more resampled base meshes based upon the decoded atlas data; a displacement decoder that outputs one or more displacements to verticies of the one or more resampled base meshes; a mesh position refinement component that applies the one or more displacements to the one or more resampled base meshes and outputs one or more resultant meshes; and a video decoder that decodes the attribute video substream into one or more texture images.

V-mesh bitstream structure including syntax elements and decoding process with reconstruction

A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.

Three-dimensional mesh compression using a video encoder

A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.

Point cloud attribute transfer algorithm

A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. The encoder is also configured to determine quantized minimum depths and/or maximum depths patch images in the image frames, wherein depth information is signaled relative to the quantized minimum depth.

Quantized depths for projection point cloud compression

An encoder is configured to compress point cloud information using a blocks of nodes determined from a prediction tree. A prediction tree is generated for a point cloud. Segments of the prediction tree are identified. The segments are divided into blocks that are predicted by predecessor blocks within the segments. The blocks of the prediction tree may then be encoded and may be provided for transmission to a decoder that can regenerate the point cloud from the blocks of the prediction tree.

Block-based predictive coding for point cloud compression

A system comprises an encoder configured to compress attribute information and/or spatial information for volumetric visual content and/or a decoder configured to decompress compressed attribute and/or spatial information for the volumetric visual content. The encoder is configured to convert a 3D representation of the visual volumetric content into a 2D image based representation. The encoder is further configured to scale the patch in 2D space independent of any scaling in 3D space. Auxiliary information is signaled for use in identifying 2D scaled or unscaled patches in an image frame, mapping the patches into 3D space, and adjusting for any scaling factors applied at the encoder.

Video-based point cloud compression with variable patch scaling

Techniques for encoding video with motion compensation include a compressed bitstream syntax that includes a list of all motion prediction reference frames without distinguishing between short-term reference frame and long-term reference frames. The list of reference frames may be provided in a slice header and may apply to encoded data video data within the corresponding slice. The list may be prefaced with a single number indicating the total number of reference frames. In an aspect delta POC reference numbers may be encoded with a flag indicating the sign of the delta POC when the absolute value of the POC is not equal to zero. In another aspect, a flag may be encoded for every reference frame indicating if POC information should be used when scaling prediction references, and a weighting parameter may be included when POC information should be used.

Reference picture management and list construction

Disclosed are a method and apparatus for encoding/decoding images. The image-decoding method comprises the steps of: receiving a bit stream including information regarding an NAL unit type; and checking whether or not the NAL unit in the bit stream is a reference picture based on said information regarding an NAL unit type and decoding the NAL unit. The information regarding an NAL unit type indicates whether the NAL unit is a reference reading picture or not a reference reading picture.

Method and apparatus for encoding/decoding images

The present invention relates to the encoding and decoding of image information. According to the present invention, the decoding method comprises the steps of: entropy-decoding received information; performing inter prediction on a current block based on the entropy-decoded information; and restoring images by using the prediction results, wherein, in the inter prediction step, a skip mode or merge mode is applied to the current block and movement information of the current block may be determined based on the movement information of a neighboring block of the current block.

Method for encoding and decoding image information and device using same

New intra planar modes are introduced for predicting digital video data. As part of the new intra planar modes, various methods are offered for predicting a first sample within a prediction unit, where the first sample is needed for referencing to when processing the new intra planar modes. And once the first sample is successfully predicted, the new intra planar modes are able to predict a sample of video data within the prediction unit by processing a bi-linear interpolation of four previously reconstructed reference samples.

Planar prediction mode

Growing community of inventors

San Jose, CA, United States of America

Jungsun Kim