Tencent America LLC

Sehoon Yea

Shan Liu

Arash Vosoughi

Stephan Wenger

Xin Zhao

Wen Gao

Byeongdoo Choi

Xiang Zhang

Iraj Sodagar

Yixin Du

Shuai Zhao

Birendra Kathariya

Madhu Peringassery Krishnan

A method of dynamic point cloud partition packing is by at least one processor and includes obtaining one or more region of interest (ROI) patches from an ROI of a point cloud, and attempting to pack, into one among tiles of a tile map, one among the obtained one or more ROI patches, in a tile scan order. The method further includes identifying whether the one among the one or more ROI patches is packed successfully into the one among the tiles, and based on the one among the one or more ROI patches being determined to be not packed successfully into the one among the tiles, chunking the one among the one or more ROI patches into multiple ROI patches.

Techniques and apparatus for automatic ROI chunking for content-aware point cloud compression using HEVC tiles

Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that decodes a video bitstream to obtain a reduced-resolution residual block for a current block. The processing circuitry determines that a block level flag is set to a pre-defined value. The pre-defined value indicates that the current block is coded in reduced-resolution coding. Based on the block level flag, the processing circuitry generates a reduced-resolution prediction block for the current block by down-sampling a full-resolution reference block of the current block. The processing circuitry generates a reduced-resolution reconstruction block for the current block based on the reduced-resolution prediction block and the reduced-resolution residual block. The processing circuitry generates a full-resolution reconstruction block for the current block by up-sampling the reduced-resolution reconstruction block.

Block-level adaptive mixed-resolution prediction

Aspects of the disclosure provide methods and apparatuses for video encoding and decoding. Processing circuitry of an apparatus for video decoding decodes coded information for one or more blocks from a coded video bitstream. The coded information indicates whether to apply a super resolution coding mode to the one or more blocks. The super resolution coding mode is applied in response to the one or more blocks having been down sampled from a high spatial resolution to a low spatial resolution lower than the high spatial resolution by an encoder. Based on the coded information indicating that the super resolution coding mode is applied to the one or more blocks, the processing circuitry can generate, using the super resolution coding mode, a reconstructed block having the high spatial resolution by upsampling information of a first block having the low spatial resolution in the one or more blocks including transform coefficients.

Superresolution-based coding

In a method for point cloud processing, a bitstream corresponding to a sequence of coded point cloud frames is received. Whether an implicit geometry partition is enabled for the sequence of coded point cloud frames is determined. An octree representing a geometry of points in a bounding box in a coded point cloud frame in the sequence of coded point cloud frames is reconstructed based on whether the implicit geometry partition is determined to be enabled for the sequence of coded point cloud frames.

Implicit geometry partition for point cloud coding

A Method of decoding an encoded video bitstream using at least one processor includes: obtaining an encoded video bitstream, the encoded video bitstream including encoded color components; entropy parsing the encoded color components; dequantizing the color components and obtaining transform coefficients of the color components; applying a joint components secondary transform (JCST) on the transform coefficients of the color components, thereby generating JCST outputs; performing a backward transform on the JCST outputs, thereby obtaining residual components of the color components; and decoding the encoded video bitstream based on the residual components of the color components.

Joint component secondary transform

A method of video decoding includes determining directionality information of a restoration filter unit included in a video frame based on directionality of each of one or more groups of pixels in the restoration filter unit determined by at least one of a previously performed CDEF process or a previously performed intra prediction coding process. The method also includes selecting, based on the directionality information of the restoration filter unit, a set of filter parameters from among a plurality of sets of filter parameters of a restoration filter process, and, after the at least one of the previously performed CDEF process or the previously performed intra prediction coding process, performing one of a Wiener filter process or a self-guided projection filter process as the restoration filter process on the restoration filter unit based on the selected set of filter parameters.

Using directionality information from a CDEF or intra coding process for restoration filtering

A method of point cloud attribute coding is performed by at least one processor and includes receiving a point cloud data set comprising a bounding box. A determination is made as to whether the bounding box is symmetric or asymmetric. A quad-tree-binary-tree (QtBt) decomposition is performed on the point cloud data set based on the bounding box being asymmetric.

Techniques and apparatus for explicit quad-tree and binary-tree partitioning for geometry coding

A method and apparatus for encoding a video stream using video point cloud coding, the decoding including obtaining an input point cloud; dividing the input point cloud into a plurality of chunks, including a first chunk including a first plurality of points and a second chunk including a second plurality of points; generating a first plurality of patches based on the first plurality of points; generating a second plurality of patches based on the second plurality of points; packing the first plurality of patches and the second plurality of patches into an image; and generating the video stream based on the image.

Method and apparatus for point cloud chunking for improved patch packing and coding efficiency

A method of point cloud geometry encoding includes receiving a slice of a point cloud frame for encoding, and constructing an octree representing a geometry of points in a bounding box of the slice where a current node of the octree is partitioned with a quadtree (QT) partition or a binary tree (BT) partition. The constructing includes determining a value of a partitionSkip variable specifying a partition type and a partition direction of the current node of the octree.

Implicit quadtree or binary-tree geometry partition for point cloud coding

Method and apparatus for video coding

A method of encoding video data corresponding to a point cloud by at least one processor, the method including obtaining a plurality of transform coefficients corresponding to attributes of the point cloud; and encoding the plurality of transform coefficients to generate an embedded bitstream, the encoding including iterating over a plurality of bit-planes of the plurality of transform coefficients to process all points in the point cloud.

Techniques and apparatus for scalable lifting for point-cloud attribute coding

Method and apparatus for dynamic point cloud partition packing

A method of obtaining a tree-based point cloud compression (PCC) media stream using moving picture experts group (MPEG)-dynamic adaptive streaming over http (DASH), is performed by at least one processor and includes obtaining, from a server, a media representation description (MPD) comprising a PCC uniform resource indicator (URI) and a PCC three-dimensional (3D) descriptor, and determining whether the PCC URI comprised in the obtained MPD indicates that the tree-based PCC media stream is to be accessed. The method further includes, based on the PCC URI being determined to indicate that the tree-based PCC media stream is to be accessed, obtaining, from the server, the tree-based PCC media stream, using the PCC 3D descriptor comprised in the obtained MPD.

Method and apparatus for tree-based point cloud compression (PCC) media stream using moving picture experts group (MPEG)-dynamic adaptive streaming over HTTP (DASH)

A method of point cloud geometry decoding in a point cloud decoder can include receiving a bitstream including a slice of a coded point cloud frame, and reconstructing an octree representing a geometry of points in a bounding box of the slice where a current node of the octree is partitioned with a quadtree (QT) partition or a binary tree (BT) partition.

A method of point cloud geometry decoding including receiving, from a coded bitstream for a point cloud that includes a set of points in a three-dimensional (3D) space, first signaling information being indicative of partition information of the point cloud, and receiving second signaling information that indicates whether the 3D space is an asymmetric cuboid. The method further includes determining dimensions of the 3D space that are signaled along x, y, and z directions based on the second signaling information indicating that the 3D space is the asymmetric cuboid. The method further includes, in response to the first signaling information indicating that the 3D space is the asymmetric cuboid, partitioning the 3D space based on the determined dimensions of the 3D space and based on the partition information indicated by the first signaling information, and reconstructing, by the processing circuitry, the point cloud based on the partitioned 3D space.

Growing community of inventors

Palo Alto, CA, United States of America

Sehoon Yea