Qualcomm Incorporated

Samsung Electronics Co., Ltd.

Velos Media, LLC

Thomson Licensing

Other

Rajan Laxman Joshi

Marta Karczewicz

Joel Sole Rojals

Vadim Seregin

Wei Pu

Madhukar Budagavi

Vijayaraghavan Thirumalai

Feng Zou

Natan Jacobson

Liwei Guo

Jianle Chen

Krishnakanth Rapaka

Peisong Chen

Muhammed Zeyd Coban

Hossein Najaf-Zadeh

Wei-Jung Chien

Chao Pang

Yunfei Zheng

Yuriy Reznik

Cheng-Teh Hsieh

Woo-Shik Kim

Ye-Kui Wang

Xianglin Wang

Hsiao-Chiang Chuang

Esmaeil Faramarzi

Li Feng Zhang

Geert Van Der Auwera

Xiang Yang Li

Ying Hai Chen

Min Dai

Neha Dawar

Xin Zhao

Adarsh Krishnan Ramasubramonian

Youngkwon Lim

Ike Ikizyan

Indranil Sinharoy

Yi-Wen Chen

Imed Bouazizi

Amir Said

Yu-Chen Sun

Ana Belen Benitez

Jewon Kang

James Arthur Fancher

Rahul P Panchal

Eric Ho Ching Yip

Natan Haim Jacobson

A method for point cloud encoding includes generating, for a three-dimensional (3D) point cloud, video frames and atlas frames that includes pixels representing information about the 3D point cloud, wherein atlas tiles represent partitions in the atlas frames and video tiles represent partitions in the video frames. The method also includes setting a value for a syntax element according to relationships between sizes of the video tiles and sizes of the atlas tiles. The method further includes encoding the video frames and the atlas frames to generate video sub-bitstreams and an atlas sub-bitstream, respectively. Additionally, the method includes generating a bitstream based on the atlas sub-bitstream, the video sub-bitstreams, and the syntax element and transmitting the bitstream.

Tiling for video based point cloud compression

An apparatus includes a communication interface configured to receive a bitstream for a compressed video and a processor operably coupled to the communication interface. The processor is configured to decode the bitstream for the compressed video. The processor is also configured to identify a mapping of view numbers of a plurality of images and a plurality of subpicture identifiers, each of the plurality of subpicture identifiers associated with a defined location in a video frame, wherein the mapping is signaled in the bitstream, and wherein each one of the view numbers is assigned to one image of the plurality of images based on a corresponding one of a plurality of camera viewpoints of a scene. The processor is also configured to instruct a display of at least one image based on at least one of the plurality of images.

Signaling of multiview tiled volumetric video

An apparatus comprises a communication interface and a processor operably coupled to the communication interface. The communication interface is configured to receive a compressed bitstream including association information between scene objects and submeshes. The processor is configured to determine an index of a scene object, decode the association information between scene objects and submeshes, determine an identifier of a submesh based on the association information and the index of the scene object, and reconstruct the submesh based on the identifier.

Submesh coding for dynamic mesh coding

An apparatus includes a communication interface and a processor operably coupled to the communication interface. The processor is configured to form an LOD signal corresponding to a displacement field. The processor is further configured to identify one or more samples of the LOD signal. The processor is further configured to determine whether a set of values of the one or more samples has a positive skew or a negative skew and set a skew flag. The processor is further configured to convert the set of values to a set of unsigned symbols according to the determined positive skew or negative skew. The processor is further configured to perform binarization on the converted set of values. The processor is further configured to produce an output bitstream including encoding the LOD signal using the converted and binarized set of values and encoding the skew flag in the output bitstream.

Coding of displacements using skew flag for vertex mesh (V-MESH)

A video encoder may transform residual data by using a transform selected from a group of transforms. The transform is applied to the residual data to create a two-dimensional array of transform coefficients. A scanning mode is selected to scan the transform coefficients in the two-dimensional array into a one-dimensional array of transform coefficients. The combination of transform and scanning mode may be selected from a subset of combinations that is based on an intra-prediction mode. The scanning mode may also be selected based on the transform used to create the two-dimensional array. The transforms and/or scanning modes used may be signaled to a video decoder.

Video coding using mapped transforms and scanning modes

An encoding device, a decoding device, and a method for mesh decoding are disclosed. The method for mesh decoding includes receiving a bitstream. The method also includes decoding a frame that includes pixels from the bitstream. A portion of the pixels of the frame represent geometric locations of vertices of a 3D mesh that are organized into overlapped patches. The method further includes decoding connectivity information from the bitstream. Additionally, the method includes identifying triangles associated with the overlapped patches. The triangles represented in an overlapped patch of the overlapped patches are allocated to a projection direction based on a normal vector associated with each of the triangles of the overlapped patch. The method also includes reconstructing the 3D mesh based on the connectivity information and the overlapped patches.

Overlapped patches for mesh coding for video based point cloud compression

A method for point cloud decoding includes receiving a bitstream. The method also includes decoding the bitstream into multiple frames that include pixels. Certain pixels of the multiple frames correspond to points of a three-dimensional (3D) point cloud. The multiple frames include a first set of frames that represent locations of the points of the 3D point cloud and a second set of frames that represent attribute information for the points of the 3D point cloud. The method further includes reconstructing the 3D point cloud based on the first set of frames. Additionally, the method includes identifying a first portion of the points of the reconstructed 3D point cloud based at least in part on a property associated with the multiple frames. The method also includes modifying a portion of the attribute information. The portion of the attribute information that is modified corresponds to the first portion of the points.

Attribute transfer in V-PCC

An encoding device and a method for point cloud encoding are disclosed. The method includes segmenting an area including points representing a three-dimensional (3D) point cloud into multiple voxels. The method also includes generating a patch information for each of the multiple voxels that include at least one of the points of the 3D point cloud. The method further includes assigning the patch information of the multiple voxels to the points included in each respective voxel, to generate patches that represent the 3D point cloud. Additionally, the method includes generating frames that include pixels that represent the patches. The method also includes encoding the frames to generate a bitstream and transmitting the bitstream.

Complexity reduction of video-based point cloud compression encoding using grid-based segmentation

A method for point cloud decoding includes receiving a bitstream. The method also includes decoding the bitstream into multiple frames that include pixels. A portion of the pixels are organized into patches and correspond to respective clusters of points of a 3D point cloud. The method further includes decoding, from the bitstream, an occupancy map frame. The occupancy map frame indicates the portion of the pixels included in the multiple frames that represent the points of the 3D point cloud. In addition, the method includes reconstructing the 3D point cloud using the multiple frames and the occupancy map frame. The method also includes determining whether to perform smoothing to the 3D point cloud based at least in part on properties of the multiple frames. Based on determining to perform the smoothing, the method includes performing the smoothing to the 3D point cloud.

Decision-making rules for attribute smoothing

In an example, a method of processing video data may include inferring a pixel scan order for a first palette mode encoded block of video data without receiving a block-level syntax element having a value representative of the pixel scan order for the first palette mode encoded block. The method may include decoding the first palette mode encoded block of video data using the inferred pixel scan order. The method may include receiving a block-level syntax element having a value representative of a pixel scan order for a second palette mode encoded block of video data. The method may include determining the pixel scan order for the second palette mode encoded block of video data based on the received block-level syntax element. The method may include decoding the second palette mode encoded block of video data using the determined pixel scan order.

Palette mode encoding and decoding design

A decoding device for point cloud decoding includes a communication interface and a processor. The communication interface configured to receive a bitstream. The processor is configured to identify, from the bitstream, messages and one or more sub-bitstreams representing a three-dimensional (3D) point cloud. The processor is configured to identify a query label indicating an object of the 3D point cloud for decoding. In response to determining that the query label corresponds to a label, the processor is configured to identify a 3D scene object associated with the query label. The processor is configured to identify a 2D tile that correspond to the 3D scene object. The processor is configured to determine to decode, based on an identification of the 2D tile from the sub-bitstream, a portion of the sub-bitstream corresponding to the 2D tile to generate a portion of a video frame representing a portion of the 3D scene object.

Partial decoding and reconstruction of a video-based point cloud compression bitstream

Growing community of inventors

San Diego, CA, United States of America

Rajan Laxman Joshi