Samsung Electronics Co., Ltd.

Esmaeil Faramarzi

Madhukar Budagavi

Rajan Laxman Joshi

Hossein Najaf-Zadeh

Indranil Sinharoy

Youngkwon Lim

Felix Carlos Fernandes

Sungryeul Rhyu

Abhishek Sehgal

Ankur Saxena

Kyungmo Park

Nishith D Tripathi

Sungoh Hwang

Tuan Ho

Xin Li

Anshuman Tewari

Young-Kwon Lim

Sung-Oh Hwang

An encoding device, a decoding device, and a method for mesh decoding are disclosed. The method for mesh decoding includes receiving a bitstream. The method also includes decoding a frame that includes pixels from the bitstream. A portion of the pixels of the frame represent geometric locations of vertices of a 3D mesh that are organized into overlapped patches. The method further includes decoding connectivity information from the bitstream. Additionally, the method includes identifying triangles associated with the overlapped patches. The triangles represented in an overlapped patch of the overlapped patches are allocated to a projection direction based on a normal vector associated with each of the triangles of the overlapped patch. The method also includes reconstructing the 3D mesh based on the connectivity information and the overlapped patches.

Overlapped patches for mesh coding for video based point cloud compression

An encoding device and a method for point cloud encoding are disclosed. The method includes segmenting an area including points representing a three-dimensional (3D) point cloud into multiple voxels. The method also includes generating a patch information for each of the multiple voxels that include at least one of the points of the 3D point cloud. The method further includes assigning the patch information of the multiple voxels to the points included in each respective voxel, to generate patches that represent the 3D point cloud. Additionally, the method includes generating frames that include pixels that represent the patches. The method also includes encoding the frames to generate a bitstream and transmitting the bitstream.

Complexity reduction of video-based point cloud compression encoding using grid-based segmentation

A method for generating content includes receiving information regarding electronic devices respectively capturing content associated with an event. The method also includes identifying, based on the received information, one or more parameters for the electronic devices to use in capturing the content, the one or more parameters identified to assist in generating multi-view content for the event from the captured content. The method further includes identifying, based on the received information, a common resolution for the electronic devices to use in capturing the content. Additionally, the method includes identifying, based on the received information, a common frame rate for the electronic devices to use in capturing the content. The method also includes sending information indicating the one or more parameters, the common resolution, and the common frame rate to the electronic devices.

Generation and distribution of immersive media content from streams captured via distributed mobile devices

An encoding device and a method for point cloud encoding are disclosed. The method for encoding includes segmenting an area including points representing a three-dimensional (3D) point cloud into multiple voxels. The method also includes identifying a normal score for each of the points of the 3D point cloud and a smoothing score for each of the multiple voxels that include at least one of the points of the 3D point cloud. The method further includes grouping each point of the 3D point cloud to one of multiple projection planes based on the normal score and the smoothing score to generate refined patches that represent the 3D point cloud. Additionally, the method includes generating frames that include pixels that represent the refined patches. The method also includes encoding the frames to generate a bitstream and transmitting the bitstream.

Fast projection method in video-based point cloud compression codecs

An decoding device, an encoding device and a method for point cloud encoding is disclosed. The method includes generating, from a three-dimensional point cloud, multiple two-dimensional frames, the two-dimensional frames including at least a first frame representing a geometry of points in the three-dimensional point cloud and a second frame representing texture of points in the three-dimensional point cloud. The method also includes generating an occupancy map indicating locations of pixels in the two-dimensional frames that represent points in the three-dimensional point cloud. The method further includes encoding the two-dimensional frames and the occupancy map to generate a compressed bitstream. The method also includes transmitting the compressed bitstream.

Point cloud and mesh compression using image/video codecs

An encoding device, a decoding device, and a method for mesh decoding are disclosed. The method for mesh decoding includes receiving a compressed bitstream. The method also includes separating, from the compressed bitstream, a first bitstream and a second bitstream. The method further includes decoding, from the second bitstream, connectivity information of a three dimensional (3D) mesh. The method additionally includes decoding, from the first bitstream, a first frame and a second frame that include patches. The patches included in the first frame represent vertex coordinates of the 3D mesh and the patches included in the second frame represent a vertex attribute of the 3D mesh. The method also includes reconstructing a point cloud based on the first and second frames. Additionally, the method also includes applying the connectivity information to the point cloud to reconstruct the 3D mesh.

Mesh compression

An encoding device and a method for point cloud encoding are disclosed. The method includes generating, for a 3D point cloud, an attribute frame and an occupancy map. The method also includes reducing a resolution of the frames over a number of sequential steps, until the frames are a predetermined size. After the frames are reduced to the predetermined size, the method includes increasing the resolution of the frames over the number of sequential steps while adding padding to modify at least some of the pixels in the attribute frame that do not represent points of the 3D point cloud. While the resolution of the attribute frame is incrementally increased, the method includes performing smoothing on the pixels in the attribute frame that do not represent the points of the 3D point cloud. The method additionally includes encoding the frames to generate a bitstream and then transmitting the bitstream.

Image padding in video-based point-cloud compression CODEC

An encoding device and methods for point cloud encoding are disclosed. The method for encoding includes generating, using a processor of an encoder, a first frame and a second frame that include patches representing a cluster of points of three-dimensional (3D) point cloud; identifying a patch to segment in the patches of the first frame and the second frame; determining, in response to identifying the patch, a path representing a boundary between segmented regions within the patch; segmenting the patch along the path into two patches for the first frame and the second frame; encoding the first frame and the second frame to generate a compressed bitstream; and transmitting, using a communication interface operably coupled to the processor, the compressed bitstream.

Patch splitting for improving video-based point cloud compression performance

A decoding device, an encoding device and a method for point cloud decoding is disclosed. The method includes receiving a compressed bitstream. The method also includes decoding the compressed bitstream into 2-D frames that represent a 3-D point cloud. Each of the 2-D frames including a set of patches, and each patch includes a cluster of points of the 3-D point cloud. The cluster of points corresponds to an attribute associated with the 3-D point cloud. One patch of the set of patches, the set of patches, and the 2-D frames correspond to respective access levels representing the 3-D point cloud. The method also includes identifying a first and a second flag. In response to identifying the first and the second flag, the method includes reading the metadata from the bitstream. The method further includes generating, based on metadata and using the sets of 2-D frames, the 3-D point cloud.

Point cloud compression using non-orthogonal projection

A decoding device, an encoding device and a method for point cloud decoding is disclosed. The method includes decoding the compressed bitstream into a first set and second set of 2-D frames. The first set of 2-D frames include first set of regular patches representing geometry of a 3-D point cloud and the second set of 2-D frames include first set of regular patches representing texture of the 3-D point cloud. The method includes identifying in the first set of 2-D frames, a missed points patch representing geometry of points of the 3-D point cloud not included in the regular patches, and in the second set of 2-D frames a missed points patch that represents texture of the points of the 3-D point cloud not included in the regular patches. The method also includes generating, using the set of 2-D frames, the 3-D point cloud using the missed points patches.

Point cloud compression using hybrid transforms

A user equipment includes a modem receives a compressed bitstream and metadata. The UE also includes a decoder that decodes the compressed bitstream to generate an HDR image, an inertial measurement unit that determines viewpoint information based on an orientation of the UE, and a graphics processing unit (GPU). The GPU maps the HDR image onto a surface and renders a portion of the HDR image based on the metadata and the viewpoint information. A display displays the portion of the HDR image.

Method and apparatus for creating, streaming, and rendering HDR images

A method includes identifying an optimal backlight value for at least one quality level of a first video segment. The method also includes transmitting data for the first video segment. The transmitted data for the first video segment includes a message containing a first set of display adaptation information. The first set of display adaptation information includes the optimal backlight value for the at least one quality level of the first video segment. The method further includes identifying a backlight value for the at least one quality level of a second video segment. The method also includes determining a maximum backlight value change threshold between successive video segments. In addition, the method includes applying temporal smoothing between the optimal backlight value and the backlight value based on the maximum backlight value change threshold.

Display power reduction using histogram metadata

A method for real-time multi-frame super resolution (SR) of video content is provided. The method includes receiving a bitstream including an encoded video, motion metadata for a plurality of blocks of a frame of video content, and parameters. The motion metadata is estimated from the original video before downsampling and encoding. The motion metadata is averaged over consecutive blocks. The method includes upscaling the motion metadata for the plurality of blocks. The method also includes upscaling the decoded video using the upscaled motion metadata. The method also includes deblurring and denoising the upscaled video.

Growing community of inventors

Richardson, TX, United States of America

Esmaeil Faramarzi