Mediatek Corporation

Chao-Chih Huang

Shen-Kai Chang

Jian-Liang Lin

Hung-Chih Lin

Chia-Ying Li

Chi-Cheng Ju

Hui Ou Yang

Han-Liang Chou

Ting-An Lin

Hui Ouyang

Methods and apparatus of processing cube face images are disclosed. According to embodiments of the present invention, one or more discontinuous boundaries within each assembled cubic frame are determined and used for selective filtering, where the filtering process is skipped at said one or more discontinuous boundaries within each assembled cubic frame when the filtering process is enabled. Furthermore, the filtering process is applied to one or more continuous areas in each assembled cubic frame.

Method and apparatus for selective filtering of cubic-face frames

A video processing method includes receiving a bitstream, and decoding, by a video decoder, the bitstream to generate a decoded frame. The decoded frame is a projection-based frame that has a 360-degree image/video content represented by triangular projection faces packed in a triangle-based projection layout. An omnidirectional image/video content of a viewing sphere is mapped onto the triangular projection faces via a triangle-based projection of the viewing sphere. An equator of the viewing sphere is not mapped along any side of each of the triangular projection faces.

Method and apparatus for decoding projection based frame with 360-degree content represented by triangular projection faces packed in triangle-based projection layout

A projection-based frame is generated according to an omnidirectional video frame and a triangle-based projection layout. The projection-based frame has a 360-degree image content represented by triangular projection faces assembled in the triangle-based projection layout. A 360-degree image content of a viewing sphere is mapped onto the triangular projection faces via a triangle-based projection of the viewing sphere. One side of a first triangular projection face has contact with one side of a second triangular projection face, one side of a third triangular projection face has contact with another side of the second triangular projection face. One image content continuity boundary exists between one side of the first triangular projection face and one side of the second triangular projection face, and another image content continuity boundary exists between one side of the third triangular projection face and another side of the second triangular projection face.

Method and apparatus for generating projection-based frame with 360-degree image content represented by triangular projection faces assembled in triangle-based projection layout

A video processing method includes receiving a bitstream, and decoding, by a video decoder, the bitstream to generate a decoded frame. The decoded frame is a projection-based frame that has a 360-degree image/video content represented by triangular projection faces packed in an octahedron projection layout. An omnidirectional image/video content of a viewing sphere is mapped onto the triangular projection faces via an octahedron projection of the viewing sphere. An equator of the viewing sphere is not mapped along any side of each of the triangular projection faces.

Method and apparatus for decoding projection-based frame with 360-degree content represented by triangular projection faces packed in octahedron projection layout

A projection-based frame is generated according to an omnidirectional video frame and an octahedron projection layout. The projection-based frame has a 360-degree image content represented by triangular projection faces assembled in the octahedron projection layout. A 360-degree image content of a viewing sphere is mapped onto the triangular projection faces via an octahedron projection of the viewing sphere. One side of a first triangular projection face has contact with one side of a second triangular projection face, one side of a third triangular projection face has contact with another side of the second triangular projection face. One image content continuity boundary exists between one side of the first triangular projection face and one side of the second triangular projection face, and another image content continuity boundary exists between one side of the third triangular projection face and another side of the second triangular projection face.

Method and apparatus for generating projection-based frame with 360-degree image content represented by triangular projection faces assembled in octahedron projection layout

A video processing method includes receiving a bitstream, processing the bitstream to obtain at least one syntax element from the bitstream, and decoding the bitstream to generate a current decoded frame having a rotated 360-degree image/video content represented in a 360-degree Virtual Reality (360 VR) projection format. The at least one syntax element signaled via the bitstream indicates rotation information of content-oriented rotation that is involved in generating the rotated 360-degree image/video content, and includes a first syntax element. When the content-oriented rotation is enabled, the first syntax element indicates a rotation degree along a specific rotation axis.

Method and apparatus having video decoding function with syntax element parsing for obtaining rotation information of content-oriented rotation applied to 360-degree image content or 360-degree video content represented in projection format

A video processing method includes: receiving a current input frame having a 360-degree image/video content represented in a 360-degree Virtual Reality (360 VR) projection format, applying content-oriented rotation to the 360-degree image/video content in the current input frame to generate a content-rotated frame having a rotated 360-degree image/video content represented in the 360 VR projection format, encoding the content-rotated frame to generate a bitstream, and signaling at least one syntax element via the bitstream, wherein the at least one syntax element is set to indicate rotation information of the content-oriented rotation.

Method and apparatus having video encoding function with syntax element signaling of rotation information of content-oriented rotation applied to 360-degree image content or 360-degree video content represented in projection format and associated method and apparatus having video decoding function

A video processing method includes: receiving an omnidirectional image/video content corresponding to a viewing sphere, generating a sequence of projection-based frames according to the omnidirectional image/video content and an octahedron projection layout, and encoding, by a video encoder, the sequence of projection-based frames to generate a bitstream. Each projection-based frame has a 360-degree image/video content represented by triangular projection faces packed in the octahedron projection layout. The omnidirectional image/video content of the viewing sphere is mapped onto the triangular projection faces via an octahedron projection of the viewing sphere. An equator of the viewing sphere is not mapped along any side of each of the triangular projection faces.

Method and apparatus for generating and encoding projection-based frame with 360-degree content represented by triangular projection faces packed in octahedron projection layout

A method and apparatus of video encoding or decoding for a video encoding or decoding system applied to multi-face sequences corresponding to a 360-degree virtual reality sequence are disclosed. According the present invention, one or more multi-face sequences representing the 360-degree virtual reality sequence are derived. If Inter prediction is selected for a current block in a current face, one virtual reference frame is derived for each face of said one or more multi-face sequences by assigning one target reference face to a center of said one virtual reference frame and connecting neighboring faces of said one target reference face to said one target reference face at boundaries of said one target reference face. Then, the current block in the current face is encoded or decoded using a current virtual reference frame derived for the current face to derive an Inter predictor for the current block.

Method and apparatus of inter coding for VR video using virtual reference frames

A method and system for encoding a group of coding blocks and packetizing the compressed data into slices/packets with hard-limited packet size are disclosed. According to the present invention, a packetization map for at least a portion of a current picture is determined. The packetization map associates coding blocks in at least a portion of the current picture with one or more packets by identifying a corresponding group of coding blocks for each packet of said one or more packets. The corresponding group of coding blocks for each packet is then encoded according to the packetization map and the size of each packet is determined. The packet size is checked. If any packet size exceeds a constrained size, a new packetization map is generated and the corresponding group of coding blocks for each packet is encoded according to the new packetization map.

Method of hard-limited packet size for video encoding

A method for encoding a frame divided into a plurality of tiles includes: storing encoding-related information derived from blocks in a last block row of a first tile of the frame into a storage device; reading the encoding-related information from the storage device; and performing entropy encoding upon blocks in a first block row of a second tile of the frame based at least partly on the encoding-related information read from the storage device. The first block row of the second tile is vertically adjacent to the last block row of the first tile. The entropy encoding of the first block row of the second tile is started before entropy encoding of the last block row of the first tile is accomplished.

Method and apparatus for packing tile in frame through loading encoding-related information of another tile above the tile from storage device

A hybrid video encoding method and system using a software engine and a hardware engine. The software engine receives coding unit data associated with a current picture, and performs a first part of the video encoding operation by executing instructions. The first part of the video encoding operation generates an inter predictor and control information corresponding to the coding unit data of the current picture. The first part of the video encoding operation stores the inter predictor into an off-chip memory. The hardware engine performs a second part of the video encoding operation according to the control information. The second part of the video encoding operation receives the inter predictor, and subtracts the inter predictor from the coding unit data to generate a residual signal. The second part of the video encoding operation then transforms and quantizes the residual signal to generate transformed and quantized residual signal, and encodes the transformed and quantized residual signal to generate an encoded video bitstream.

Method and apparatus using software engine and hardware engine collaborated with each other to achieve hybrid video encoding

A method for performing image processing control and an associated apparatus are provided, where method may include the steps of: performing image coding on image information of at least one frame to generate encoded data of the at least one frame, wherein in the encoded data, a specific frame of the at least one frame includes a plurality of tiles, and each tile of the plurality of tiles includes a plurality of superblocks; and generating a bitstream carrying the encoded data of the at least one frame, wherein at least a partition type and a transform size of each superblock within a specific tile of the plurality of tiles are derivable from information corresponding to the specific tile within the encoded data, having no need to derive the partition type and the transform size from information corresponding to another tile of the plurality of tiles within the encoded data.

Method for performing image processing control with aid of predetermined tile packing, associated apparatus and associated non-transitory computer readable medium

Growing community of inventors

Hsinchu County, Taiwan

Chao-Chih Huang