Mediatek Singapore Pte. Ltd.

Mediatek Corporation

Hfi Innovation Inc.

Other

Future Wei Technologies, Inc.

Lulin Chen

Xin Ru Wang

Shan Liu

Chih-Wei Hsu

Ching-Yeh Chen

Wang Lin Lai

Tzu-Der Chuang

Yu-Wen Huang

Shih-Ta Hsiang

Shuai Zhao

Chen-Yen Lai

Olena Chubach

Chun-Chia Chen

Wang-Lin Lai

Yu-Ling Hsiao

Xin Wang

Hsi-Hsin Lee

Meng Liu

Xudong Song

Methods and apparatus for video coding using Adaptive Loop Filter (ALF) processing are disclosed. According to one method, the ALF virtual boundary processing is always applied to the bottom CTU row regardless whether the bottom CTU row is for a picture or a sub-picture. In another method, the ALF padding process is unified for different boundary types belonging to the target boundary belongs to a boundary-type group comprising two or more of slice boundary, tile boundary, VR360 face boundary, and sub-picture boundary. In yet another method, the ALF VB processing has a fixed priority for a corner region that both horizontal and vertical virtual boundaries can be applied.

Method and apparatus for adaptive loop filtering at picture and sub-picture boundary in video coding

A multimedia device is configured to process video data via a related method. The multimedia device includes a processor in communication with a panel. The processor is configured to output the video data to the panel when being switched into a video unmute mode, and further to not output the video data to the panel when being switched into a first video mute mode. The processor is further configured to execute media retrieval and visual processing in response to the first video mute mode.

Multimedia device and related method for a video mute mode

A method for specifying layout of subpictures in video pictures is provided. A video decoder receives data from a bitstream to be decoded as a current picture of a video. For a current subpicture of a set of subpictures of the current picture, the video decoder determines a position of the current subpicture based on a width and a height of the current picture and a previously determined width and height of a particular subpicture in the set of subpictures. The video decoder reconstructs the current picture and the current subpicture based on the determined position.

Specifying layout in video pictures

The techniques described herein relate to methods, apparatus, and computer readable media configured to generate media data for an immersive media experience. A set of parameters for processing a scene description for an immersive media experience are accessed. Multimedia data for the immersive media experience is accessed, including a plurality of media tracks, each media track comprising an associated series of samples of media data for a different component of the immersive media experience, and a derived track comprising a set of derivation operations to perform to generate a series of samples of media data for the client for the immersive media experience. A derivation operation is performed to generate a portion of media data for a derived media track, including processing the plurality of media tracks to generate a first series of samples of the media data for the immersive media experience, and outputting the derived media track.

Methods and systems for implementing scene descriptions using derived visual tracks

Method and apparatus for signaling or parsing constrained active entries in reference picture lists for multi-layer coding are disclosed. For the decoder side, when the current picture is a RADL (Random Access Decodable Leading) picture, reference picture list 0 or reference picture list 1 of the current picture is mandatorily required to contain no active entry corresponding to a RASL (Random Access Skipped Leading) picture with pps_mixed_nalu_types_in_pic_flag equal to 0 or a picture that precedes an associated IRAP (Intra Random Access Point) picture in decoding order, and wherein an active entry in the reference picture list 0 or the reference picture list 1 of the RADL picture can refer to a RASL picture with the pps_mixed_nalu_types_in_pic_flag equal to 1 and a referenced RASL picture either belongs to the same layer or a different layer than a layer containing the current picture which is the RADL picture.

Method and apparatus for video coding with constraints on reference picture lists of a RADL picture

The techniques described herein relate to methods, apparatus, and computer readable media configured to encode and/or decode video data. Immersive media data includes a set of one or more tracks, each track comprising associated immersive media data corresponding to an associated spatial portion of immersive media content and metadata specifying a six degree of freedom (6DoF) viewing region in the immersive media content, wherein the metadata comprises viewing region type data indicating a type of the viewing region. An encoding and/or decoding operation is performed based on the set of one or more tracks and the viewing region metadata to generate encoded and/or decoded immersive media data. The viewing region type data can be specified by a data structure attribute of the metadata specifying a viewing region and/or by an attribute of the metadata specifying a viewing region.

Methods and apparatus for signaling viewing regions of various types in immersive media

A method for specifying layout of subpictures is provided. A video decoder receives data from a bitstream to be decoded as a current picture of a video. The video decoder parses the bitstream for positions and sizes of multiple subpictures of the current picture. A position of a first subpicture and a size of a last subpicture are skipped during the parsing. The video decoder reconstructs the current picture and the subpictures of the current picture according to the positions and the sizes of the subpictures.

Specifying video picture information

A method for performing transform skip mode (TSM) in a video decoder is provided. A video decoder receives data from a bitstream to be decoded as a plurality of video pictures. The video decoder parses the bitstream for a first syntax element in a sequence parameter set (SPS) of a current sequence of video pictures. When the first syntax element indicates that transform skip mode is allowed for the current sequence of video pictures and when transform skip mode is used for a current block in a current picture of the current sequence, the video decoder reconstructs the current block by using quantized residual signals that are not transformed.

Signaling coding of transform-skipped blocks

The techniques described herein relate to methods, apparatus, and computer readable media configured to accessing multimedia data that includes a plurality of media tracks that each include an associated series of samples of media data, and a derived track comprising a set of derivation operations to perform to generate a series of samples of media data for the derived track. A derivation operation of the set is performed to generate a portion of media data for the derived track, which includes: determining, based on the derivation operation, a group of media tracks from the plurality by determining each media track in the group meets a grouping criteria, selecting one media track from the group of media tracks, and adding a sample from the one media track to the derived track to generate the portion of the derived track.

Methods and apparatus for selecting and switching input video tracks using track derivations

The techniques described herein relate to methods, apparatus, and computer readable media configured to access media data for a first three-dimensional (3D) immersive media experience including media tracks each including an associated series of samples of media data for a different component of the first 3D immersive media experience and derived immersive tracks, each comprising a set of derivation operations to perform to generate an associated series of samples of media data for a different component of a second 3D immersive media experience and perform, for each of the one or more derived immersive tracks, a derivation operation of the set of derivation operations by processing associated samples of the one or more media tracks as specified by the derivation operation to generate the associated series of samples of media data of the second 3D immersive media experience.

Methods and systems for derived immersive tracks

The techniques described herein relate to methods, apparatus, and computer readable media configured to access multimedia data comprising a hierarchical track structure comprising at least a first track at a first level of the hierarchical track structure comprising first media data, wherein the first media data comprises a first sequence of video media units, and a second track at a second level in the hierarchical track structure different than the first level of the first track, the second track comprising metadata specifying a re-timing derivation operation. Output video media units are generated according to the second track, comprising performing the re-timing derivation operation on the first sequence of video media units to modify a timing of the first sequence of video media units by removing one or more video media units associated with the re-timing derivation operation and/or shifting timing information of the first sequence of video media units.

Methods and apparatus for re-timing and scaling input video tracks

A method and system of multimedia streaming services using DASH (Dynamic Adaptive Streaming over HTTP) are disclosed. According to this method, one or more Push Directives are sent from a client to a server to indicate information related to media data requested. Each Push Directive comprises a Push type including Push-rate and Push-rate Directive includes information associated with a push data rate related to the media data requested. If the Push-rate Directive is received by the server, one or more groups of data for the media data requested are pushed from the server to the client according to the push data rate. According to another method, fragmented MPDS are used, where at least one fragmented MPD omits a MPD header, MPD payload, Period header or Period payload. In yet another method, a status message group includes SharedResourceAllocation message that comprises parameters including bandwidth and pacingRate.

Method and system for streaming applications using rate pacing and MPD fragmenting

The techniques described herein relate to methods, apparatus, and computer readable media configured to perform media processing tasks. A media processing entity includes a processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the processor, cause the processor to perform receiving, from a remote computing device, multi-view multimedia data comprising a hierarchical track structure comprising at least a first track comprising first media data at a first level of the hierarchical track structure, and a second track comprising task instruction data at a second level in the hierarchical track structure that is different than the first level of the first track. The instructions further cause the processor to perform processing the first media data of the first track based on the task instruction data of the second track to generate modified media data and an output track that includes the modified media data.

Methods and apparatus for using track derivations to generate new tracks for network based media processing applications

Methods and apparatus for video coding are disclosed. According to one method, a bitstream is generated or received, where the bitstream includes a first syntax and a second syntax. The first syntax is related to a target number of bits used to represent a set of third syntaxes and each third syntax specifies one subpicture ID for one subpicture in a set of subpictures. The second syntax is related to a total number of subpictures in the set of subpicture, where a first number that can be represented by the target number of bits is equal to or greater than the total number of subpictures. According to another method, the subpicture ID syntaxes have different values for different subpictures.

Method and apparatus of signaling subpicture information in video coding

The techniques described herein relate to methods, apparatus, and computer readable media configured to perform media processing. A media processing entity includes at least one processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the at least one processor, cause the at least one processor to perform receiving, from a remote computing device, multi-view multimedia data comprising a hierarchical track structure comprising at least a first track comprising first media data at a first level of the hierarchical track structure, and metadata associated with a second track at a second level in the hierarchical track structure that is different than the first level of the first track. The instructions further cause the processor to perform processing the first media data of the first track based on the metadata associated with the second track to generate second media data for the second track.

Growing community of inventors

San Jose, CA, United States of America

Lulin Chen