Apple Inc.

Ati International Srl

Other

Nvidia Corporation

Xiaohua Yang

Hsi-Jung Wu

Dazhong Zhang

Haitao Guo

Alexandros Michael Tourapis

Xiaosong Zhou

Hao Pan

Hang Yuan

Linfeng Guo

Jiefu Zhai

Jae Hoon Kim

Ming Chen

Francesco Iacopino

Munehiro Nakazato

Xiang Fu

Krishnakanth Rapaka

Stefan Eckart

Richard W Webb

Michael L Lightstone

Haiyan He

Fabio Ingrao

Felix Chou

Yeping Su

Xin Ru Wang

David William Singer

Beibei Wang

Jim Chen Chou

Christopher M Garrido

Sorin Constantin Cismas

Xuemei Zhang

Yingjun Bai

Wei Li

Karthick Santhanam

Ming Jin

Ke Chen

Eric L Chien

Peikang Song

Albert E Keinath

Ying Jian He

Qiang Wang

Haixia Shi

Vikrant Kasarabada

David R Conrad

Gurtej Singh Chandok

Davide Concion

Ye Cong

Vaidyanath Mani

Xu Zhao

Bess C Chan

Mukta Gore

Ruiqi Hu

Gui Xie

Jin Wook Chang

Giribalan Gopalan

Krishna Rapaka

In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

Adaptive coding and streaming of multi-directional video

In one implementation, a method of generating a bit stream encoding a video stream is performed by a device including one or more processors and non-transitory memory. The method includes decomposing a video stream into a plurality of frequency band video streams. The method includes determining a target bitrate and determining, for each frequency band video stream, a respective frequency band bit rate based on the target bit rate. The method includes encoding each of the plurality of frequency band video streams at its respective frequency band bit rate and transmitting, over a channel, each encoded frequency band video stream.

Multi-band rate control

Techniques are disclosed for coding video data in which frames from a video source are partitioned into a plurality of tiles of common size, and the tiles are coded as a virtual video sequence according to motion-compensated prediction, each tile treated as having respective temporal location of the virtual video sequence. The coding scheme permits relative allocation of coding resources to tiles that are likely to have greater significance in a video coding session, which may lead to certain tiles that have low complexity or low motion content to be skipped during coding of the tiles for select source frames. Moreover, coding of the tiles may be ordered to achieve low coding latencies during a coding session.

Efficient coding of source video sequences partitioned into tiles

A device comprises memory, a display characterized by a display characteristic, and processors coupled to the memory. The processors execute instructions causing the processors to receive data indicative of the display characteristic, data indicative of ambient lighting, and data indicative of content characteristics for a content item; determine a tone mapping curve for the content item based on the data indicative of content characteristics; determine a first, so-called 'anchor' point along the tone mapping curve; modify a first portion of the tone mapping curve below the anchor point based on the data indicative of ambient lighting; modify a second portion of the tone mapping curve above the anchor point based on the data indicative of the display characteristic; perform tone mapping for the content item based on the modified toned mapping curve to obtain a tone mapped content item; and cause the display to display the tone mapped content item.

Ambient headroom adaptation

Techniques for encoding video with reduced frame-boundary artifacts are presented. The techniques include a video encoding method, where, when skip mode is selected as a motion prediction coding mode for a pixel block predicted from a reference block of a reference frame, estimating an amount of the reference block that extends beyond the edge of the reference frame. If the amount beyond the edge does not exceed a threshold, the prediction may be coded with skip mode. If the amount beyond the edge exceeds a threshold, the pixel block may be partitioned, and the partitioned blocks may be coded with motion prediction.

Frame boundary artifacts removal

Techniques are disclosed for coding image data adaptively at different levels of downscaling. Such techniques may involve partitioning input data into pixel blocks for coding and performing content analysis on the pixel blocks. The pixel blocks may be input to block coders that operate at different pixel block sizes, which may code the pixel blocks input to them at their respective sizes. Except when a block coder operates at the partitioning size, block coders that operate at different pixel block sizes may perform downscaling of the pixel blocks to match their size with the block coders' respective coding size. A block decoder may invert the coding operations performed by the block coders, decoding coded image data at respective pixel block sizes, then upscaling decoded image data obtained therefrom to a common pixel block size. Image reconstruction may synthesize a resultant image from the decode pixel block data output by the decoders. Quality enhancements may be added by neural network processing systems that have been trained to other segmented images.

Deep quality enhancement of adaptive downscaled coding for image compression

Methods are described for encoding and decoding blocks of image data using intra block copying (IBC). A source block for intra block copying is selected from a source region of a current image that is closer to the current block than a threshold, wherein the source region does not include a portion of the current image that is further from the current block than the threshold.

Techniques for resource conservation during performance of intra block copy prediction searches

Techniques are disclosed for developing quantization matrices for use in video coding. According to these techniques a first quantization matrix may be derived from a second quantization matrix by scaling quantization values of the second quantization matrix by scaling parameters. The scaling parameters may increase according to distance between each matrix position and a matrix origin, they may be derived from characteristics of a video sequence to be coded, or both. The first quantization matrix may be communicated to a decoder. Thereafter, a video sequence may be coded predictively. As part of the coding, pixel data of the video sequence may be transformed to a plurality of frequency domain coefficients, and the frequency domain coefficients may be quantized according to the first quantization matrix.

Techniques for calculation of quantization matrices in video coding

This disclosure relates to a wide gamut encoder capable of receiving a wide gamut color image in accordance with a wide gamut standard. The encoder can encode one or more wide gamut color image pixel values into portions of narrow gamut encoding elements for transmission to a video encoder. The encoder can implement an advanced extended YCC format that is backward compatible with a P3 color gamut.

Extended YCC format for backward-compatible P3 camera video

A system, method, and computer program product are provided for buffering an audio video (AV) stream, audio/video header information, and an audio/video elementary stream for hardware audio/video digital rights management (DRM) processing. In operation, an AV stream encrypted under a shared symmetric key in an M2TS format is buffered, where the AV stream includes content including at least one of audio or video and all content data associated with the AV stream is removed at picture level and below, with the exception of content headers associated with the content data. Additionally, content header information encrypted under the shared symmetric key is buffered, the content header information indicating locations of the content headers associated with the content data. Further, a content elementary stream encrypted under a hardware secret key is buffered for consumption of a hardware bit stream decoding engine.

System, method, and computer program product for buffering in association with audio/video digital rights management (DRM) processing

A method and apparatus for storing multimedia data for use in a digital VCR includes processing that begins by maintaining a first link list of a plurality of memory sections, where the first link list links the plurality of memory sections as a circular buffer. The processing then continues by receiving a stream of multimedia data. The processing then continues by storing the stream of multimedia data in at least some of the memory sections of the plurality of memory sections. The processing then continues by receiving a request for independent storage of a selected portion of the stream of multimedia data, e.g., the user desires to have a permanent copy of a particular program. The processing further continues by generating a second link list for a set of memory sections of the at least some of the memory sections. The set of memory sections stores the selected portion of the stream of multimedia data. The processing continues by updating the linking of the plurality of memory sections within the first link list without the set of memory section.

Method and apparatus for storing multi-media data

A method and apparatus for indexing and locating key frames in streaming frame data and variable-frame-length data is described. Fast and efficient location of desired key frames in both directions (e.g., forward/backward, future/past) is provided. An estimate of the distance to the desired key frame is made and a seek performed according to that distance. At the location specified by the seek, key frame seek assist data are obtained. The desired key frame is located or a new seek is performed, depending on the key frame seek assist data obtained. By placing the key frame seek assist data at readily identifiable locations, efficient location of key frames is provided. The key frame seek assist data may be tailored to optimize efficiency for seeking in a particular direction, for example, backwards. The seek process is correspondingly configured to favor seeking in the more efficient direction.

Method and apparatus for indexing and locating key frames in streaming and variable-frame-length data

Growing community of inventors

San Jose, CA, United States of America

Xiaohua Yang