Apple Inc.

Ovics

Geo Semiconductor Inc.

Mobilygen Corporation

Maxim Integrated Products, Inc.

Other

Quintessence Architectures, Inc.

Sorin Constantin Cismas

Jim Chen Chou

Ilie Garbacea

Ganesh G Yadav

Moinul H Khan

Hao Pan

Kristan Jon Monsen

Alexandros Michael Tourapis

Guy Cote

David William Singer

Keangpo Ricky Ho

Eran Sudak

Simon Wolfenden Butler

Krishnakanth Rapaka

Ran Katz

Ling Su

Jiandong Shen

Munehiro Nakazato

Yaxiong Zhou

Liviu R Morogan

Hsi-Jung Wu

Yeping Su

Athanasios Leontaris

Dazhong Zhang

Ali Sazegari

Haitao Guo

Steven E Saunders

Aleksandr M Movshovich

Arthur Yasheng Zhang

Krasimir D Kolarov

Mark P Rygh

Paul V Johnson

Sreeraman Anantharaman

Xiaohua Yang

Yung-Chin Chen

Holly Gerhard

Assaf Menachem

Jian Zhou

Ido Y Soffair

William W Sprague

Felix C Fernandes

Syed Muhammad A Rizvi

Jeffrey J Irwin

Abheek Banerjee

Uri Nix

Christian Thomas Martelock

Henry K So

The present disclosure relates to systems and methods of multi-pipe scheduling for image decoding. For example, a bitstream may include compressed slices that are scheduled to each of the multiple decoding pipelines present in the image processing circuitry of an electronic device. The bitstream may include image data that was encoded using variable-length coding. This results in some bits of the image data containing denser and/or sparser syntax elements and result in variable processing times. The scheduling circuitry may be able to monitor each of the multiple decoder pipelines rate of bit consumption and the number of bits initially scheduled to each of the multiple pipelines and the number of bits consumed by each of the multiple pipelines over time so that incoming compressed slices may be scheduled to the pipe that will be able to process the compressed slice the fastest.

Systems and methods for multi-pipe scheduling during image decoding

This disclosure is directed to systems and methods of rate control in multiple pass video encoding. The video encoder may complete multiple encoding passes for slices of an image. Rate control algorithms may be implemented that scale the quantization step size and quantization matrix values depending on the determined size of the image slices. This may enable the size of slices to be adjusted based on size parameters for the image data.

Systems and methods of rate control for multiple pass video encoding

Compression techniques are described. In an embodiment, a first plane of sensor data is accessed, the first plane of sensor data is divided into a plurality of slices, each sample is encoded in each slice from the plurality of slices, where encoding a sample include computing a median based prediction for the sample, computing an error for the sample comprising a difference between the sample and the computed median based prediction, determining a context for the sample, selecting a model for the sample by using the determined context, and encoding the computed error by using the selected model.

Lossless compression techniques

A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.

Priority-based video encoding and transmission

An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

Electronic device content provisioning adjustments based on wireless communication channel bandwidth condition

A device may include a display for displaying an image frame based on warped image data and image processing circuitry to generate the warped image data by warping input image data to account for one or more distortions associated with displaying the image. The image processing circuitry may include a two-stage cache architecture having an first cache and an second cache and warp the input image data by generating mapping data indicative of a warp between the input image space and the output image space and fetching the input image data to populate the first cache. Warping may also include populating the second cache with a grouping of pixel values from the first cache that are selected according to a sliding window that traverses the first cache based on the mapping data and interpolating between pixel values of the grouping to generate pixel values of the warped image data.

Cache architecture for image warp processing systems and methods

The present disclosure relates to systems and methods of multi-processing core processing of image frames during image encoding. The multiple processing cores may be connected via dedicated interfaces and transfer neighbor data between the processing cores to enable parallel processing of frame data. The multiple processing cores may each process quad-rows of image data for a single frame in parallel to reduce memory usage and mitigate latency in video encoding.

Systems and methods for multi-core image encoding

A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder. The encoded frequency data is packetized and transmitted to a receiving device. On the receiving device, the encoded data is decoded to recover the frequency bands. Wavelet synthesis is then performed on the frequency bands to reconstruct the pixel data for display. The system may encode parts of frames (tiles or slices) using one or more encoders and transmit the encoded parts as they are ready. A pre-filter component may perform a lens warp on the pixel data prior to the wavelet transform.

Video encoding system

This disclosure is directed to systems and methods of data partitioning in image encoding. A video encoder may receive a single stream of video data that includes multiple layers. The video encoder may encode the one or more layers utilizing multiple counters for each component within the layers. The multiple counters may correspond to the header bits, luma bits, and chroma bits within each slice layer. The encoded layers may then be assembled into a single slice before it is sent to a decoder for decoding of image frame.

Systems and methods for data partitioning in video encoding

This disclosure is directed to systems and methods of streaming extensions for video encoding. The streaming extensions may enable the bitstream syntax for layered video data to be modified to reduce overhead for encoding. The bitstream syntax may be modified to enable variable length luma and chroma components, and enable the alignment between the layers and slice to be bit aligned to enable increased granularity in image encoding, and to minimize overhead between different elements within the layers.

Systems and methods for streaming extensions for video encoding

In one implementation, a method of encoding an image is performed at a device including one or more processors and non-transitory memory. The method includes determining a category of a spatial portion of an image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters. The method includes quantizing the spatial portion of the image based on the categorization.

Video encoder with quantization control

Systems and methods of parallel image parsing and processing for video decoding are provided. Video decoder circuitry may enable an incoming encoded bitstream to be split into multiple bitstreams corresponding to the bitstream compression scheme and processed by multiple parsers corresponding to the bitstream compression scheme in parallel. This enables parallel decoding of the incoming bitstream and, thus, more efficient decoder processing.

Parallel video parsing for video decoder processing

A source electronic device may include first interface circuitry that transmits a data packet over a wireless link to a sink electronic device to present the data packet as part of a video stream. The source electronic device may also include encoder circuitry that encodes the data packet for transmission through the wireless link and a feedback path communicatively coupling the encoder circuitry directly to the first interface circuitry. The feedback path may transmit one or more feedback signals from the first interface circuitry to the encoder circuitry, bypassing a network layer, an encoder driver, or both. The encoder circuitry, the first interface circuitry, or both may adjust one or more transmission parameters associated with transmitting the data packet over the wireless link, based on the one or more feedback signals.

Systems and methods for reducing latency of a video transmission system

Growing community of inventors

Saratoga, CA, United States of America

Sorin Constantin Cismas