Apple Inc.

Lg Electronics Inc.

Other

James Normile

James O Normile

Stephen Olivier Lemay

Hsi-Jung Wu

Xiaosong Zhou

Hyeonkuk Jeong

Joe S Abuan

Chris Yoochang Chung

Yan Yang

Thomas Christopher Jansen

Barin Geoffry Haskell

Ke-Chiang C Chu

Xiaojin Shi

Adriana Dumitras

Ryan R Salsbury

Katherine Shu-Wei Wang

Roberto Garcia, Jr

Douglas Scott Price

Gobind Johar

Ionut Hristodorescu

Yeping Su

Sundararaman V Shiva

Atul Puri

Elizabeth Caroline Cranfill

Wen Zhao

Dulce Beatriz Ponceleon

Hao Pan

Thomas Pun

Xiaochun Nie

Srinivasan Vasudevan

Luciano Miguel Verger

Chia L Yeh

Gang Lu

Daniel W Wright

David A Eldred

David William Singer

Roberto Garcia

Dazhong Zhang

Nirav Rajendra Patel

Ke Zhang

Gianluca Filippini

Hassan A Shojania

Ting Chen

Jiefu Zhai

Haitao Guo

Berkat S Tung

David Daming Kuo

Xin Tong

Andrew Yanowitz

Albert E Keinath

Christian L Duvivier

Yuxin Liu

Shujie Liu

Jochen Christian Schmidt

Thomas Jansen

David D Kuo

Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.

Instant video communication connections

A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.

Codec techniquest for fast switching without a synchronization frame

In a video coding system, an encoder may include a coding engine to predictively code input video, a decoder to reconstruct reference pictures generated by the coding engine, a reference picture cache to store the reconstructed reference pictures, a patch cache to store prediction patches generated from other sources, and a prediction search unit to search among the reference picture cache and the patch cache to generate prediction references for use by the coding engine while coding input video. The prediction patches may be assembled from a variety of sources including: predefined image content, reference pictures being evicted from the reference picture cache, image content of prior coding sessions and image data stored by applications on a common terminal where the encoder resides. A decoder may store prediction patches in its own patch cache for synchronous decoding.

Pixel patch collection for prediction in video coding system

Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

Video analysis techniques for improved editing, navigation, and summarization

Scalable video coding and multiplexing compatible with non-scalable decoders is disclosed. In some embodiments, video data is received and encoded in a manner that renders at least a base layer to be compatible with a non-scalable video encoding standard, including by assigning for at least the base layer default values to one or more scalability parameters. In some embodiments, video data is received and encoded to produce an encoded video data that includes a base layer that conforms to a non-scalable video encoding standard and one or more subordinate non-scalable layers, which subordinate non-scalable layers do not by themselves conform to the non-scalable video encoding standard but which can he combined with the base layer to produce a result that does conform to the non-scalable video encoding standard, such that the result can be decoded by a non-scalable decoder. An identification data identifying those portions of the encoded video data that are associated with a subordinate non-scalable layer is included in the encoded video data.

Scalable video coding/multiplexing compatible with non-scalable decoders

Systems and methods are presented for minimizing the suddenness and immediacy of changes to the video quality perceived by users due to bandwidth fluctuations and transitions between different bitrate streams. A method may include identifying an upcoming bitrate change in a bitstream and a nearest scene cut boundary from sync frame scene cut tags included in the bitstream. The method may include calculating whether waiting until the identified nearest scene cut boundary before changing the bitrate will cause the buffer to drop below a threshold. When the buffer is calculated to not drop below the threshold, the method may postpone the upcoming bitrate change until the identified nearest scene cut boundary.

Adaptive streaming techniques

Codec techniques for fast switching with intermediate sequence

Techniques for coding video data estimate depths of different elements within video content and identify regions within the video content based on the estimated depths. One of the regions may be assigned as an area of interest. Thereafter, video content of a region that is not an area of interest may be masked out and the resultant video content obtained from the masking may be coded. The coded video content may be transmitted to a channel. These techniques permit a coding terminal to mask out captured video content prior to coding in order to support coding policies that account for privacy interests or video composition features during a video coding session.

Video coding with composition and quality adaptation based on depth derivations

In video conferencing over a radio network, the radio equipment is a major power consumer especially in cellular networks such as LTE. In order to reduce the radio power consumption in video conferencing, it is important to introduce an enough radio inactive time. Several types of data buffering and bundling can be employed within a reasonable range of latency that doesn't significantly disrupt the real-time nature of video conferencing. In addition, the data transmission can be synchronized to the data reception in a controlled manner, which can result in an even longer radio inactive time and thus take advantage of radio power saving modes such as LTE C-DRX.

Radio power saving techniques for video conference applications

An apparatus and method for detecting and analyzing spikes in network jitter and the estimation of a jitter buffer target size is disclosed. Detected spikes may be classified as jump spikes or slope spikes, and a clipped size of detected spikes may be used in the estimation of the jitter buffer target. Network characteristics and conditions may also be used in the estimation of the jitter buffer target size. Samples may be modified during playback adaptation to improve audio quality and maintain low delay of a receive chain.

Adaptive jitter buffer management for networks with varying conditions

A method and system are provided for decoding coded video data by turning off or not loading at least one functional unit or functional subunit of the decoder while decoding a portion of the coded video data. A schedule may be created prior to substantive decoding and then the schedule may be used to decode coded video data. The coded video data may be reordered based on the functional units or subunits the portions of the coded video data need for decoding. The portions of the coded video data are reordered into their original order in an output buffer after being decoded. The decoder may determine which functional units or subunits are needed for decoding based on administration information included with the coded video data. The decoder may decode portions of the coded video data in parallel.

Power saving decoder architecture

Computing devices may implement dynamic display of video communication data. Video communication data for a video communication may be received at a computing device where another application is currently displaying image data on an electronic display. A display location may be determined for the video communication data according to display attributes that are configured by the other application at runtime. Once determined, the video communication data may then be displayed in the determined location. In some embodiments, the video communication data may be integrated with other data displayed on the electronic display for the other application.

Dynamic display of video communication data

Video coding systems and methods protect against banding artifacts in decoded image content. According to the method, a video coder may identify, from content of pixel blocks of a frame of video data, which pixel blocks are likely to exhibit banding artifacts from the video coding/decoding processes. The video coder may assemble regions of the frame that are likely to exhibit banding artifacts based on the identified pixel blocks' locations with respect to each other. The video coder may apply anti-banding processing to pixel blocks within one or more of the identified regions and, thereafter, may code the processed frame by a compression operation.

Signal shaping techniques for video data that is susceptible to banding artifacts

Growing community of inventors

Sunnyvale, CA, United States of America

James O Normile