Apple Inc.

Ming Jin

Christopher M Garrido

Joe S Abuan

David L Biderman

Yan Yang

Eric L Chien

Karthick Santhanam

Patrick Miauton

Hsien-Po Shiang

Gurtej Singh G Chandok

Hyeonkuk Jeong

Luciano Miguel Verger

Ian J Baird

Austin W Shyu

Daniel Ben Pollack

Ajoy K Singh

Dazhong Zhang

Najeeb M Abdulrahiman

Berkat S Tung

Srinivasan Vasudevan

Thomas P Devanneaux

Eric A Allamanche

Anil G Naik

Vu H Chiem

Gurtej Singh Chandok

Deepak Chitlur Lakshman

Xiaoxiao Zheng

Komei Harada

Wenhui Xu

Hsi-Jung Wu

Xiaosong Zhou

Padmavathy Bhooma

Hang Yuan

Peikang Song

Jose A Lozano Hinojosa

Christoph Paasch

Ryan W Baker

Erik Vladimir Ortega Gonzalez

Yu Xing

Mark M Xue

Jin Hyung Park

Sean P Devlin

Joshua L Hare

Brian Thomas Toombs

Bess C Chan

Gabriel Nava Marino

Vladimir Goupenko

David J Steele

Beibei Wang

Kevin P McLaughlin

Cahya Adiansyah Masputra

Anush G Nadathur

Jae Hoon Kim

Keith Walter Rauenbuehler

Roberto Garcia, Jr

Srinivas Rama

Yang Yu

Xiaohua Yang

Albert E Keinath

Bradley F Patterson

Jingyao Zhang

Sudeng Hu

Vikrant Kasarabada

David R Conrad

Vinay A Ramaswamy

Xing Wen

Barry A Whitebook

Davide Concion

Brajesh K Dave

Yichao Shen

Giribalan Gopalan

Ashwin Ramesh

Santosh Vamaraju

Erik Vladimir Ortega Gonzales

Suryaprakash Bangalore Rajeevalochana

Spencer E Lewson

Kartik P Sathappan

The embodiments described herein can dynamically adjust timing of network bandwidth estimations by adjusting a target frequency for sending probing sequences to one or more receivers of content. The receivers receive these probing sequences from a transmitter and respond to the transmitter with network bandwidth estimations. In one embodiment, the probing sequences can use the content itself to create the probing sequences. The embodiments can be used in video conferencing applications to control how a transmitter of content can adjust transmissions based upon the network bandwidth estimations. In one embodiment, a policy can be used at a transmitter to begin a video transmission with a high frequency target for sending probing sequences (with, e.g., smaller length probing sequences) and transition to a lower frequency target (with, e.g., longer length probing sequences) when network bandwidth deteriorates and then return to the higher frequency target when the network bandwidth improves.

High frequency probing for network bandwidth estimation using video data in real-time video conference

A method and apparatus of a device that manages a video telephony call is described. In an exemplary embodiment, the device receives a network event from a network service of a device. The device further determines that the network event that is due to a local disruption of a network component of the device. In addition, and in response to the determination, the device restricts a local dynamic control of the video telephony call.

Systems and methods of enhanced adaptability in real-time communications based on events and metrics from network interfaces

A method and apparatus of a device that uses a video jitter buffer to buffer the video frames for a received video stream is described. The device uses the video jitter buffer to estimate the delay variability of the frames and pick a target delay that will help harmonize the playback with minimal loss and delay. This is achieved by estimating the delay spread, which is the result of performing statistical analysis of the measured lags of the video frames received. The video jitter buffer provides target delay recommendation and reference frame information to the video player in order to anchor the playback and schedule the frames presentation time.

Systems and methods of video jitter estimation

Techniques are disclosed relating to multiway communications. In some embodiments, a first electronic device initiates a multiway call between a plurality of electronic devices and exchanges a first secret with a first set of electronic devices participating during a first portion of the multiway call, the first secret being used to encrypt traffic between the first set of electronic devices. The first electronic device receives an indication that first set of participating electronic devices has changed and, in response to the indication, exchanges a second secret with a second set of electronic devices participating during a second portion of the multiway call, the second secret being used to encrypt traffic between the second set of participating electronic devices. In some embodiments, the indication identifies a second electronic device as leaving the multiway call, and the second secret is not exchanged with the second electronic device.

Secure multiway calling

The subject technology provides a video conferencing application in which a live incoming or outgoing video stream can be supplemented with supplemental content, such as stickers, animations, etc., from within the video conferencing application. In this manner, a user participating in a video conferencing session with a remote user can add stickers, animations, and/or adaptive content to an outgoing video stream being captured by the device of the user, or to an incoming video stream from the device of the remote user, without having to locally cache/store a video clip before editing, and without having to leave the video conferencing session (or the video conferencing application) to access a video editing application.

Modifying video streams with supplemental content for video conferencing

The subject technology provides a messaging application in which an image can be captured and supplemented with supplemental content such as stickers, animations, etc., from within an active messaging thread. In this manner, a user participating in a messaging conversation with a remote user can add stickers, animations, and/or adaptive content to an image captured by the user, without having to locally cache/store the captured image before editing and without having to leave the messaging conversion (or the messaging application) to access an image editing application.

Modifying images with supplemental content for messaging

A device implementing cellular communication protocol aware multimedia streaming may include at least one processor configured to establish a link for communicating with another device, wherein the link utilizes at least one of a first cellular communication protocol or a second cellular communication protocol. The at least one processor may be configured to determine a bit rate for a video stream to be provided to the other device based at least in part on whether the link utilizes the first cellular communication protocol or the second cellular communication protocol, wherein a first bit rate is determined when the link utilizes the first cellular communication protocol and a second bit rate is determined when the link utilizes the second cellular communication protocol. The at least one processor may be configured to provide, for transmission over the link to the other electronic device, the video stream at the determined bit rate.

Cellular communication protocol aware multimedia streaming

Techniques are disclosed for coding video data in which frames from a video source are partitioned into a plurality of tiles of common size, and the tiles are coded as a virtual video sequence according to motion-compensated prediction, each tile treated as having respective temporal location of the virtual video sequence. The coding scheme permits relative allocation of coding resources to tiles that are likely to have greater significance in a video coding session, which may lead to certain tiles that have low complexity or low motion content to be skipped during coding of the tiles for select source frames. Moreover, coding of the tiles may be ordered to achieve low coding latencies during a coding session.

Efficient coding of source video sequences partitioned into tiles

A video playback buffer adjustment system is disclosed. The video playback buffer has a target size, measured in units of time of content, and includes a compressed frames queue and an uncompressed frames queue. The uncompressed frames queue has a minimum threshold queue size. If the size of the uncompressed frames queue falls below the minimum threshold size, then a next encoded frame in the compressed frames queue is removed from the compressed frames queue, decoded, and enqueued in the uncompressed frames queue. If a current size of the playback queue exceeds the target size plus &#x394; (a hysteresis value), then a playback frame rate is increased, and a presentation time of one or more frames in the uncompressed frames queue is adjusted according to the increased playback frame rate. If the playback queue size is less than the target size minus &#x394;, the playback speed can be reduced.

Video playback buffer adjustment

Systems and methods for coding a video to be overlaid by annotations are devised. A motion compensated predictive coding is employed, wherein coding parameters of video pixel blocks are determined based on the pixel blocks' relation to the annotations. A decoder decodes the video and annotates it based on metadata, obtained from the coder or other sources, describing the annotations' appearance and rendering mode.

Efficient coding of video data in the presence of video annotations

A device implementing a system for audio-video conferencing using multiple stream identifiers includes a processor configured to receive, from a sending device, indication of a first content stream and a first stream identifier, and indication of a second content stream and a second stream identifier associated. The first content stream and the second content stream correspond to different bit rates of streaming content. The processor is configured to receive, from a receiving device, a request to subscribe to the second content stream, the request including the second stream identifier, and receive, from the sending device, an indication that the second stream identifier has been associated with the first content stream. The processor is configured to forward, to the receiving device, the first content stream based on the request to subscribe to the second content stream and on the indication that the second stream identifier has been associated with the first content stream.

Multiway audio-video conferencing

Growing community of inventors

Saratoga, CA, United States of America

Ming Jin