Apple Inc.

Eric L Chien

Christopher M Garrido

Ian J Baird

Yan Yang

Ming Jin

Joe S Abuan

Karthick Santhanam

Patrick Miauton

David L Biderman

Dazhong Zhang

Xiaosong Zhou

Austin W Shyu

Keith Walter Rauenbuehler

Berkat S Tung

Gurtej Singh G Chandok

Xiaoxiao Zheng

Komei Harada

Kyle William Horn

Qian Sun

Wenhui Xu

Bess C Chan

Hsi-Jung Wu

Beibei Wang

Luciano Miguel Verger

Hang Yuan

Thomas P Devanneaux

Hsien-Po Shiang

Xiaohua Yang

Peikang Song

Albert E Keinath

Vikrant Kasarabada

Vu H Chiem

David R Conrad

Gurtej Singh Chandok

Davide Concion

Joshua L Hare

Yichao Shen

Brian Thomas Toombs

Spencer E Lewson

Kartik P Sathappan

Giribalan Gopalan

A device implementing the subject technology may include at least one processor configured to receive downlink condition reports from device, each downlink condition report indicating a downlink channel condition of a respective device. The at least one processor is further configured to determine an uplink channel condition for each of the devices. The at least one processor is further configured to determine, for each respective device and based at least in part on the downlink condition reports and the uplink channel conditions, quality tiers, each of the quality tiers indicating a quality of at least one of an audio stream or a video stream. The at least one processor is further configured to provide for transmission, to each respective device, the quality tiers determined for the respective device.

Multi-device communication management

The subject technology receives, at a local device, a requested camera format based on specifications of a display associated with a remote device. The remote device and the local device are devices participating in a video conference. The requested camera format includes a first resolution. Camera formats supported by a camera associated with the local device are determined. If a second resolution of a first camera format matches among the supported camera formats matches with the first resolution, the first camera format is selected for capturing the video stream by the camera. Otherwise, a second camera format among the supported camera formats is determined for capturing the video stream so as to maximize a field of view of the video stream relative to other camera formats supported by the camera.

Camera format selection

A device implementing the subject technology may include at least one processor configured to transmit an allocation request requesting allocation of a group communication session with a plurality of devices and receive an allocation response in response to the allocation request, the allocation response including credential information for the device to use to join the group communication session. The at least one processor may be further configured to transmit an allocation bind request with the credential information to join the group communication session using the credential information and receive an allocation bind success response in response to the allocation bind request, the allocation bind success response indicating that the device has joined the group communication session. The at least one processor may be further configured to provide a join notification to the plurality of devices via an intermediary device to notify that the device has joined the group communication session.

The subject technology provides a video conferencing application in which a live incoming or outgoing video stream can be supplemented with supplemental content, such as stickers, animations, etc., from within the video conferencing application. In this manner, a user participating in a video conferencing session with a remote user can add stickers, animations, and/or adaptive content to an outgoing video stream being captured by the device of the user, or to an incoming video stream from the device of the remote user, without having to locally cache/store a video clip before editing, and without having to leave the video conferencing session (or the video conferencing application) to access a video editing application.

Modifying video streams with supplemental content for video conferencing

The subject technology provides a messaging application in which an image can be captured and supplemented with supplemental content such as stickers, animations, etc., from within an active messaging thread. In this manner, a user participating in a messaging conversation with a remote user can add stickers, animations, and/or adaptive content to an image captured by the user, without having to locally cache/store the captured image before editing and without having to leave the messaging conversion (or the messaging application) to access an image editing application.

Modifying images with supplemental content for messaging

Techniques are disclosed for coding video data in which frames from a video source are partitioned into a plurality of tiles of common size, and the tiles are coded as a virtual video sequence according to motion-compensated prediction, each tile treated as having respective temporal location of the virtual video sequence. The coding scheme permits relative allocation of coding resources to tiles that are likely to have greater significance in a video coding session, which may lead to certain tiles that have low complexity or low motion content to be skipped during coding of the tiles for select source frames. Moreover, coding of the tiles may be ordered to achieve low coding latencies during a coding session.

Efficient coding of source video sequences partitioned into tiles

A video playback buffer adjustment system is disclosed. The video playback buffer has a target size, measured in units of time of content, and includes a compressed frames queue and an uncompressed frames queue. The uncompressed frames queue has a minimum threshold queue size. If the size of the uncompressed frames queue falls below the minimum threshold size, then a next encoded frame in the compressed frames queue is removed from the compressed frames queue, decoded, and enqueued in the uncompressed frames queue. If a current size of the playback queue exceeds the target size plus &#x394; (a hysteresis value), then a playback frame rate is increased, and a presentation time of one or more frames in the uncompressed frames queue is adjusted according to the increased playback frame rate. If the playback queue size is less than the target size minus &#x394;, the playback speed can be reduced.

Video playback buffer adjustment

A device implementing the subject technology may include at least one processor configured to receive an indication of a task being performed at an other device. The at least one processor is further configured to perform, in response to receipt of the indication, one or more preliminary operations in anticipation of receiving a handoff of the task. The at least one processor is further configured to receive, after performing the one or more preliminary operations, a notification that the task is being handed off. The at least one processor is further configured to receive the handoff of the task from the other device. The at least one processor is further configured to continue to perform the task based at least in part on the one or more preliminary operations that were performed prior to receiving the notification that the task is being handed off.

A device implementing a system for audio-video conferencing using multiple stream identifiers includes a processor configured to receive, from a sending device, indication of a first content stream and a first stream identifier, and indication of a second content stream and a second stream identifier associated. The first content stream and the second content stream correspond to different bit rates of streaming content. The processor is configured to receive, from a receiving device, a request to subscribe to the second content stream, the request including the second stream identifier, and receive, from the sending device, an indication that the second stream identifier has been associated with the first content stream. The processor is configured to forward, to the receiving device, the first content stream based on the request to subscribe to the second content stream and on the indication that the second stream identifier has been associated with the first content stream.

Multiway audio-video conferencing

A device implementing the subject technology may include at least one processor configured to receive a plurality of buffer reports from a plurality of other devices, each of the plurality of buffer reports indicating a current target buffer level for a respective one of the plurality of other devices. The at least one processor may be further configured to determine a group target buffer level based at least in part on the current target buffer levels of the plurality of other devices and a current target buffer level of the at least one buffer. The at least one processor may be further configured to transmit the group target buffer level to the plurality of other devices. The at least one processor may be further configured to manage an occupancy of the at least one buffer based at least in part on the group target buffer level.

A first request to form a conference call is received from a first of a plurality of electronic devices. In response to the first request, a conference data structure is generated in a memory. Based on determining the conference call has ended, a second request is transmitted to each of the plurality of electronic devices to return a high-resolution video stream generated by each electronic device during the conference call. In response to the second requests, the high-resolution video stream is received from at least some of the plurality of electronic devices. Each of the received high-resolution video streams is stored in the conference data structure in the memory to generate a completed conference data structure. A notice that the completed conference data structure is available is transmitted to each of the plurality of electronic devices.

High-quality audio/visual conferencing

Growing community of inventors

Santa Clara, CA, United States of America

Eric L Chien