Apple Inc.

Salesforce Com, Inc.

Yan Yang

Stephen Olivier Lemay

Joe S Abuan

Hyeonkuk Jeong

Daniel Ben Pollack

Berkat S Tung

Xiaosong Zhou

Pierre Jonathan De Filippis

Hsi-Jung Wu

James O Normile

Christopher M Garrido

Nicholas Joseph Circosta

Ming Jin

Thomas Christopher Jansen

Gobind Johar

Gregory B Novick

Craig P Dooley

Aroon Pahwa

Tyler D Hawkins

David T Wilson

Ian J Baird

Todd Allan Shortlidge

Eric L Chien

James C Grandy

David C Donley

Roberto Garcia, Jr

Julien A Poumailloux

Chris Yoochang Chung

Dazhong Zhang

Thomas P Devanneaux

Patrick Miauton

Sundararaman V Shiva

Austin W Shyu

Vu H Chiem

Karthick Santhanam

Thuy Park

Jin Hyung Park

Justin N Wood

Roberto Garcia

Keith Walter Rauenbuehler

Gokul P Thirumalai

Hsien-Po Shiang

Hassan A Shojania

Nirav Rajendra Patel

Jose A Lozano Hinojosa

Ryan W Baker

Sean P Devlin

Barry A Whitebook

Yu Xing

Mark M Xue

Yichao Shen

David J Steele

Vladimir Goupenko

Xiasong Zhou

Elizabeth Caroline Cranfill

Jianxiong Shi

Ting Chen

David L Biderman

Haitao Guo

Douglas Scott Price

David Daming Kuo

Andrew Yanowitz

Amol V Pattekar

Kit Pang Szeto

Jean-Marc Soumet

Karl Ryszard Skucha

Leah McGuire

Xiaoxiao Zheng

Pierre De Filippis

Matvey Tovbin

Bess C Chan

Komei Harada

David A Eldred

Vlad Patryshev

Aleksei Naiden

David D Kuo

Marco Vivero

Zhongren Xu

Joshua Sauter

Pierre J De Fillippis

Julien A Poumallioux

Qiong Liu

Thomas Jansen

A device implementing the subject technology may include at least one processor configured to receive downlink condition reports from device, each downlink condition report indicating a downlink channel condition of a respective device. The at least one processor is further configured to determine an uplink channel condition for each of the devices. The at least one processor is further configured to determine, for each respective device and based at least in part on the downlink condition reports and the uplink channel conditions, quality tiers, each of the quality tiers indicating a quality of at least one of an audio stream or a video stream. The at least one processor is further configured to provide for transmission, to each respective device, the quality tiers determined for the respective device.

Multi-device communication management

Techniques are disclosed relating to multiway communications. In some embodiments, a first electronic device initiates a multiway call between a plurality of electronic devices and exchanges a first secret with a first set of electronic devices participating during a first portion of the multiway call, the first secret being used to encrypt traffic between the first set of electronic devices. The first electronic device receives an indication that first set of participating electronic devices has changed and, in response to the indication, exchanges a second secret with a second set of electronic devices participating during a second portion of the multiway call, the second secret being used to encrypt traffic between the second set of participating electronic devices. In some embodiments, the indication identifies a second electronic device as leaving the multiway call, and the second secret is not exchanged with the second electronic device.

Secure multiway calling

Systems, methods and non-transitory computer readable media for allowing a user to switch between wearable items that have been paired or associated with an electronic device, such as a smartphone, are described. In one embodiment, the wearable items automatically detect a removal of a first wearable item from a user's body and an attachment of a second wearable item to the user's body. Messages from the wearable items are transmitted to the electronic device to allow the electronic device to switch the active wearable item from the first wearable item to the second wearable item. The switch can occur while the electronic device is in a locked state, and the electronic device can synchronize the second wearable item with data received from the first wearable item. Other embodiments are also described.

Switching between watches or other accessories

A device implementing the subject technology may include at least one processor configured to transmit an allocation request requesting allocation of a group communication session with a plurality of devices and receive an allocation response in response to the allocation request, the allocation response including credential information for the device to use to join the group communication session. The at least one processor may be further configured to transmit an allocation bind request with the credential information to join the group communication session using the credential information and receive an allocation bind success response in response to the allocation bind request, the allocation bind success response indicating that the device has joined the group communication session. The at least one processor may be further configured to provide a join notification to the plurality of devices via an intermediary device to notify that the device has joined the group communication session.

The subject technology provides a video conferencing application in which a live incoming or outgoing video stream can be supplemented with supplemental content, such as stickers, animations, etc., from within the video conferencing application. In this manner, a user participating in a video conferencing session with a remote user can add stickers, animations, and/or adaptive content to an outgoing video stream being captured by the device of the user, or to an incoming video stream from the device of the remote user, without having to locally cache/store a video clip before editing, and without having to leave the video conferencing session (or the video conferencing application) to access a video editing application.

Modifying video streams with supplemental content for video conferencing

The subject technology provides a messaging application in which an image can be captured and supplemented with supplemental content such as stickers, animations, etc., from within an active messaging thread. In this manner, a user participating in a messaging conversation with a remote user can add stickers, animations, and/or adaptive content to an image captured by the user, without having to locally cache/store the captured image before editing and without having to leave the messaging conversion (or the messaging application) to access an image editing application.

Modifying images with supplemental content for messaging

Establishing a communication channel via a relay server with reduced setup time. Upon request by an initiating communication device a relay allocation server may allocate a single relay server for use in a communication session between the initiating communication device and one or more recipient communication devices. The relay server may be selected to perform favorably for the initiating communication device. Messaging for establishment of the communication session may be performed using persistent messaging connections, to avoid connection establishment cost. Messaging may also be performed using address tokens to avoid the cost of discovering global IP addresses. Following establishment of the communication session, the relay server may discover the IP address of one or more recipient communication devices, and may initiate reallocation of those devices to another relay server.

Relayed communication channel establishment

A quick relay communication protocol is used by an initiating communication device (such as a wearable electronic device, e.g., a smart watch) and/or a recipient communication device (such as a companion electronic device to the wearable electronic device, e.g., a smart phone, a tablet computer or a laptop computer) to selectively communicate messages via different communication channels. Based on available connections and a communication constraint associated with a message, a processor executing a program module in an application layer in the initiating communication device provides transmission instructions to an interface circuit in the initiating communication device, which transmits a message to the recipient communication device based on the transmission instructions. When there are currently no available connections and the message is eligible to be communicated through a cloud-based relay server, the processor establishes a cloud-based connection with the recipient communication device via the relay server.

Quick relay traffic management for cloud messaging

A device implementing a system for multiway audio-video conferencing includes a processor configured to receive, from a first device, indication of a first channel and a second channel for communicating content for an audio-video conference session. The first channel and the second channel correspond to different types of communication interfaces. The processor is further configured to receive, from the first device, a first request to subscribe to a first content stream for the audio-video conference session via the first channel, and to subscribe to a second content stream for the audio-video conference session via the second channel, and in response to receiving the first request, forward, to the first device, the first content stream via the first channel.

Multiway audio-video conferencing with multiple communication channels per device

A device implementing the subject technology may include at least one processor configured to receive an indication of a task being performed at an other device. The at least one processor is further configured to perform, in response to receipt of the indication, one or more preliminary operations in anticipation of receiving a handoff of the task. The at least one processor is further configured to receive, after performing the one or more preliminary operations, a notification that the task is being handed off. The at least one processor is further configured to receive the handoff of the task from the other device. The at least one processor is further configured to continue to perform the task based at least in part on the one or more preliminary operations that were performed prior to receiving the notification that the task is being handed off.

A device implementing a system for audio-video conferencing using multiple stream identifiers includes a processor configured to receive, from a sending device, indication of a first content stream and a first stream identifier, and indication of a second content stream and a second stream identifier associated. The first content stream and the second content stream correspond to different bit rates of streaming content. The processor is configured to receive, from a receiving device, a request to subscribe to the second content stream, the request including the second stream identifier, and receive, from the sending device, an indication that the second stream identifier has been associated with the first content stream. The processor is configured to forward, to the receiving device, the first content stream based on the request to subscribe to the second content stream and on the indication that the second stream identifier has been associated with the first content stream.

Multiway audio-video conferencing

Growing community of inventors

San Jose, CA, United States of America

Yan Yang