Apple Inc.

D2 Technologies, Inc.

Christopher M Garrido

Karthick Santhanam

Ming Jin

Patrick Miauton

David L Biderman

Eric L Chien

Hsien-Po Shiang

Ian J Baird

Joe S Abuan

Yan Yang

Dazhong Zhang

Xiaosong Zhou

Daniel Ben Pollack

Luciano Miguel Verger

Gurtej Singh G Chandok

Erik Vladimir Ortega Gonzalez

Bradley F Patterson

Keith Walter Rauenbuehler

Austin W Shyu

Kevin Arthur Robertson

Berkat S Tung

Padmavathy Bhooma

Gurtej Singh Chandok

Hsi-Jung Wu

Ajoy K Singh

Qian Sun

Xiaoxiao Zheng

Jae Woo Chang

Martin E Johnson

Hyeonkuk Jeong

Sean Anthony Ramprashad

Najeeb M Abdulrahiman

Srinivasan Vasudevan

Daniel K Boothe

Hang Yuan

Eric A Allamanche

Thomas P Devanneaux

Nicholas M Fraioli

Peikang Song

Jose A Lozano Hinojosa

Vu H Chiem

Sudeng Hu

Anil G Naik

Jingyao Zhang

Deepak Chitlur Lakshman

Joshua L Hare

Chieh Lu

Peter D Callaway

Bess C Chan

Komei Harada

Wenhui Xu

Andreas Edgar Schobel

Thomas Christopher Jansen

Christoph Paasch

Ryan W Baker

Kyle William Horn

Sean P Devlin

Mark M Xue

Yu Xing

Jin Hyung Park

Hugh W Johnson

Jason Adam Bernardo

Brian Thomas Toombs

Vladimir Goupenko

David J Steele

Gabriel Nava Marino

Jinbo Qiu

Kostyantyn Komarov

James A Forrest

Srinivasan Nimmala

Beibei Wang

Vikram Bhaskara Yerrabommanahalli

Rohan C Malthankar

Kevin P McLaughlin

Sean Boland Kelly

Robert D Watson

Cahya Adiansyah Masputra

Anush G Nadathur

Jae Hoon Kim

Nicholas Joseph Circosta

Richard Michael Powell

Faraz Faheem

Daniel C Klingler

Mitchell R Lerner

Albert Riley Howard

Srinivas Rama

Gregory Robert Burns

Yang Yu

Xiaohua Yang

Sergey Sitnikov

Ariane Cotte

Adam E Kriegel

Tony S Verma

Albert E Keinath

Bradley Ford

Charles C Hoyt

Vikrant Kasarabada

Vinay A Ramaswamy

Ryan A Williams

A technique for transmitting data in a copresence environment includes initiating a virtual communication session between a local device and remote devices in a shared copresence environment, where each of the plurality of sending devices are transmitting a sending quality data stream in the virtual communication session. A region of interest for the local device is determined that includes a portion of the copresence environment. The local device subscribes to a first quality data stream for the remote devices represented in the region of interest, and a second quality data stream for the remote devices not represented in the region of interest.

Gaze-based copresence system

A device implementing the subject technology may include at least one processor configured to receive downlink condition reports from device, each downlink condition report indicating a downlink channel condition of a respective device. The at least one processor is further configured to determine an uplink channel condition for each of the devices. The at least one processor is further configured to determine, for each respective device and based at least in part on the downlink condition reports and the uplink channel conditions, quality tiers, each of the quality tiers indicating a quality of at least one of an audio stream or a video stream. The at least one processor is further configured to provide for transmission, to each respective device, the quality tiers determined for the respective device.

Multi-device communication management

The subject technology receives, at a local device, a requested camera format based on specifications of a display associated with a remote device. The remote device and the local device are devices participating in a video conference. The requested camera format includes a first resolution. Camera formats supported by a camera associated with the local device are determined. If a second resolution of a first camera format matches among the supported camera formats matches with the first resolution, the first camera format is selected for capturing the video stream by the camera. Otherwise, a second camera format among the supported camera formats is determined for capturing the video stream so as to maximize a field of view of the video stream relative to other camera formats supported by the camera.

Camera format selection

Devices, methods, and non-transitory program storage devices are disclosed to enable the automatic establishment of a secure audio/video data streaming connection between electronic devices. For example, a first electronic device may enter into a first state of a peer device advertising protocol, and then, based on a determination that the first electronic device meets a first set of device state criteria (e.g., including at least an orientation state criterion), the first electronic device may enter into a second (e.g., enhanced) state of the peer device advertising protocol. In response to detecting a presence of a second electronic device in its proximity, the first electronic device may connect to the second electronic device via a secure peer-to-peer connection protocol and then send one or more images captured by a first image capture device of the first electronic device to the connected second electronic device via the secure wireless peer-to-peer connection protocol.

Framework for automatically establishing secure connections for streaming audio and video data between devices based on device state criteria

A device implementing a system for packet loss management may include a memory and at least one processor configured to identify a plurality of categories of packets provided for transmission to an electronic device. The at least one processor may be further configured to determine a respective packet loss value for a respective category of the plurality of categories of packets. The at least one processor may be further configured to identify a particular category of the plurality of categories of packets for which the determined respective packet loss value satisfies a packet loss condition. The at least one processor may be further configured to adjust subsequent transmission of packets in the particular category of packets based at least in part on the packet loss condition being satisfied by the determined respective packet loss value for the particular category of packets.

Per-packet type packet loss management

The embodiments described herein can dynamically adjust timing of network bandwidth estimations by adjusting a target frequency for sending probing sequences to one or more receivers of content. The receivers receive these probing sequences from a transmitter and respond to the transmitter with network bandwidth estimations. In one embodiment, the probing sequences can use the content itself to create the probing sequences. The embodiments can be used in video conferencing applications to control how a transmitter of content can adjust transmissions based upon the network bandwidth estimations. In one embodiment, a policy can be used at a transmitter to begin a video transmission with a high frequency target for sending probing sequences (with, e.g., smaller length probing sequences) and transition to a lower frequency target (with, e.g., longer length probing sequences) when network bandwidth deteriorates and then return to the higher frequency target when the network bandwidth improves.

High frequency probing for network bandwidth estimation using video data in real-time video conference

A method and apparatus of a device that manages a video telephony call is described. In an exemplary embodiment, the device receives a network event from a network service of a device. The device further determines that the network event that is due to a local disruption of a network component of the device. In addition, and in response to the determination, the device restricts a local dynamic control of the video telephony call.

Systems and methods of enhanced adaptability in real-time communications based on events and metrics from network interfaces

A computer system outputs audio content via one or more audio output devices. If the audio content includes information that enables spatialization of the audio content, the system outputs the audio content in a simulated three-dimensional environment, including, if the audio content corresponds to a first category of content, causing the one or more audio output devices to simulate production of the audio content in a first virtual space, and if the audio content corresponds to a second category of content, causing the one or more audio output devices to simulate production of the audio content in a second virtual space that has different simulated acoustic properties than simulated acoustic properties of the first virtual space.

Systems, methods, and graphical user interfaces for using spatialized audio during communication sessions

Systems and processes for providing textual representations for a communication session are provided. For example, at least one audio input is received at an electronic device, wherein each audio input of the at least one audio input is associated with a respective priority level. A priority level of an audio input detected at a microphone of the electronic device is determined, wherein a highest priority level among the determined priority level and each received priority level corresponding to the at least one audio input is identified. A textual representation of a respective audio input corresponding to the identified highest priority level is obtained, wherein the obtained textual representation is displayed on a display of the electronic device.

Providing textual representations for a communication session

A method and apparatus of a device that uses a video jitter buffer to buffer the video frames for a received video stream is described. The device uses the video jitter buffer to estimate the delay variability of the frames and pick a target delay that will help harmonize the playback with minimal loss and delay. This is achieved by estimating the delay spread, which is the result of performing statistical analysis of the measured lags of the video frames received. The video jitter buffer provides target delay recommendation and reference frame information to the video player in order to anchor the playback and schedule the frames presentation time.

Systems and methods of video jitter estimation

Techniques are disclosed relating to multiway communications. In some embodiments, a first electronic device initiates a multiway call between a plurality of electronic devices and exchanges a first secret with a first set of electronic devices participating during a first portion of the multiway call, the first secret being used to encrypt traffic between the first set of electronic devices. The first electronic device receives an indication that first set of participating electronic devices has changed and, in response to the indication, exchanges a second secret with a second set of electronic devices participating during a second portion of the multiway call, the second secret being used to encrypt traffic between the second set of participating electronic devices. In some embodiments, the indication identifies a second electronic device as leaving the multiway call, and the second secret is not exchanged with the second electronic device.

Secure multiway calling

A device implementing a system for multipath connection management may include first and second local communication interfaces, and a processor configured to establish a primary connection for communicating between the first local communication interface and a first remote communication interface of an other device, and a secondary connection for communicating between the second local communication interface and a second remote communication interface. The processor may be configured to transmit application and control data over the primary connection and concurrently transmit a copy of control data over the secondary connection. The processor may be configured to determine that a degradation of the quality of the primary connection is attributable to the other device. The processor may be configured to switch the secondary connection to the first local communication interface and the second remote communication interface. The processor may be configured to transmit a copy of the application and control data over the secondary connection.

Multi-path connection management

Participant systems in an audiovisual (AV) conferencing can, in one embodiment, use methods to ensure that all participants have a common platform to support AV conferencing, such as a common codec, and also attempt to provide higher quality AV conferencing (e.g., better than the common codec) based on available bandwidth and other criteria. The participant systems can use the common codec as a fallback platform when bandwidth or other criteria dictate a reduction in the quality of the AV conferencing. Other embodiments are also disclosed.

Optimizing media experience in conferencing with diverse participants

A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatially rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatially rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.

Spatial audio controller

A device implementing the subject technology may include at least one processor configured to transmit an allocation request requesting allocation of a group communication session with a plurality of devices and receive an allocation response in response to the allocation request, the allocation response including credential information for the device to use to join the group communication session. The at least one processor may be further configured to transmit an allocation bind request with the credential information to join the group communication session using the credential information and receive an allocation bind success response in response to the allocation bind request, the allocation bind success response indicating that the device has joined the group communication session. The at least one processor may be further configured to provide a join notification to the plurality of devices via an intermediary device to notify that the device has joined the group communication session.

Growing community of inventors

San Jose, CA, United States of America

Christopher M Garrido