Apple Inc.

Xiaosong Zhou

Hsi-Jung Wu

Chris Yoochang Chung

Dazhong Zhang

Jiefu Zhai

Jae Hoon Kim

Joe S Abuan

James O Normile

Hyeonkuk Jeong

Hang Yuan

Douglas Scott Price

Yeping Su

Yan Yang

Peikang Song

Jun Xin

Ke Zhang

Yunfei Zheng

Roberto Garcia, Jr

Ming Chen

Thomas Christopher Jansen

Elizabeth Caroline Cranfill

Albert E Keinath

Christopher M Garrido

Karthick Santhanam

Shujie Liu

Sudeng Hu

Stephen Olivier Lemay

Alexandros Michael Tourapis

Gobind Johar

Yao-Chung Lin

Mei Guo

Patrick Miauton

David R Conrad

Fanyi Duanmu

Xing Wen

Berkat S Tung

Xiaojin Shi

Luciano Miguel Verger

Ian J Baird

Xiaohua Yang

Eric L Chien

Jingteng Xue

Wen Zhao

David L Biderman

Keith Walter Rauenbuehler

Srinivasan Vasudevan

John Y Su

Ionut Hristodorescu

Gang Lu

David A Eldred

Jun Xu

James David Batson

Roberto Garcia

Ming Jin

Gianluca Filippini

Sundararaman V Shiva

Zhenheng Li

Feng Yi

Xingyu Zhang

Bess C Chan

Xiaoxia Sun

Jianxiong Shi

David William Singer

Athanasios Leontaris

Beibei Wang

Ting Chen

Haitao Guo

Christopher L Flick

Samir Gehani

David Daming Kuo

Andrew Yanowitz

Vinay Sharma

Emilie Kim

Christian L Duvivier

Bartlomiej W Rymkowski

Yuxin Liu

Kevin Arthur Robertson

Vikrant Kasarabada

Johnny Trenh

Hassan A Shojania

Gurtej Singh Chandok

Xiaoxiao Zheng

Davide Concion

Joshua L Hare

Ethan J Tira-Thompson

Shuang Gao

Robert A Bailey

Jochen Christian Schmidt

Sasanka T Vemuri

Peter Shiang

Sarah K Herrlinger

Paul Seung Ho Chang

Ben Englert

Giribalan Gopalan

Jinbo Qiu

Eduardo Asbun

Shalini Sahoo

Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

Establishing a video conference during a phone call

Systems and methods disclosed for video compression, utilizing neural networks for predictive video coding. Processes employed combine multiple banks of neural networks with codec system components to carry out the coding and decoding of video data.

Neural network based residual coding and prediction for predictive coding

A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.

Immersive video streaming using view-adaptive prefetching and buffer control

In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

Adaptive coding and streaming of multi-directional video

A device implementing the subject technology may include at least one processor configured to transmit an allocation request requesting allocation of a group communication session with a plurality of devices and receive an allocation response in response to the allocation request, the allocation response including credential information for the device to use to join the group communication session. The at least one processor may be further configured to transmit an allocation bind request with the credential information to join the group communication session using the credential information and receive an allocation bind success response in response to the allocation bind request, the allocation bind success response indicating that the device has joined the group communication session. The at least one processor may be further configured to provide a join notification to the plurality of devices via an intermediary device to notify that the device has joined the group communication session.

Multi-device communication management

Techniques for multi-view video streaming are described in the present disclosure, wherein a viewport prediction may be employed at a client-end based on analysis of pre-fetched media item data and ancillary information. A streaming method may first prefetch a portion of content of a multi-view media item. The method may next identify a salient region from the prefetched content and may then download additional content of the media item that corresponds to the identified salient region.

Client-end enhanced view prediction for multi-view video streaming exploiting pre-fetched data and side information

Video object and keypoint location detection techniques are presented. The system includes a detection system for generation locations of an object's keypoints along with probabilities associated with the locations, and a stability system for stabilizing keypoint locations of the detected objects. In some aspects, the generated probabilities are two-dimensional array correspond locations within input images, and stability system fits the generated probabilities to a two-dimensional probability distribution function.

Object and keypoint detection system with low spatial jitter, low latency and low power usage

Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.

Sphere projected motion estimation/compensation and mode decision

Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.

Systems and methods for perspective shifting in video conferencing session

In an example method, a system receives a plurality of frames of a video, and generates a data structure representing the video and representing a plurality of temporal layers. Generating the data structure includes: (i) determining a plurality of quality levels for presenting the video, where each of the quality levels corresponds to a different respective sampling period for sampling the frames of the video, (ii) assigning, based on the sampling periods, each of the frames to a respective one of the temporal layers of the data structure, and (iii) indicating, in the data structure, one or more relationships between (a) at least one the frames assigned to at least one of the temporal layers of the data structure, and (b) at least another one of the frames assigned to at least another one of the temporal layers of the data structure. Further, the system outputs the data structure.

Encoding and decoding video content

Techniques disclosed for managing video captured by an imaging device. Methods disclosed capture a video in response to a capture command received at the imaging device. Following a video capture, techniques for classifying the captured video based on feature(s) extracted therefrom, for marking the captured video based on the classification, and for generating a media item from the captured video according to the marking are disclosed. Accordingly, the captured video may be classified as representing a static event, and, as a result, a media item of a still image may be generated. Otherwise, the captured video may be classified as representing a dynamic event, and, as a result, a media item of a video may be generated.

Automated media editing operations in consumer devices

Techniques are disclosed for coding video data in which frames from a video source are partitioned into a plurality of tiles of common size, and the tiles are coded as a virtual video sequence according to motion-compensated prediction, each tile treated as having respective temporal location of the virtual video sequence. The coding scheme permits relative allocation of coding resources to tiles that are likely to have greater significance in a video coding session, which may lead to certain tiles that have low complexity or low motion content to be skipped during coding of the tiles for select source frames. Moreover, coding of the tiles may be ordered to achieve low coding latencies during a coding session.

Efficient coding of source video sequences partitioned into tiles

Growing community of inventors

Campbell, CA, United States of America

Xiaosong Zhou