Apple Inc.

Christopher L Flick

John Samuel Bushell

Xiaochun Nie

David William Singer

David L Biderman

James David Batson

Gregory R Chapman

Michel A Rynderman

Roger N Pantos

John Y Su

Jeffrey L Robbin

Hsi-Jung Wu

Xiaosong Zhou

Eric Taylor Seymour

William B May, Jr

Rainer Brodersen

Jun Xin

Thomas Michael Madden

J Peter Hoddie

Samir Gehani

Courtney Ann Kennedy

Kevin Calhoun

Fanyi Duanmu

Jordan B Schneider

Thai Wey Then

Thal-Wey Then

John Kevin Calhoun

Eduardo Asbun

Shalini Sahoo

William May

Techniques are disclosed for coding and delivering multi-view video in which the video is represented as a manifest file identifying a plurality of segments of the video available for download. The multi-view video may be partitioned spatially into a plurality of tiles that, in aggregate, encompass the entire spatial area of the video. The tiles are coded as segments contains coded video representing content contained within its respective tile. Tiles may be given different sizes based on saliency of the content within their respective regions. In this manner, tiles with high levels of interest may have relatively large spatial areas, which can lead to efficient coding in the presence of content motion.

Versatile tile coding for multi-view video streaming

Embodiments of the present disclosure provide techniques for rendering content from a media item. According to these embodiments, from a file of the media item, track(s) in a group data structure corresponding to the type of content are identified as candidate track(s). From other tracks in the file, a determination may be made whether another track corresponds to the type of content. When another track corresponds to the type of content, feature tags in the file that are associated may be compared with the other track to capabilities of a player device that is to render the type of content. When the feature tags match capabilities of the player device, the other track may be included as a candidate track. Thereafter, a track may be selected from the candidate tracks and rendered by the player device.

Media files and protocols supporting runtime dependent tracks

An encoding system may include a metadata manager, a key manager, and an encoder. The metadata manager may interface with one or more metadata sources to determine whether to include a metadata item from the one or more metadata sources. The key manager may determine whether the metadata item can be represented using one of already-allocated keys or an inline key must be used to represent the metadata item. The encoder may encode the metadata. If an inline key must be used to represent the metadata item, the encoder may associate the inline key and the type of the metadata item to the media file, and the encoder may encode the metadata item using the inline key in the media file.

Inline keyed metadata

Systems and methods for improved video formats used in delivery and playback are presented. According to an embodiment, the movie package format contains tiers that provide for multiple sets of movie variations that are individually selectable for transfer to a device for local playback. A locally stored movie package may contain any subset of available tiers for a movie. Non-resident tiers can be discovered and downloaded into the movie package as needed or when available. Tiers, and other movie files may be updated or added to the movie package at any time. Then users can request updates or the updates can be pushed to the user without affecting the previously downloaded files.

Movie package file format

System and methods for storing streamed media data to memory for future playback are provided. A device may stream media data associated with a movie over a network connection. The data streamed to the device will be saved to device memory and will then be playable offline. A manifest associated with the media data will be downloaded to the device and modified to reflect the location of the locally stored media data. During subsequent playback of the media data, the manifest will indicate that at least a portion of the media data exists in local memory. Some portions of the media data not stored locally may be subsequently retrieved from a remote source. The stored data may be updated or added to as necessary.

Movie package file format to persist HLS onto disk

Methods, data processing systems and machine readable non-transitory storage media are described that can provide, in one embodiment, a non-time based description of types of metadata in a time based metadata track that can be associated with, in time, a time based media track. The description can include a set of keys, or other identifiers, that specify the types of metadata in the metadata track, and the description can also include values describing the structure of each key and values describing how to interpret each key.

Temporal metadata track

This is directed to systems, methods and computer-readable media for media files having timed and untimed location metadata. For example, a media file can include timed location metadata stored in a metadata track of the media file, such that individual timed packets of location information are each associated with different portions of the recorded media. In some embodiments, the location metadata can include information describing the direction the device is facing and/or elevation/tilt of the device relative a horizontal plane (e.g. a plane perpendicular to a line between the device position and the center of the earth) and/or a motion of the device.

Location metadata in a media file

A description of types of metadata can provide, in one embodiment, an index to the types of metadata in a time based metadata track that can be associated with a time based media track having audio or video or both. The description can be non-time based and be separate from the metadata track, and the description can be examined to determine whether a particular type of metadata exists in the time based metadata track without having to search through the track to determine whether the particular type of metadata exists.

A content streaming system, such as an HTTP streaming system, can use a variant audio playlist that identifies different audio playlists, such as one playlist in English and one playlist in Spanish, for the same program such as a video program which is specified by a video playlist which can be separate from the variant audio playlist. A client can use the variant audio playlist to select a particular audio content for the same program, and the particular audio content can be referred to by one URL in the variant audio playlist, among a set of alternative URLs, in the variant audio playlist, for alternative audio content.

Playlists for real-time or near real-time streaming

Techniques are described for synchronizing multiple time-based data streams with independent clocks wherein relationships between clock rates of timing devices associated with the time-based data streams are determined, and based on these relationships, times in at least one of the time-based data streams may be translated to times in any of the other time-based data streams despite the data streams having independent clocks.

Time synchronization of multiple time-based data streams with independent clocks

System and method for integrating media objects for viewing on and manipulation via a computing device such as a personal computer. The system and method may be provided via an application program interface (API) which provides functions that allow an application program to create a scene and add media objects to the scene. The method includes preparing a translation vector and a rotation matrix for each of the media objects to define an orientation and a location of each of the media objects in the scene. The scene including the media objects is displayed. An interface is provided so that a user may manipulate the scene and the objects therein. The system and method may be implemented on a personal computer or other computing device.

System and method for integrating media objects

A sequence of video images can be represented using multiple related timelines by generating a first timeline identifying a decode order associated with a sequence of video images and a second timeline identifying a display order associated with the sequence of video images, wherein the sequence of video images is comprised of one or more samples. The first and second timelines can be correlated based on an offset, which represents a time period by which decoding precedes display. The sequence of video images can then be played in accordance with the correlated first and second timelines. Additionally, the decode order in the first timeline can differ from the display order in the second timeline. A revised offset between the first and second timelines can be determined after the sequence of video images has been edited and the first and second timelines can be correlated based on the revised offset.

Growing community of inventors

Sunnyvale, CA, United States of America

Christopher L Flick