Apple Inc.

John Samuel Bushell

James David Batson

Gregory R Chapman

Christopher L Flick

Roger N Pantos

David L Biderman

William B May, Jr

John Harper

James Michael Magee

Eric Olaf Carlson

Bradley Ford

Jeremy Spencer Jones

Nicolas Moss

Mohammad A Shah

Heiko Gernot Albert Panther

Nicholas V King

David William Singer

Bob Bradley

Kenneth I Greenebaum

Alexander B Beaman

Steve Swen

David P Saracino

Samir Gehani

Alexandre R Moha

Sundararaman V Shiva

Kevin Calhoun

Vikrant Kasarabada

Gennadiy Shekhtman

Davide Concion

Jerome Decoodt

Mortiz Wittenhagen

Erik Turnquist

Thal-Wey Then

Nicholas V Scapel

John Kevin Calhoun

William May

Systems and methods are disclosed for the rendering of contents communicated between devices. A source device processes a video sequence and transmits it to a target device together with metadata including rendering directives. At the target device, the received video sequence is rendered according to the rendering directives. Rendering is affected by events detected by the target device at the time of rendering or by the target device's information. Transparency masks, generated by the source device, are transmitted in an alpha channel to the target device, and are used for blending the video sequence with a secondary content.

Configuring alpha channel video based on display settings

Techniques are disclosed for identifying multiple sections from one or more tracks of a media file and reading them together in a consumption-driven pipeline process. A render pipeline may comprise a sample generator, a sample buffer, and a destination buffer. Multiple render pipelines may be used for parsing multiple tracks of the media file. An I/O manager may determine that a destination buffer requires new data. The I/O manager may schedule a memory read for a data element from the sample buffer corresponding to the destination buffer and may determine if any of the sample buffers have data elements with memory locations close to the scheduled read. If so, the I/O manager may also schedule those memory locations to be read. After reading, the filled data elements corresponding to the read memory may then be sent to their corresponding destination buffers to be consumed and added to their corresponding tracks.

Using additional intermediate buffer queues to identify interleaved media data to be read together

In some implementations, a computing device can notify a media application when a screen recording may be in progress. For example, the computing device can be configured to send media content provided by the media application for presentation on the display of the computing device to a second destination (e.g., a file, a remote playback device, a remote recording device, etc.) that may result in a recording of the display screen of the computing device. To allow the media application an opportunity to protect the media content from unauthorized recording, the computing device can notify the media application that the media content being sent to the second destination may be recorded. In response to receiving the notification, the media application can modify the presentation of the media content to prevent or downgrade any recording that may be performed.

Notifying applications of screen recording

Techniques are disclosed for selecting frames for decode and display during different playback modes of a media player. Prediction dependencies may be estimated among frames from a sample table of a media item identifying dependency state among frames in the media item. Based on a playback rate of a media player, a collection of frames may be identified from the media item that have presentation times within a display refresh time of the player. A frame may be selected for decode and display during the display refresh time based on the estimated prediction dependencies. The selected frame may be decoded for display during the player display refresh time.

Techniques for selecting frames for decode in media player

Video data with high frame rates may be displayed on devices with limited resources (e.g., decoder and/or display resources). These devices may have their resources devoted to other tasks or may not be capable to display the video data at the high frame rates. The coding method may include coding the frames such that additional droppable frames are included in the encoded video data. The decoding method may include dropping droppable frames before the encoded video data is decoded to reduce the number of frames that will be decoded and displayed. These methods may be applied to video data that has a variable frame rate and may be combined with processing the image sequence for slow motion playback.

Tuning video compression for high frame rate and variable frame rate capture

Disclosed herein are systems, methods, and non-transitory computer-readable storage media for creating and using media asset proxies. The media asset proxies represent a digital media asset and are created by filtering and modifying elements from the digital media asset. The media asset proxies can be queried in the same manner as their corresponding digital media asset.

Media asset proxies

Methods, systems and machine readable storage medium for allowing playback of streaming media at playback rates of other than 1&#xd7; are described. In one embodiment, a method can determine different sets of I-frames that are available before a display deadline, where each set can have a different cadence, and one of the sets can be selected for download and display to achieve playback at other than 1&#xd7;. Byte range requests from a client device can be used to retrieve each of the I-frames. Other methods, system and media are also described.

Playlists for real-time or near real-time streaming

A module may provide codec-independent services including determining frame display order, frame dependency sets, and queuing the dependency frames in advance so as to enable display of a video. The module enables a video to be played forwards or backwards at a variety of playback speeds from any position within the video. In one implementation, a device communicatively coupled to a plurality of decoders accesses a video that includes a plurality of frames. One or more of the frames are decodable by one or more of the communicatively coupled decoders. The device identifies a frame in the video that is to be displayed, and determines a plurality of dependency frames in the video upon which decoding of the frame to be displayed depends. The device provides an indication that one or more associated dependency frames are to be decoded.

Decoding interdependent frames of a video for display

This is directed to systems, methods and computer-readable media for media files having timed and untimed location metadata. For example, a media file can include timed location metadata stored in a metadata track of the media file, such that individual timed packets of location information are each associated with different portions of the recorded media. In some embodiments, the location metadata can include information describing the direction the device is facing and/or elevation/tilt of the device relative a horizontal plane (e.g. a plane perpendicular to a line between the device position and the center of the earth) and/or a motion of the device.

Location metadata in a media file

A video decoder includes a mode of operation for reverse playback that includes dividing a sequence of coded video data into groups of pictures (GOPs) and further subdividing the groups of pictures into a plurality of spans. Each span is processed in reverse coding order by decoding the first key frame and any reference frames that precede the currently processed span in coding order, selecting a plurality of frames from the currently processed span for decode and display and further selecting for decode but not display any reference frames from the currently processed span that were omitted by the first selection. The method accommodates control parameters that define the number of spans selected from each GOP and the number of frames selected from each span for decoded and display.

Control of video decoder for reverse playback operation

A method is provided through which information about media files embedded in web pages is obtained from a server and analyzed to determine if the media files are playable on a device. This information may be external to the media file or may be a portion of the media file itself. The determination of whether a media file is playable by a device is made based on information obtained from the server without downloading the entirety of the media file.

Determining playability of media files with minimal downloading

Techniques for synchronizing audio and video content for presentation to a user at a same rate are provided. Streams of content from two or more sources of media, each media source having an associated clock, are synchronized by a synchronizing component and processor with respect to a master clock. As well, techniques are provided for ensuring that output devices are synchronized at preview startup. That is, such techniques ensure that the output devices start playing the media at the same time as well as at the same rate.

Capturing media in synchronized fashion

A content streaming system, such as an HTTP streaming system, can use a variant audio playlist that identifies different audio playlists, such as one playlist in English and one playlist in Spanish, for the same program such as a video program which is specified by a video playlist which can be separate from the variant audio playlist. A client can use the variant audio playlist to select a particular audio content for the same program, and the particular audio content can be referred to by one URL in the variant audio playlist, among a set of alternative URLs, in the variant audio playlist, for alternative audio content.

A graphic display module operating on a first device prepares graphic data to be displayed on a wirelessly connected display adapter that includes graphics processing capability. The display adapter transmits metadata to the graphic display module that includes the graphic processing capabilities of the display adapter. The graphic display module uses the metadata, and possibly the available bandwidth, to selectively delegate graphic processing tasks to the display adapter.

Growing community of inventors

San Jose, CA, United States of America

John Samuel Bushell