Apple Inc.

Eric J Graves

Randy Ubillos

Giovanni M Agnoli

Randall Hayes Ubillos

Vijay Sundaram

Nils Angquist

Xiaohuan Corina Wang

Kenneth M Carson

David N Chen

Brian Everett Meaney

Colleen M Pendergast

Mike Stern

Peter Chou

Paul Thomas Schneider

Shaun M Poole

Angus M Taggart

Jean-Francois N Dumais

A novel method for retiming a portion of a media content (e.g., audio data, video data, audio and video data, etc.) in a media-editing application is provided. The media editing application includes a user interface for defining a range in order to select a portion of the media content. The media editing application performs retiming by applying a speed effect to the portion of the media content selected by the defined range. For a faster speed effect, the media editing application retimes the selected portion of the media content by sampling the media content at a faster rate. For a slower speed effect, the media editing application retimes the selected portion of the media content by sampling the content at a slower rate.

Retiming media presentations

An operating system that includes an image processing framework as well as a job management layer is provided. The image processing framework is for performing image processing operations and the job management layer is for assigning the image processing operations to multiple concurrent computing resources. The computing resources include several processing units and one or more direct memory access (DMA) channels for concurrently rendering image data and transferring image data between the processing units.

Multi-processor graphics rendering

Some embodiments provide a media-editing application. The application includes several image processing destinations for performing operations on video images. The application includes a scheduling engine for scheduling disk read, decode, and graphics processing operations to perform on images to prepare the images for the several destinations. The scheduling engine includes a first set of instructions for scheduling images based on a speed at which a particular one of the several destinations processes the images when none of the destinations require images in real-time. The scheduling engine includes a second set of instructions for scheduling images based on a real-time clock when at least one of the several destinations requires images in real-time.

Efficient media processing

Some embodiments provide a media-editing application that includes several background-rendering modules. These modules automatically render segments of a media presentation in the background of a system on which the media-editing application is being executed. By performing rendering in the background, the background-rendering modules produce rendered results for the segments. That is, the modules pre-generate playable media output data (e.g., composite video frames or audio samples) of the media presentation without interrupting other operations (e.g., editing operations, etc.) of the media-editing application. The background-rendering modules in some embodiments include a first background-rendering module and a second background-rendering module. The first background-rendering module determines a prioritized order in which the segments are to be rendered. The second background-rendering module renders the segments of each category in the prioritized order that is determined by the first background-rendering module.

Media-editing application with automatic background rendering capabilities

Some embodiments provide a media-editing application. The application receives a command to import a media file into the media-editing application. The media file includes a sequence of video images. The application copies the media file to a storage location associated with the media-editing application. The method performs several analysis and transcode operations on the media file in parallel. In some embodiments, the application identifies a video image on which to the operations. The application schedules a single set of image preparation operations for the video image to generate one or more sets of image data for the operations. The method sends the image data to the different operations. A same set of image data is sent to at least two of the operations.

Efficient media import

Some embodiments provide a method that receives the addition of a video clip to a composite video project. The video clip has a sequence of video images at a first frame rate and the composite video project has a second frame rate for outputting video images. When the first frame rate does not match the second frame rate but is within a threshold of the second frame rate, the method generates output video images for a particular duration of the composite video project at the second frame rate by using each of the video images of the video clip once during the particular duration. When the first frame rate is not within the threshold, generating output video images for the particular duration of the composite video project at the second frame rate by using at least one of the video images for each output video image over the particular duration.

Rate conform operation for a media-editing application

A method for processing an image of a given file type is disclosed. The method involves converting the image into data formatted for a new pixel type, the new pixel type is closely correlated with and has all the components of pixels for the given file type. In addition, the method includes processing the data formatted in the new pixel type using standard image processing routines, these standard routines being designed for data having different components of pixels than the new pixel type and the given file type.

Adjustment of color values for optimized image processing

Methods for analyzing a list of routine identifiers to optimize processing of routines identified in the list. Some embodiments execute a set of routines in multiple passes where each pass comprises each routine in the set processing a single band of its source. The band size of the sources of the set is related to the size of a cache used during execution of the set. A band size of sources of the set is determined so that all data processed by and produced by any routine in the set can be stored to the cache while the routine processes one band of its source. Some embodiments use the list to combine two or more routines into a single routine where the list is modified accordingly. Some embodiments use the list for grouping and re-ordering routines identified in the list to send particular routines to an alternative processor for processing.

Optimizing the execution of media processing routines using a list of routine identifiers

A first command is retrieved from a script containing one or more commands written for a first color space. The first command is associated with zero or more input buffers and zero or more output buffers. The first command has zero or more parameters. A behavior of the first command in the first color space and in a second color space is determined. The behavior comprises one of unique behavior, transparent behavior, and different behavior. The first command has the unique behavior when the first command only operates in the first color space. The first command has the transparent behavior when the first command generates similar results in the first color space and in the second color space. The first command has the different behavior when the first command generates different results in the first color space and in the second color space. Using the behavior of the first command, an operation associated with the first command is processed. The operation is processed in a preferred format based on current formats of the input buffers.

Mechanism for color-space neutral (video) effects scripting engine

A graphical user interface for performing color correction and methods for implementing the color correction are disclosed. The graphical user interface allows a user to adjust the colorspace of the pixels in the image. In one embodiment, a color adjustment pad allows the user to push the pixels from a particular luminance level a desired magnitude towards a desired hue. Pixels from other luminance levels are affected proportionally. The graphical user interface further allows a user to adjust the luminance of the pixels in the image. A luminance adjustment slider allows the user to adjust the luminance of pixels from a selected luminance level by a relative amount. Pixels from other luminance levels have their luminance are affected in a manner proportional to a difference between the selected luminance level value and the luminance value of the other pixel.

Growing community of inventors

Radnor, PA, United States of America

Eric J Graves