Apple Inc.

Kelvin C Chiu

Aram M Lindahl

Rahul U Joshi

Aaftab A Munshi

Gokhan Avkarogullari

Srinivas Dasari

Mon Ping Wang

Alexander K Kan

Charles Brissart

Lloyd A Cunningham

Anna Tikhonova

Nick W Burns

Mon P Wang

A method of altering audio output from an electronic device based on image data is provided. In one embodiment, the method includes acquiring image data and determining one or more characteristics of the image data. Such characteristics may include sharpness, brightness, motion, magnification, zoom setting, and so forth, as well as variation in any of the preceding characteristics. The method may also include producing audio output, wherein at least one characteristic of the audio output is determined based on one or more of the image data characteristics. Various audio output characteristics that may be varied based on the video data characteristics may include, for instance, pitch, reverberation, tempo, volume, filter frequency response, added sound effects, or the like. Additional methods, devices, and manufactures are also disclosed.

Audio alteration techniques

The disclosed concepts provide a method to generate and use a compound shader object. A compound shader object includes a shader's intermediate representation (IR) and one or more binary modules; each binary module configured to execute on one type of graphics processing unit (GPU) with a specific input state. One method includes receiving, through a public application programming interface (API), a request to execute a shader from an user-level application. At the framework level, if the request corresponds to one of the prior compiled binary modules, that module may be passed to a GPU for immediate execution via a system private interface. If the request does not correspond to one of the binary modules, the shader's IR module may returned to the requesting user-level application (which module would then have to be compiled before it may be sent to the GPU).

Compound shader object and use thereof

A system decouples the source code language from the eventual execution environment by compiling the source code language into a unified intermediate representation that conforms to a language model allowing both parallel graphical operations and parallel general-purpose computational operations. The intermediate representation may then be distributed to end-user computers, where an embedded compiler can compile the intermediate representation into an executable binary targeted for the CPUs and GPUs available in that end-user device. The intermediate representation is sufficient to define both graphics and non-graphics compute kernels and shaders. At install-time or later, the intermediate representation file may be compiled for the specific target hardware of the given end-user computing system. The CPU or other host device in the given computing system may compile the intermediate representation file to generate an instruction set architecture binary for the hardware target, such as a GPU, within the system.

Unified intermediate representation

Various techniques relating to the alteration of image data are provided herein. An electronic device capable of carrying out such techniques may include data processing circuitry configured to receive image data and detect the occurrence of a device operation event (e.g., an audio event, a motion event, a location event, or an image event, and so forth). The data processing circuitry may alter the image data using a full-quality version or a reduced-quality version of an image alteration effect associated with the device operation event, depending on currently available resources.

Image alteration techniques

Methods, systems and devices are disclosed to examine developer supplied graphics code and attributes at run-time. The graphics code designed for execution on a graphics processing unit (GPU) utilizing a coding language such as OpenCL or OpenGL which provides for run-time analysis by a driver, code generator, and compiler. Developer supplied code and attributes can be analyzed and altered based on the execution capabilities and performance criteria of a GPU on which the code is about to be executed. In general, reducing the number of developer defined work items or work groups can reduce the initialization cost of the GPU with respect to the work to be performed and result in an overall optimization of the machine code. Manipulation code can be added to adjust the supplied code in a manner similar to unrolling a loop to improve execution performance.

Combining compute tasks for a graphics processing unit

Various techniques relating to the alteration of image data are provided herein. In generally, disclosed embodiments may provide techniques for applying on or more image alteration effects to image data that is displayed on an electronic device. In certain disclosed embodiments, the application of such image alteration effects may be triggered based upon various detected device operation events, which may include audio-related events, motion-related events, location-related events, and/or events relating the imaging properties. The selection of a triggering device event and a corresponding image alteration affect may be defined by a user through a set of user preference settings on the electronic device.

Growing community of inventors

San Jose, CA, United States of America

Kelvin C Chiu