Apple Inc.

Other

Metacreations, Corp.

Marcu, Gabriel G.

Hayward, David

Zimmer, Mark

Mark Zimmer

Ralph T Brunner

David Hayward

Peter N Graffagnino

John Harper

Suk Hwan Lim

Frank Doepke

Geoff Stahl

Bas Ording

Guy Cote

Gabriel G Marcu

Kok S Chen

Imran A Chaudhri

D Amnon Silverstein

Ricardo Jansson Motta

Rudolph Van Der Merwe

Richard E Crandall

Jason Klivington

Mark J Flider

Sheng Lin

Joseph P Bratt

Simon Wolfenden Butler

John Derry

Ralp Brunner

Peter M Graffagnino

Disclosed is a system for producing images including techniques for reducing the memory and processing power required for such operations. The system provides techniques for programmatically representing a graphics problem. The system further provides techniques for reducing and optimizing graphics problems for rendering with consideration of the system resources, such as the availability of a compatible GPU.

System for optimizing graphics operations

The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to&#x2014;or in place of&#x2014;calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created&#x2014;and interacted with&#x2014;by the user.

Three dimensional user interface effects on a display

Systems and methods for reducing chrominance (chroma) noise in image data are provided. In one example of such a method, image data in YCC format may be received into logic of an image signal processor. Using the logic, noise may be filtered from a first chrominance component or a second chrominance component, or both, of the image data, using a sparse filter and a noise threshold. The noise threshold may be determined based at least in part on two of the components of the YCC image data.

Systems and methods for chroma noise reduction

A presentation application for masking portions of an object, such as the background of an image, is provided. The presentation application may provide a background removal tool that allows a user to define an initial point in the background of the object. The presentation application may establish an initial background color based on the initial point, and may compute and automatically adjust a color tolerance of the background color based on the distance that a user-controlled cursor is from the initial point. Using a seed-fill algorithm, the presentation application can select a contiguous portion of the object for masking that includes the initial point and surrounding pixels that are within the background color tolerance. To smoothen the edges of the contiguous portion, the presentation application can convert the portion to a vector graphic before making the object.

Background removal tool for a presentation application

This disclosure pertains to novel devices, methods, and computer readable media for performing raw camera noise reduction using a novel, so-called 'alignment mapping' technique to more effectively separate structure from noise in an image, in order to aid in the denoising process. Alignment mapping allows for the extraction of more structure from the image and also the ability to understand the image structure, yielding information for edge direction, edge length, and corner locations within the image. This information can be used to smooth long edges properly and to prevent tight image details, e.g., text, from being overly smoothed. In alignment maps, the amount of noise may be used to compute thresholds and scaling parameters used in the preparation of the alignment map. According to some embodiments, a feature map may also be created for the image. Finally, the image may be smoothed using the created feature map as a mask.

Raw camera noise reduction using alignment mapping

Systems, methods and computer program products are disclosed for resampling a digital image. According to an implementation, a source image can be presharpened and upsampled to a first upsampled image having a specified image size and a first level of presharpening. The source image is also presharpened and upsampled to a second upsampled image having the specified image size and second level of presharpening that is less than the first level of presharpening. The first and second upsampled images are deblurred. A binary edge mask image is generated from the deblurred, upsampled images. The binary edge mask image is dilated and blurred to generate a deep mask image. The first and second, deblurred upsampled images are blended together using the deep mask image.

Digital image resampling

This disclosure pertains to novel devices, methods, and computer readable media for performing 'blind' color defringing on images. In one embodiment, the blind defringing process begins with blind color edge alignment. This process largely cancels every kind of fringe, except for axial chromatic aberration. Next, the process looks at the edges and computes natural high and low colors to either side of the edge, attempting to get new pixel colors that aren't contaminated by the fringe color. Next, the process resolves the pixel's estimated new color by interpolating between the low and high colors, based on the green variation across the edge and the amount of green in the pixel that is being repaired. Care is taken to prevent artifacts in areas that generally do not fringe, like red-black boundaries and skin tone. Finally, the process computes the final repaired color by using luminance-scaling of the new pixel color estimate.

Blind defringing for color images

This disclosure pertains to novel devices, methods, and computer readable media for performing color defringing on image data. In photography, particularly RAW images, different artifacts can affect the quality of the edges of objects in the image. This effect is generally more noticeable when the edge has high contrast. One motivation for the described techniques is the understanding that, typically, not all pixels of an image exhibit color fringing. Usually, fringing only occurs in high-contrast edges. Mere masking of the effects of the whole-image operations can improve the result, but further improvements are still possible. This disclosure also pertains to novel devices and computer readable media for performing red-blue color reconstruction on data from a variety of color filter arrays (CFAs).

Defringing RAW images

The techniques disclosed herein use a compass, MEMS accelerometer, GPS module, and MEMS gyrometer to infer a frame of reference for a hand-held device. This can provide a true Frenet frame, i.e., X- and Y-vectors for the display, and also a Z-vector that points perpendicularly to the display. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track the Frenet frame of the device in real time to provide a continuous 3D frame-of-reference. Once this continuous frame of reference is known, the position of a user's eyes may either be inferred or calculated directly by using a device's front-facing camera. With the position of the user's eyes and a continuous 3D frame-of-reference for the display, more realistic virtual 3D depictions of the objects on the device's display may be created and interacted with by the user.

Three dimensional user interface effects on a display by using properties of motion

Disclosed are a system and method for computing a picture. Instead of loading a file that contains the image from memory, the present invention provides for a system and method for opening and retaining a procedural recipe and a small set of instructions that can be executed to compute a picture. The picture can be computed very quickly using a GPU (graphics processing unit), and can be made to move on demand. When a part of the image is needed to composite, that part is computed using a fragment program on the GPU using the procedural recipe and a specially written fragment program into a temporary VRAM buffer. After it is computed and composited, the buffer containing the result of the fragment program may be discarded.

System and method for computing an image

Systems and methods for processing YCC image data provided. In one example, an electronic device includes memory to store image data in RGB or YCC format and a YCC image processing pipeline to process the image data. The YCC image processing pipeline may include receiving logic configured to receive the image data in RGB or YCC format and color space conversion logic configured to, when the image data is received in RGB format, convert the image data into YCC format. The YCC image processing logic may also include luma sharpening and chroma suppression logic; brightness, contrast, and color adjustment logic; gamma logic; chroma decimation logic; scaling logic; and chroma noise reduction logic.

Systems and methods for YCC image processing

The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may compute noise statistics associated with image data by receiving a frame of the image data having a plurality of pixels. The image processing pipeline may then identify a plurality of portions of the frame of the image data such that each portion of the plurality of portions has a flat surface. The image processing pipeline may then calculate a plurality of gradients for each portion of the plurality of portions, determine one or more dominant gradient orientations for each portion of the plurality of portions, and generate a histogram that represents a plurality of dominant gradient orientations that corresponds to the plurality of portions. After generating the histogram, the image processing pipeline may store the histogram, which may represent the noise statistics, in a memory.

Growing community of inventors

Aptos, CA, United States of America

Mark Zimmer