Apple Inc.

David Hayward

Mark Zimmer

Alexandre Naaman

Giridhar Sreenivasa Murthy

Ralph T Brunner

Richard R Dellinger

Ian C Hendry

Chendi Zhang

John Kennedy Calhoun

Frank Doepke

Geoff Stahl

Gabriel G Marcu

Garrett M Johnson

Eric Werner Anderson

Suk Hwan Lim

D Amnon Silverstein

Brijesh Tripathi

Ricardo Jansson Motta

Kenneth I Greenebaum

Steve Swen

Ian R Ollmann

Travis W Brown

Michael Balle-Pedersen

Guy Cote

Sheng Lin

Joseph P Bratt

Howard Aron Miller

Michael James Paquette

Simon Wolfenden Butler

Alan Bryant Heirich

Joseph Anthony Petolino, Jr

Serhan Uslubas

Ian Ollman

Kenneth Greemebaum

This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both 'relative' gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and 'absolute' gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

Gesture mapping for image filter input parameters

At least certain embodiments described herein provide a continuous autofocus mechanism for an image capturing device. The continuous autofocus mechanism can perform an autofocus scan for a lens of the image capturing device and obtain focus scores associated with the autofocus scan. The continuous autofocus mechanism can determine an acceptable band of focus scores based on the obtained focus scores. Next, the continuous autofocus mechanism can determine whether a current focus score is within the acceptable band of focus scores. A refocus scan may be performed if the current focus score is outside of the acceptable band of focus scores.

Continuous autofocus mechanisms for image capturing devices

Embodiments are directed toward systems and methods segment an input image for performance of a warp kernel that executes by a graphics processing unit (GPU) the warp kernel on an array of dummy data, wherein cells of the array are populated with data representing the cells' respective locations within the array, determine, from an output array obtained from execution of the warp kernel on the dummy data, a segmentation size, and build by the GPU an output image from the input image by executing the warp kernel on the input image according to the segmentation size.

Automatic determination of a region of influence

This invention provides methods for spatially localized image editing. For example, an input image is divided into multiple bins in each dimension. For each bin, a histogram is computed, along with local image statistics such as mean, medium and cumulative histogram. Next, for each tile, a type of adjustment is determined and applied, including adjustment associated with Exposure, Brightness, Shadows, Highlights, Contrast, and Blackpoint. The adjustments are done for all tiles in the input image to render a small adjustment image. The small image is then interpolated, for example, using an edge-preserving interpolation, to get a full size adjustment image with adjustment curve for each pixel. Subsequently, per-pixel image adjustments can be performed across an entire input image to render a final adjusted image.

Methods and systems for spatially localized image editing

RAW camera images may be processed by a computer system using either a particular application or a system level service. In either case, at least some parameters needed for the processing are preferably separated from the executable binary of the application or service, and are provided in separate, non-executable, data-only files. Each of these files can correspond to a particular camera or other imaging device. When a user of the system attempts to open a RAW image file from an unsupported device, the local system may contact a server for on-demand download and on-the-fly installation of the required support resource.

Digital camera raw image support

Disclosed herein are methods and systems for fast and edge preserving upsampling of a small data image based on one or more guide images. During the upsampling process, selected data from the one or more guide images are combined with data from the data image to generate an upsampled pixel in an upsampled image. The upsampling can occur directly from the data image or sequentially via one or more intermediate upsampled images.

Fast and edge-preserving upsampling of images

The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to&#x2014;or in place of&#x2014;calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created&#x2014;and interacted with&#x2014;by the user.

Three dimensional user interface effects on a display

The techniques disclosed herein use a compass, MEMS accelerometer, GPS module, and MEMS gyrometer to infer a frame of reference for a hand-held device. This can provide a true Frenet frame, i.e., X- and Y-vectors for the display, and also a Z-vector that points perpendicularly to the display. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track the Frenet frame of the device in real time to provide a continuous 3D frame-of-reference. Once this continuous frame of reference is known, the position of a user's eyes may either be inferred or calculated directly by using a device's front-facing camera. With the position of the user's eyes and a continuous 3D frame-of-reference for the display, more realistic virtual 3D depictions of the objects on the device's display may be created and interacted with by the user.

Three dimensional user interface effects on a display by using properties of motion

Growing community of inventors

Los Altos, CA, United States of America

David Hayward