Apple Inc.

Garrett M Johnson

Russell Y Webb

Randy Ubillos

Guy Cote

Timothy David Cherna

Frederic Cao

James Edmund Orr, Iv

Samuel Morgan Roberts

Jerremy Holland

Alexis Gatt

Jonathan P Ive

Alan C Dye

Andre Souza Dos Santos

Grant R Paul

Avi Elias Cieplinski

Cyrus Daniel Irani

David Hayward

Todd Stephen Sachs

Pavel Pivonka

Jeffrey A Brasket

Elliott B Harris

Russell Mackay Reid

Emilie Kim

Billy Sorrentino, Iii

Francesc T Terrades

Behkish J Manzari

Paul M Hubel

Joseph A Malia

Peter Warner

Jan Erik Solem

Hao Sun

Pedro Mari

Arian Behzadi

Marek A Bereza

Steven David Hordley

Claus Moelgaard

Yury Degtyarev

May-Li Khoe

Jiaying Wu

Daniel Trent Preston

B Michael Victor

Johnnie B Manzari

Farhan A Baqai

Nicolas P Bonnier

Bianca Cheng Costanzo

Earl Quong Wong

Glenn Gregory Gilley

Christopher Cunningham

Fabio Riccardi

Teun R Baar

Bradley Ford

Cédric Bray

Chong Chen

Caroline Hermans

Jeffrey Trær Bernstein

Elliot Harris

Marek Bareza

Billy Iii Sorrentino

Johnnie Behkish Manzari

The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.

User interface camera effects

In some implementations, a method includes: obtaining a first image; determining characterization properties for each of a plurality of pixels within the first image; determining a dominant hue based on the one or more characterization properties for each of the plurality of pixels within the first image; determining a plurality of hues that satisfy a predetermined perception threshold relative to the dominant hue based on the characterization properties for each of the plurality of pixels within the first image, wherein the plurality of hues is different from the dominant hue; and generating a second image based at least in part on the dominant hue and the plurality of hues. In some implementations, the second image corresponds to a color gradient generated based on the dominant hue within the first image. In some implementations, the second image is set as a wallpaper for a user interface.

Method and device for generating a resultant image based on colors extracted from an input image

Devices, methods, and program storage devices for creating and/or displaying backwards-compatible High Dynamic Range (HDR) images are disclosed, comprising: obtaining two or more exposures of a scene; creating a gain map based on at least one of the two or more exposures, wherein the gain map comprises a plurality of pixels each corresponding to a portion of the scene, and wherein values of the pixels in the gain map comprise indications of a brightness level of the corresponding portions of the scene; combining the two or more exposures to form a first image; tone mapping the first image based on a Standard Dynamic Range (SDR) format to generate a first SDR image of the scene; and storing the first SDR image and created gain map in a first enhanced image file. The first enhanced image file may be, e.g., a HEIF, HEIC, PNG, GIF, JPEG, or other suitable file format.

Backwards-compatible high dynamic range (HDR) images

In one embodiment, a method includes: obtaining a first image of a scene while an illumination component is set to an inactive state; obtaining a second image of the scene while the illumination component is set to a pre-flash state; determining one or more illumination control parameters for the illumination component for a third image of the scene that satisfy a foreground-background balance criterion based on a function of the first and second images in order to discriminate foreground data from background data within the scene; and obtaining the third image of the scene while the illumination component is set to an active state in accordance with the one or more illumination control parameters.

Method and device for balancing foreground-background luminosity

Some embodiments provide a novel user interface (UI) tool that is a unified slider control, which includes multiple sliders that slide along a region. The region is a straight line in some embodiments, while it is an angular arc in other embodiments. In some embodiments, the unified slider control is used in a media editing application to allow a user to modify several different properties of the image by moving several different sliders along the region. Each slider is associated with a property of the image. A position of the slider in the region corresponds to a value of the property associated with the slider.

Unified slider control for modifying multiple image properties

Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.

Techniques for providing virtual lighting adjustments utilizing regression analysis and functional lightmaps

Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A user interface for presenting and/or modifying image data may be provided via an electronic device. User input may be received that indicates a selection of a virtual lighting mode. Landmark points corresponding to a set of pixels of the image data may be identified based, at least in part, on depth measurement values of the set of pixels. One or more masks may be generated from the landmark points. One or more virtual lighting adjustments associated with the selected virtual lighting mode may be made to the image data using these masks (or the landmark points and an implied geometry of the landmark points). The adjusted/modified image may be presented to the user via the user interface at the electronic device.

Techniques for providing virtual light adjustments to image data

Techniques of reducing or eliminating artifact pixels in high dynamic range (HDR) imaging are described. One embodiment includes obtaining a first image of a scene at a first time with first exposure settings and obtaining a second image of the scene at a second time with second exposure settings that differ from the first exposure settings. The obtained images may be downsampled. The images may be compared to each other to assist with determining a number of potential artifact pixels in the scene. Depending on a relationship between the number of potential artifact pixels and a threshold value, the first image or second image may be selected as a reference image for registering the images with each other. A type of registration performed between the images may depend on which of the two images is the selected reference image. The registered images may be used to generate an HDR image.

Reducing or eliminating artifacts in high dynamic range (HDR) imaging

This invention provides methods for spatially localized image editing. For example, an input image is divided into multiple bins in each dimension. For each bin, a histogram is computed, along with local image statistics such as mean, medium and cumulative histogram. Next, for each tile, a type of adjustment is determined and applied, including adjustment associated with Exposure, Brightness, Shadows, Highlights, Contrast, and Blackpoint. The adjustments are done for all tiles in the input image to render a small adjustment image. The small image is then interpolated, for example, using an edge-preserving interpolation, to get a full size adjustment image with adjustment curve for each pixel. Subsequently, per-pixel image adjustments can be performed across an entire input image to render a final adjusted image.

Methods and systems for spatially localized image editing

Disclosed herein are methods and systems for fast and edge preserving upsampling of a small data image based on one or more guide images. During the upsampling process, selected data from the one or more guide images are combined with data from the data image to generate an upsampled pixel in an upsampled image. The upsampling can occur directly from the data image or sequentially via one or more intermediate upsampled images.

Fast and edge-preserving upsampling of images

Systems, methods, and computer readable media to improve the operation of electronic display systems. Techniques for inverse tone mapping operations for selected standard dynamic range (SDR) images are described. The converted images may be presented on high dynamic range (HDR) displays so as to increase a user's viewing experience (through an expanded dynamic range) while preserving the artistic content of the displayed information. Techniques disclosed herein selectively transform SDR images to HDR images by determining if the SDR images were created from HDR images (e.g., through the fusion of multiple SDR images) and if their quality is such as to permit the conversion without introducing unwanted visual artifacts. The proposed techniques apply a sigmoidal inverse tone mapping function configured to provide a perceptual-based tone mapping. Values for the function's tuning parameters may be set based on what may be determined about the original HDR-to-SDR mapping operation.

Perceptual tone mapping of SDR images for an HDR display

Growing community of inventors

San Francisco, CA, United States of America

Garrett M Johnson