Apple Inc.

Brandon J Corey

Johnnie B Manzari

Grant R Paul

Nathan De Vries

Alan C Dye

Elizabeth Caroline Cranfill

James Nicholas Jones

Craig Michael Federighi

Neil Gareth Crane

Andre Souza Dos Santos

Ryan S Dixon

Jeffrey A Brasket

Xin Wang

Xin Ru Wang

William A Sorrentino, Iii

Behkish J Manzari

D Amnon Silverstein

Steven D Baker

Jianping Zhou

Srinivasan Venkatachary

Xuemei Zhang

Yingjun Bai

Yonghui Zhao

Vignesh Jagadeesh

Marco Zuliani

Jennifer P Chen

Matthias Paulik

Viktor Miladinov

Elliott B Harris

Vincent M Lane

Vinay Sharma

Guillaume Borios

Nicholas D Lupinetti

Kellie L Albert

Walker J Eagleston

Anders M Holtsberg

Pulah J Shah

Kayur Dushyant Patel

Thomas Deselaers

Aya Siblini

Ron C Santos

Ali-Amir Aldan

Yang Zhao

Matthias Dantone

Martin Lindberg

Guangyu Zhong

Chen Ye

Benjamin P Englert

Ngoc Hong Pham

George William

Francisco Alvaro Munoz

Adrian Zumbrunnen

Siyang Tang

Sudhakar Valluru

Siva Kiran V Yellamraju

Adam H Bradford

Jonathan I Mccormack

Xishuo Liu

Sebastien V Marineau-mes

Sebastien V Marineau-Mes

Adam Huff Bradford

Mallika Priya Khullar

Rajen Chatterjee

Amittai Axelrod

Jennifer Pon Chen

The present disclosure generally relates to methods and user interfaces for managing visual content at a computer system. In some embodiments, methods and user interfaces for managing visual content in media are described. In some embodiments, methods and user interfaces for managing visual indicators for visual content in media are described. In some embodiments, methods and user interfaces for inserting visual content in media are described. In some embodiments, methods and user interfaces for identifying visual content in media are described. In some embodiments, methods and user interfaces for translating visual content in media are described. In some embodiments, methods and user interfaces for translating visual content in media are described. In some embodiments, methods and user interfaces for managing user interface objects for visual content in media are described.

User interfaces for managing visual content in media

User interfaces for controlling media capture settings are described, including user interfaces for controlling capture of media with associated depth information (e.g., for applying simulated depth-of-field effects), controlling media capture settings with multiple input types, controlling zoom settings for media capture (e.g., conditionally displaying a secondary preview at a different zoom level), capturing and viewing media using internal and external media storage, and controlling an indicator for level capture guidance.

User interfaces for controlling media capture settings

The present disclosure generally relates to user interfaces for managing recording space for visual media. A computer system displays a camera preview and a recording space affordance that, when selected, initiates performing an operation associated with recording space available for recording media captured by the one or more cameras.

Camera user interface with recording space management

The present disclosure generally relates to methods and user interfaces for managing visual content at a computer system. In some embodiments, methods and user interfaces for managing visual content in media are described. In some embodiments, methods and user interfaces for managing visual indicators for visual content in media are described. In some embodiments, methods and user interfaces for inserting visual content in media are described. In some embodiments, methods and user interfaces for identifying visual content in media are described. In some embodiments, methods and user interfaces for translating visual content in media are described.

Devices, methods, and non-transitory program storage devices are disclosed herein to provide improved region of interest (ROI) tracking, image framing, and distortion correction for wide field of view (FOV) video image streams. The techniques disclosed may be configured, such that the image framing decisions made over the course of a captured wide FOV video image stream are able to be panned smoothly and seamlessly transition between framing a narrower portion of a wide angle camera's FOV to framing a wider portion of the wide angle camera's FOV (or vice versa), e.g., depending on the composition and movement of relevant subjects in the captured scene. The techniques disclosed herein may also be used to perform any distortion correction desired on the framed image portions in the output video image stream, e.g., based on the image portions' FOVs and/or the locations of the portions within the original wide FOV video image stream.

Cinematic image framing for wide field of view (FOV) cameras

The subject technology determines input parameters and an output format of algorithms for a particular functionality provided by an electronic device. The subject technology determines an order of the algorithms for performing the particular functionality based on temporal dependencies of the algorithms, and the input parameters and the output format of the algorithms. The subject technology generates a graph based on the order of the algorithms, the graph comprising a set of nodes corresponding to the algorithms, each node indicating a particular processor of the electronic device for executing an algorithm. Further, the subject technology executes the particular functionality based on performing a traversal of the graph, the traversal comprising a topological traversal of the set of nodes and the traversal being based on a score indicating whether selection of a particular node for execution over another node enables a greater number of processors to be utilized at a time.

Scheduling heterogeneous execution on heterogeneous hardware

This disclosure pertains to techniques for dynamically adapting image capturing techniques, e.g., based on shutter activation frequency, to improve camera responsiveness. One such technique is a method, comprising: receiving a first capture request; in response to receiving the first capture request, using a first capturing technique to capture a first set of images based on an image capture sequence, the image capture sequence comprising one or more images; generating a first image based on the captured first set of images; receiving a second capture request within a first time window from the first capture request, wherein a duration of the first time window is based, at least in part, on a length of time needed to capture the one or more images of the image capture sequence using the first capturing technique; in response to the received second capture request, using a second capturing technique to capture a second set of images, wherein the second capturing technique is different from the first capturing technique; and generating a second image based on the captured second set of images.

Dynamic image processing based on frequency of camera shutter activation

Displaying wide-gamut images as intended on color-managed wide-gamut display systems while rendering a visually consistent image when rendered on targeted narrow-gamut display systems (regardless of whether the narrow-gamut displays are color-managed). Images represented in accordance with this disclosure are referred to as a dual-target images (DTI): one target being the image's original wide-gamut color space, the other target being a specified narrow-gamut color space. The novel representational scheme retains narrow-gamut rendering for those colors in a wide-gamut image that are within the targeted narrow-gamut color space, transitioning to wide-gamut rendering for those colors in the wide-gamut image that are outside the targeted narrow-gamut color space. This approach minimizes pixel clipping when rendering a wide-gamut image for a narrow-gamut display, while allowing the original wide-gamut pixel values to be recovered when rendering for a wide-gamut display.

Dual-target image color rendering

An image is compressed according to a compression ratio selected based on a compression metric. In one embodiment, the compression metric is based on image characteristics indicative of the amount of image noise in an image, such as gain and lux. Greater compression ratios are used for image having compression metrics indicating a higher degree of noise. Because an image with higher image noise levels already has a reduced visual quality, the impact of higher compression is less significant as compared to the impact of compression on images having low image noise. In an embodiment, an image is divided into a number of regions, for each of which a compression metric and corresponding compression ratio is determined, so that regions of the image having high image noise may be compressed more than regions having low image noise.

Dynamic compression ratio selection

Embodiments of the present invention provide techniques for efficiently coding video data during circumstances of network congestion, or instances when a decoder is unable to handle incoming video at the intended frame rate. A video coder may code frames of a video sequence according to motion estimation prediction in which each frame of the video sequence is constrained to be coded as one of an I-frame or a P-frame. The video coder may determine for each coded P-frame, a distance from the respective P-frame and a most-recently coded reference frame, and if the distance matches a predetermined threshold distance, the respective P-frame may be marked as a reference frame. The coded video data of the I-frame(s), the reference P-frames and the non-reference P-frames may be transmitted in a channel.

High quality seamless playback for video decoder clients

Systems, methods, and computer readable media for stabilizing video frames based on information from a motion sensor are described. In general, digital video stabilization techniques are disclosed for generating and applying image-specific transformations to individual frames (images) in a video sequence after, rather than before, the image has been captured. The transformations may be used to counter-balance or compensate for unwanted jitter occurring during video capture due to, for example, a person's hand shaking.

Motion-based video stabilization

Growing community of inventors

Palo Alto, CA, United States of America

Brandon J Corey