Apple Inc.

Felipe Bacim De Araujo E Silva

Seung Wook Kim

Karlin Y Bark

Pavel V Dudrenov

Edwin Iskandar

Alfred B Huergo Wagner

William A Sorrentino, Iii

Sean Boland Kelly

Ping-Yen Chou

Zachary D Corley

Karol E Czaradzki

Chaohao Wang

Dan C Lelescu

Gary Lee Vondran, Jr

ByoungSuk Kim

Yi Huang

Michael J Rockwell

Thomas S Hulbert

Blake M Coughenour

Stuart John Wood

Yi-Pai Huang

Stuart J Wood

Dana F Segler, Jr

Sebastien Eric Gilles Leprince

Jonathan P Ive

Alan C Dye

Stephen Olivier Lemay

Wan Si Wan

Kurt R Stiehl

Peter D Anton

Richard D Lyons

Sheng Zhang

Yang Li

Jean-Pierre M Mouilleseaux

Hao Chen

Rong Liu

Yung-Yu Hsu

Gregg S Suzuki

Daniel K Boothe

Noah Denis Bedard

Pavel Pivonka

Kristi E S Bauerly

Daniel De Rocha Rosario

Samuel B Schaevitz

Bosheng Zhang

Christopher J Verplaetse

Yue Ma

Gilles M Cadet

Matthew J Allen

Pretesh A Mascarenhas

Clark D Della Silva

Menelik Baye Yimam

Sueng Wook Kim

Lee A Szuba

Ronak J Shah

Catherine N Boulanger

Avi S Khemani

A method includes displaying a dynamic graphical element in a first state and graphical content in a second state. While displaying the graphical content in the second state, the graphical content is displayed in the second state and the dynamic graphical element is displayed in a third state, where the third state is different from the first state, and the third state is based on detected motion.

Methods and user interfaces based on motion

An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The lenticular lenses may be configured to enable stereoscopic viewing of the display such that a viewer perceives three-dimensional images. The display may have a number of independently controllable viewing zones. A eye and/or head tracking system may use a camera to capture images of a viewer of the display. Control circuitry in the electronic device may use the captured images from the eye and/or head tracking system to determine which viewing zones are occupied by the viewer's eyes. The control circuitry may disable or dim viewing zones that are not occupied by the viewer's eyes in order to conserve power. An unoccupied viewing zone and an adjacent, occupied viewing zone may display the same image to increase sharpness in the display.

Displays with viewer tracking

A computing system displays, via a first display generation component, a first computer-generated environment and concurrently displays, via a second display generation component: a visual representation of a portion of a user of the computing system who is in a position to view the first computer-generated environment via the first display generation component, and one or more graphical elements that provide a visual indication of content in the first computer-generated environment. The computing system changes the visual representation of the portion of the user to represent changes in an appearance of the user over a respective period of time and changes the one or more graphical elements to represent changes in the first computer-generated environment over the respective period of time.

Devices, methods, and graphical user interfaces for providing computer-generated experiences

An electronic device may include a stereoscopic display with a plurality of lenticular lenses that extend across the length of the display. The lenticular lenses may be configured to enable stereoscopic viewing of the display such that a viewer perceives three-dimensional images. The display may have different viewing zones that account for horizontal parallax as a viewer moves horizontally relative to the display. The display may be dimmed globally, blurred, and/or composited with a default image based on the detected vertical position of the viewer. The display may render content that compensates for the real-time vertical positions of multiple viewers.

Displays with viewer tracking for vertical parallax correction

An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The display may include ray tracing circuitry that is configured to, using ray tracing, a three-dimensional image, and deflection measurements for the array of pixels, output a display calibration map that includes, for each pixel in the array of pixels, a corresponding location on a two-dimensional image. The display may also include pixel mapping circuitry configured to, using the display calibration map from the ray tracing circuitry, map the two-dimensional image to respective pixels on the array of pixels to obtain pixel data for the array of pixels.

Ray tracing in a display

An electronic device may include an ambient light sensor that measures ambient light color, a projector that projects ambient-light-matching illumination onto a surface, a user input device such as a microphone that gathers user input, and a position sensor that measures a position of the surface, a user, and/or a real-world object relative to the device. The ambient-light-matching illumination may create illuminated regions on the surface that blend in with the surrounding ambient light. Certain pixels in the projector may be turned off to create one or more unilluminated regions within the illuminated regions. The unilluminated regions may form apparent shadows. Control circuitry in the electronic device may adjust characteristics of the unilluminated regions by dynamically adjusting which pixels are turned off based on voice input, gesture input, and/or other sensor data.

Electronic devices with projectors controlled by voice input

A spatial light system that may, for example, be used to project image content onto surfaces of a room. The system may include two or more projection units for emitting light onto surfaces within a room. The system may include a controller and two or more projection units, each module including an LED array, an array of light pipes, and a condenser lens. Two or more projection units may be connected to a flexible strip that provides power and data (e.g., serial data) to the projection units, a composable light emitter unit, or a bulb-form projection system. Two or more flex strips or composable light emitter units may be connected together to provide a serially-connected, flexible modular architecture for spatial light systems that allow the projection units to be conformed to a variety of configurations and shapes.

Augmented reality room projector

In some implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, a rendering system, and a display. The method includes determining a first rendering characteristic based on a first viewing angle of a first individual with respect to the display. The method includes determining a second rendering characteristic based on a second viewing angle of a second individual with respect to the display. The first rendering characteristic is different from the second rendering characteristic. The method includes generating, via the rendering system, first display content data according to the first rendering characteristic, and generating, via the rendering system, second display content data according to the second rendering characteristic. The first display content data is associated with the first viewing angle. The second display content data is associated with the second viewing angle.

Generating and displaying content based on respective positions of individuals

A spatial light system that may, for example, be used to project image content onto surfaces of a room. The system may include two or more projection units for emitting light onto surfaces within a room. The system may include a controller and two or more projection units, each module including an LED array, an array of light pipes, and a condenser lens. Two or more projection units may be connected to a flexible strip that provides power and data (e.g., serial data) to the projection units. Two or more flex strips may be connected together. The flex strips provide a serially-connected, flexible modular architecture for spatial light systems that allow the projection units to be conformed to a variety of configurations and shapes.

Spatial light system

The present disclosure generally relates to controlling electronic devices. In some examples, the electronic device uses gaze information to activate a digital assistant. In some examples, the electronic device uses gaze information to identify an external device on which to act. In some examples, the electronic device provides an indication that distinguishes between different speakers.

Device control using gaze information

Novel viewpoints may be rendered using arrays of camera images with synthesized viewpoints. Different viewpoints of a scene may be captured via image sensors. Depth information may be determined for the captured viewpoints. An array of images may be generated that includes synthetic viewpoints generated from the captured viewpoints and depth information. A request to render a novel viewpoint may be received. Then novel viewpoint may be rendered using the array of images with synthetic viewpoints.

Synthesized camera arrays for rendering novel viewpoints

Various implementations disclosed herein include devices, systems, and methods for displaying image data based on ambient light. In some implementations, a device includes an image sensor, an environmental sensor, a display, a non-transitory memory and one or more processors. In some implementations, a method includes capturing, via the image sensor, first image data that corresponds to a body part of a user of the device. In some implementations, the method includes detecting, via the environmental sensor, environmental data that indicates a current ambient light condition of a physical environment surrounding the device. In some implementations, the method includes generating second image data by modifying the first image data based on a function of the current ambient light condition and a threshold ambient light condition detected during enrollment. In some implementations, the method includes displaying the second image data on the display.

Displaying image data based on ambient light

An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The display may have a number of independently controllable viewing zones. Each viewing zone displays a respective two-dimensional image. Each eye of the viewer may receive a different one of the two-dimensional images, resulting in a perceived three-dimensional image. The electronic device may include display pipeline circuitry that generates and processes content to be displayed on the lenticular display. Content generating circuitry may initially generate content that includes a plurality of two-dimensional images, each two-dimensional image corresponding to a respective viewing zone. The two-dimensional images may be processed by per-view processing circuitry. Pixel mapping circuitry may be used to map the two-dimensional images to the array of pixels in the lenticular display. After pixel mapping, additional panel-level processing may be performed.

Content processing in a display pipeline

An electronic device, while the electronic device is worn over a predefined portion of the user's body, displays, via a display generation component arranged on the electronic device opposite the predefined portion of the user's body, a graphical representation of an exterior view of a body part that corresponds to the predefined portion of the user's body. The electronic device detects a change in position of the electronic device with respect to the predefined portion of the user's body. The electronic device, in response to detecting the change in the position of the electronic device with respect to the predefined portion of the user's body, modifies the graphical representation of the exterior view of the body part that corresponds to predefined portion of the user's body in accordance with the detected change in position of the electronic device with respect to the predefined portion of the user's body.

Systems, methods, and graphical user interfaces for updating display of a device relative to a user's body

Growing community of inventors

Santa Clara, CA, United States of America

Felipe Bacim De Araujo E Silva