Apple Inc.

David H Huang

Benjamin Hunter Boesel

Shih-Sang Chiu

Alan C Dye

Stephen Olivier Lemay

William A Sorrentino, Iii

Alexandre Da Veiga

Ieyuki Kawashima

Kristi E Bauerly

Jonathan Perron

Timothy R Pease

Jonathan P Ive

Martha Evans Hankey

Julian Jaede

Gary Ian Butcher

Peng Liu

Israel Pastrana Vicente

Jeffrey M Faulkner

Dorian D Dargan

Jordan A Cazamias

Bart Colin Trzynadlowski

Jonathan Ravasz

Robert K Molholm

Spencer H Ray

Tyson Erze

In one implementation, a method of activating a user interface element is performed at a device including an input device, an eye tracker, a display, one or more processors, and non-transitory memory. The method includes displaying, on the display, a plurality of user interface elements and receiving, via the input device, a user input corresponding to an input location. The method includes determining, using the eye tracker, a gaze location. The method includes, in response to determining that the input location is at least a threshold distance from the gaze location, activating a first user interface element at the gaze location and, in response to determining that it is not, activating a second user interface element at the input location.

Methods and systems for changing a display based on user input and gaze

In some embodiments, an electronic device emphasizes and/or deemphasizes user interfaces based on the gaze of a user. In some embodiments, an electronic device defines levels of immersion for different user interfaces independently of one another. In some embodiments, an electronic device resumes display of a user interface at a previously-displayed level of immersion after (e.g., temporarily) reducing the level of immersion associated with the user interface. In some embodiments, an electronic device allows objects, people, and/or portions of an environment to be visible through a user interface displayed by the electronic device. In some embodiments, an electronic device reduces the level of immersion associated with a user interface based on characteristics of the electronic device and/or physical environment of the electronic device.

Methods for adjusting and/or controlling immersion associated with user interfaces

Various implementations disclosed herein include devices, systems, and methods that create a 3D video that includes determining first adjustments (e.g., first transforms) to video frames (e.g., one or more RGB images and depth images per frame) to align content in a coordinate system to remove the effects of capturing camera motion. Various implementations disclosed herein include devices, systems, and methods that playback a 3D video and includes determining second adjustments (e.g., second transforms) to remove the effects of movement of a viewing electronic device relative to a viewing environment during playback of the 3D video. Some implementations distinguish static content and moving content of the video frames to playback only moving objects or facilitate concurrent playback of multiple spatially related 3D videos. The 3D video may include images, audio, or 3D video of a video-capture-device user.

Spatial video capture and replay

In an exemplary process, a set of parameters corresponding to characteristics of a physical setting of a user is obtained. Based on the parameters, at least one display placement value and a fixed boundary location corresponding to the physical setting are obtained. In accordance with a determination that the at least one display placement value satisfies a display placement criterion, a virtual display is displayed at the fixed boundary location corresponding to the physical setting.

Displaying a virtual display

Various implementations disclosed herein include devices, systems, and methods that detects user interactions with a content object of a set of views of a three-dimensional (3D) environment and provides a different set of views with a different positional constraint. For example, an example process may include associating a content object with a region of a physical environment, providing a first set of views of the physical environment, wherein the content object is displayed using a first positional constraint when included in the first set of views, detecting an interaction associated with the region of the physical environment, and in accordance with detecting the interaction, providing a second set of views of the physical environment, wherein the content object is displayed using a second positional constraint when included in the second set of views, the second positional constraint different than the first positional constraint.

Transitioning content in views of three-dimensional environments using alternative positional constraints

Growing community of inventors

San Mateo, CA, United States of America

David H Huang