Apple Inc.

Mark K Hauenstein

Jeffrey Traer Bernstein

Julian K Missig

Joseph A Malia

Matthaeus Krenn

Matan Stauber

Linda L Dong

Praveen Sharma

Amir Hoffnung

Lukas Robert Tom Girling

Marek A Bereza

Stephen Olivier Lemay

Patrick L Coffman

Raymond S Sepulveda

Marcos Alonso Ruiz

William D Lindmeier

Adi Berenson

Marek Bereza

A computer system displays, in a first viewing mode, a simulated environment that is oriented relative to a physical environment of the computer system. In response to detecting a first change in attitude, the computer system changes an appearance of a first virtual user interface object so as to maintain a fixed spatial relationship between the first virtual user interface object and the physical environment. The computing system detects a gesture. In response to detecting a second change in attitude, in accordance with a determination that the gesture met mode change criteria, the computer system transitions from displaying the simulated environment in the first viewing mode to displaying the simulated environment in a second viewing mode. Displaying the virtual model in the simulated environment in the second viewing mode includes forgoing changing the appearance of the first virtual user interface object to maintain the fixed spatial relationship.

Systems, methods, and graphical user interfaces for interacting with augmented and virtual reality environments

The present disclosure generally relates to displaying and editing an image with depth information. In response to an input, an object in the image having a one or more elements in a first depth range is identified. The identified object is then isolated from other elements in the image and displayed separately from the other elements. The isolated object may then be utilized in different applications.

Displaying and editing images with depth information

The present disclosure generally relates to using avatars and image data for enhanced user interactions. In some examples, user status dependent avatars are generated and displayed with a message associated with the user status. In some examples, a device captures image information to scan an object to create a 3D model of the object. The device determines an algorithm for the 3D model based on the capture image information and provides visual feedback on additional image data that is needed for the algorithm to build the 3D model. In some examples, an application's operation on a device is restricted based on whether an authorized user is identified as using the device based on captured image data.

Image data for enhanced user interactions

A computer system displays a representation of a previously-captured media item, which includes or is associated with depth information corresponding to a physical environment in which the media item was captured. While displaying the representation of the media item, the system receives, via one or more input devices, one or more inputs corresponding to a request to display a representation of a measurement corresponding to a respective portion of the physical environment captured in the media item, and, in response, the system displays the representation of the measurement over at least a portion of the representation of the media item that corresponds to the respective portion of the physical environment, based on the depth information, and a label corresponding to the representation of the measurement that describes the measurement based on the depth information.

Systems, methods, and graphical user interfaces for modeling, measuring, and drawing using augmented reality

An electronic device with a touch-sensitive display displays an electronic calendar and detects a hand-drawn input on the touch-sensitive display. The hand-drawn input extends over a vertical portion, less than all, of an area corresponding to a first day in the calendar. In response to detecting the hand-drawn input, the device displays, over the vertical portion of the first day, one or more graphics that correspond to the hand-drawn input. While displaying the graphics, the device detects an input that corresponds to a request to create an event in the electronic calendar. In response, the device creates, in the first day in the electronic calendar, an event with a start time and an end time, wherein the start time and the end time of the event are in accordance with the first day that the hand drawn input extends over.

Devices and methods for creating calendar events based on hand-drawn inputs at an electronic device with a touch-sensitive display

A first device sends a request to a second device to initiate a shared annotation session. In response to receiving acceptance of the request, a first prompt to move the first device toward the second device is displayed. In accordance with a determination that connection criteria for the first device and the second device are met, a representation of a field of view of the camera(s) of the first device is displayed in the shared annotation session with the second device. During the shared annotation session, one or more annotations are displayed via the first display generation component and one or more second virtual annotations corresponding to annotation input directed to the respective location in the physical environment by the second device is displayed via the first display generation component, provided that the respective location is included in the field of view of the first set of cameras.

Devices, methods, and graphical user interfaces for depth-based annotation

A computer system while displaying an augmented reality environment, concurrently displays: a representation of at least a portion of a field of view of one or more cameras that includes a physical object, and a virtual user interface object at a location in the representation of the field of view, where the location is determined based on the respective physical object in the field of view. While displaying the augmented reality environment, in response to detecting an input that changes a virtual environment setting for the augmented reality environment, the computer system adjusts an appearance of the virtual user interface object in accordance with the change made to the virtual environment setting and applies to at least a portion of the representation of the field of view a filter selected based on the change made to the virtual environment setting.

The present disclosure generally relates to displaying and editing image with depth information. Image data associated with an image includes depth information associated with a subject. In response to a request to display the image, a first modified image is displayed. Displaying the first modified image includes displaying, based on the depth information, a first level of simulated lighting on a first portion of the subject and a second level of simulated lighting on a second portion of the subject. After displaying the first modified image, a second modified image is displayed. Displaying the second modified image includes displaying, based on the depth information, a third level of simulated lighting on the first portion of the subject and a fourth level of simulated lighting on the second portion of the subject.

An electronic device, while displaying a first user interface, detects an input for an input object, detects that first hover proximity criteria are met by the input object, and displays first visual feedback. While displaying the first visual feedback, the device detects a change in a current value of a hover proximity parameter of the input object and that second hover proximity criteria are met by the input object after the change. In response to detecting that the second hover proximity criteria are met, the device displays second visual feedback, distinct from the first visual feedback.

Devices, methods, and graphical user interfaces for interacting with a position indicator within displayed text via proximity-based inputs

While displaying playback of a first portion of a video in a video playback region, a device receives a request to add a first annotation to the video playback. In response to receiving the request, the device pauses playback of the video at a first position in the video and displays a still image that corresponds to the first, paused position of the video. While displaying the still image, the device receives the first annotation on a first portion of a physical environment captured in the still image. After receiving the first annotation, the device displays, in the video playback region, a second portion of the video that corresponds to a second position in the video, where the first portion of the physical environment is captured in the second portion of the video and the first annotation is displayed in the second portion of the video.

System and method of moving selected content is disclosed. In response to detecting a first portion of an input that activates a move operation for selected first content, a copy of at least a portion of the first content is displayed in a container object, and the container object is moved from a first placement location to a second placement location relative to a characteristic location of the contact(s) on the touch-screen display. After the movement from the first placement location to the second placement location relative to the characteristic location of the one or more contacts, the container object moves in accordance with movement of the one or more contacts while the container object is maintained at the second placement location relative to the characteristic location of the one or more contacts as the one or more contacts move across the touch-screen display.

Devices, methods, and graphical user interfaces for moving user interface objects

A computer system displays a first previously captured media object including one or more first images, wherein the first previously captured media object was recorded and stored with first depth data corresponding to a first physical environment captured in each of the one or more first images. In response to a first user request to add a first virtual object to the first previously captured media object, the computer system displays the first virtual object over at least a portion of a respective image in the first previously captured media object, wherein the first virtual object is displayed with at least a first position or orientation that is determined using the first depth data that corresponds to the respective image in the first previously captured media object.

An electronic device with a touch-sensitive surface, a display, one or more first sensors to detect proximity of an input object above the touch-sensitive surface and one or more second sensors to detect intensity of contact displays a user interface object at a first location. While displaying the user interface object, the device detects a first portion of an input at the first location of the user interface object while the input object meets hover criteria. In response, the device dynamically changes an appearance of the user interface object in accordance with a current hover proximity parameter of the input object. Afterwards, the device detects a second portion of the input at an initial contact location that corresponds to the first location; and, in response, dynamically changes the appearance of the user interface object in accordance with a current intensity of a contact by the input object.

Devices, methods, and user interfaces for interacting with a position indicator within displayed text via proximity-based inputs

A computer system captures, via one or more cameras, information indicative of the physical environment, including respective portions of the physical environment that are in a field of view. The respective portions of the physical environment include a plurality of primary features of the physical environment and secondary features of the physical environment. After capturing the information indicative of the physical environment, the system displays a user interface, including concurrently displaying graphical representations of the plurality of primary features that are generated with a first level of fidelity to the corresponding plurality of primary features of the physical environment, and one or more graphical representations of secondary features that are generated with a second level of fidelity to the corresponding one or more secondary features of the physical environment, where the second level of fidelity is lower than the first level of fidelity.

Growing community of inventors

San Francisco, CA, United States of America

Mark K Hauenstein