Apple Inc.

Luis R Deliz Centeno

Avi Bar-Zeev

Rahul Nair

Devin William Chalmers

Joseph P Cerra

Alexis Henri Palangie

Kevin Lee

Ryan S Burgoyne

Timothy Robert Oriol

Connor A Smith

Gregory Lutter

Allessandra E McGinnis

Jack R Dashwood

Stephen Olivier Lemay

Paul Xiaopeng Wang

Giancarlo Yerkes

Alex Joseph Lehmann

Allison W Dryer

Chang Zhang

Stephen E Dey

Benjamin S Phipps

Madeleine S Cordier

Bruno M Sommer

David H Bloom

William D Lindmeier

Anshu Kameswar Chimalamarri

Benjamin R Blachnitzky

Tianjia Sun

Nicolai Philip Georg

Jian H Li

Brian Warren Temple

Yuhao Pan

Tucker Bull Morgan

Paulo R Jansen Dos Reis

Hongcheng Sun

Jonathan C Atler

Yutaka Yokokawa

Avi Bar-zeev

Lilli Ing-Marie Jonsson

Peter Burgner

Kevin Z Lo

Nahckjoon Kim

Jessica Trinh

Ashwin K Vijay

Guilherme Klink

Leanid Vouk

Alhad A Palkar

Minhazul Islam

Joon-Sup Han

Sang E Lee

Paul N DuMontelle

Brandon K Schmuck

Manuel C Clement

Robert T Held

Andrew Muehlhausen

A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.

Controlling devices using a wearable device

This relates generally to systems and methods for changing tinting levels of one or more displays, and more particularly to changing tinting levels of one or more displays of an electronic device based on the satisfaction of one or more criteria. In some examples, an electronic device (e.g., an HMD) presents content in a first manner including a first tint. In some examples, in response to determining that one or more criteria are satisfied, the electronic device presents the content in a second manner and changes the tinting level from the first tinting level to the second tinting level. Changing the tinting level and the presentation of the content allows a user to seamlessly see and/or focus on different objects in the physical environment without having to manually change the tint of the display and/or without having to manually change the presentation of the content presented on the display.

Changing tinting levels of one or more displays

In some embodiments, the present disclosure includes techniques and user interfaces for interacting with graphical user interfaces using gaze. In some embodiments, the present disclosure includes techniques and user interfaces for repositioning virtual objects. In some embodiments, the present disclosure includes techniques and user interfaces for transitioning modes of a camera capture user interface.

Devices, methods, for interacting with graphical user interfaces

Various implementations present a viewing session on an electronic device based on a view of an avatar (e.g., a representation of a content creator) that is based recorded positional data and the identification of an anchor in the viewing environment during the recording of content (e.g., a memory). For example, at a first device having a processor, a process may obtain recorded data (e.g., recorded user data) including recorded positional data of a user moving relative to a coordinate space of an anchor (a room or object) during a recording in a physical environment. Then the process may identify the anchor (e.g., the actual statue or the replica) in a viewing environment based on the recorded data. Then the process may present a view of a moving avatar corresponding to the user based on the recorded positional data and the identification of the anchor in the viewing environment.

User representation based on an anchored recording

Implementing a rotation-based graphical user interface may include detecting a physical object in an image; presenting the rotation-based graphical user interface in accordance with the detected physical object, wherein input to the graphical user interface corresponds to movement of the physical object; detecting a movement of the physical object; determining a characteristic of the movement of the physical object; initiating a scrolling motion through the graphical user interface in accordance with the movement characteristic satisfying a first criterion; detecting selection of a portion of the graphical user interface; and performing an action associated with the selected portion.

Rotation-based user interface

Various implementations disclosed herein include devices, systems, and methods for switching presentation of content between devices. In some implementations, a method includes obtaining information regarding an eye condition. In some implementations, the method includes determining whether a first display of a first electronic device that is presenting content satisfies a presentation criterion based on the eye condition and a characteristic of the content. In some implementations, the method includes, in accordance with a determination that the first display does not satisfy the presentation criterion, triggering a second electronic device with a second display that satisfies the presentation criterion to present the content.

Switching presentation of content between devices

A state of a multi-user communication session is saved in response to detection of an application state saving event, or a session state saving event. During runtime, application state saving events may be detected for each application executing during a session. Application state parameters are saved in response to each application state saving event, from which the application may be launched to the saved state. In response to a state saving event, the most recent application state information for each application executing in the session are collected and stored such that the multi-user communication session may be launched to the saved state, including each application executing in the session.

Automatic determination of application state in a multi-user environment

In an exemplary process for interacting with user interface objects using an eye gaze, a placement point for a selected object is designated at a first position based on a gaze position. In response to a user input, the placement point is moved to a second position that is not based on the gaze position, and the object is placed at the second position.

Gaze-based user interactions

Various implementations present a playback session on an electronic device based on a viewer's position relative to a position of an object (e.g., a representation of a content creator) during the recording of content (e.g., a memory). For example, at a first device having a processor, a process may acquire content at a first device in a physical environment including a person, the content based on sensor data of the physical environment captured via one or more sensors, determine recorded positional data including positions of the first device associated with a path of the person as the first device is moved within the physical environment during the acquiring of the content, and provide the content for playback at a second device based on the acquired sensor data and the positional data.

Content playback based on a path

Various implementations disclosed herein include devices, systems, and methods for modifying display of virtual content. In some implementations, the method is performed by an electronic device including a non-transitory memory, one or more processors, a display, an eye tracker and a movement sensor. In some implementations, the method includes displaying, via the display, virtual content. In some implementations, the method includes detecting, via the eye tracker, a movement of a gaze in a first direction. In some implementations, the method includes detecting, via the movement sensor, a movement of a head in a second direction while detecting the movement of the gaze in the first direction. In some implementations, the method includes, in accordance with a determination that the movement of the gaze in the first direction and the movement of the head in the second direction are corresponding opposing movements, modifying a display characteristic of the virtual content.

Modifying display of content based on gaze and head movement

Various implementations disclosed herein include devices, systems, and methods for presenting communication data. In various implementations, a first device associated with a first person includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes obtaining communication data associated with a second device corresponding to a second person. In some implementations, the method includes determining whether the first device and the second device are in a shared environment. In some implementations, the method includes in response to determining that the first device and the second device are not in a shared environment, displaying a representation of the second person based on the communication data associated with the second device.

Presenting communication data based on environment

In an exemplary process, a virtual object is displayed in an enhanced reality setting. A request to transfer the virtual object is received, wherein a determination is made whether a set of one or more virtual object transfer criteria is satisfied. Movement of the virtual object away from an avatar is displayed in accordance with a determination that the set of one or more virtual object transfer criteria is satisfied. Displaying movement includes determining whether a size of the virtual object satisfies a set of one or more size criteria. In accordance with a determination that the size of the virtual object satisfies the set of one or more size criteria, a reduction in the size of the virtual object is displayed. In accordance with a determination that the size of the virtual object does not satisfy the set of one or more size criteria, displaying of a reduction in the size of the virtual object is foregone.

Transferring a virtual object

In one implementation, a method of transferring the display of video content from a first location to a second location is performed at a first device including an image sensor, a first display, one or more processors, and non-transitory memory. The method includes detecting a second device in a field-of-view of the image sensor displaying video content at a first location in the physical environment on a second display. The method includes detecting a transfer trigger to display the video content at a second location in the physical environment. The method includes, in response to detecting the transfer trigger, displaying, on the first display, a transfer animation of the video content being moved from the first location to the second location.

Transfer of the display of content between devices with animation

Facilitating collaboration in a multiuser communication session includes detecting initiation of an interaction between a user of a first device and a virtual object in a multiuser communication session, where the first device and a second device are active in the multiuser communication session, and where state information is synchronized among the first device and second device in the multiuser communication session. In accordance with detecting the initiation of an interaction between the user and the virtual object, synchronization of state information is suspended by the first device, where the state information is related to the interaction between the user and the virtual object. A representation of the multiuser communication session at the first device and a representation of the multiuser communication session at the second device are inconsistent in accordance with the suspended synchronization of the state information.

Synchronization in a multiuser experience

The disclosure pertains to techniques for collaborating in a multiuser communication session, including, at a first device, receiving a request to launch a first application in a multiuser communication session with a second device; presenting an environment of the first application in the multiuser communication session; receiving, by one or more processes of the multiuser communication session, data from the first user, the data including input data and first communications data; providing, by the one or more processes, the input data to the first application; providing, by the one or more processes, the first communications data to the second device; receiving, by the one or more processes, second communications data from the second device; and presenting, by the one or more processes, the second communications data in the environment of the first application, wherein the first application is restricted from accessing the first communications data and second communications data.

Conversation privacy for third party applications

Growing community of inventors

Fremont, CA, United States of America

Luis R Deliz Centeno