Apple Inc.

Yahoo! Inc.

Excalibur Ip, LLC

Microsoft Technology Licensing, LLC

Oath Inc.

Rahul Nair

Devin William Chalmers

Simon P King

Marc Eliot Davis

Christopher William Higgins

Avi Bar-Zeev

Thomas G Salter

Mor Naaman

Christopher T Paretti

Luis R Deliz Centeno

Shane Patrick Ahern

Carrie Burgener

Alexis Henri Palangie

Ryan S Burgoyne

Joseph James O'Sullivan

Timothy Robert Oriol

Golnaz Abdollahian

Gregory Lutter

Niranjan Manjunath

Gregory Patrick Lane Lutter

Yutaka Yokokawa

Giancarlo Yerkes

Christopher T Eubank

Bruno M Sommer

William D Lindmeier

Stephen E Pinto

Sandy Wong

Michael Ching

Kirill Kalinichev

Frank Angermann

Ioana Negoita

Shubha Umesh Nabar

Chris W Higgins

Brian Warren Temple

Bart Colin Trzynadlowski

Jonathan C Moisant-Thompson

Jun Yin

Xavier Legros

Dhruv Aditya Govil

Ori Zaltzman

Kevin L Haas

Avi Bar-zeev

Lilli Ing-Marie Jonsson

Jeannie Hui-I Yang

Srinivasan Badrinarayanan

Wei Mu

Chris Theodore Kalaboukis

Mehmet Iyigun

Arun Upadhyaya Kishan

Ronald Martinez

Anselm Grundhoefer

Athellina Athsani

Jae Hwang Lee

Ranjit Desai

David H Bloom

Iulian Doroftei Calinov

Tristan Anthony Brown

Paresh J Maisuria

Sandeep Prabhakar

Samarth Harish Shah

Jihad Tafas

Duane R Valz

Paul Hammond

Simon Willison

Tom Coates

Alexander B Jaffe

Mark Allan Bellon

Gabriel Knezek

Tapan Ansel

Zachary Sandburg Holmes

Taofiq Ezaz

Kai-Lun Hsu

James Kennyth Truckle

Manuel C Clement

This relates generally to systems and methods for changing tinting levels of one or more displays, and more particularly to changing tinting levels of one or more displays of an electronic device based on the satisfaction of one or more criteria. In some examples, an electronic device (e.g., an HMD) presents content in a first manner including a first tint. In some examples, in response to determining that one or more criteria are satisfied, the electronic device presents the content in a second manner and changes the tinting level from the first tinting level to the second tinting level. Changing the tinting level and the presentation of the content allows a user to seamlessly see and/or focus on different objects in the physical environment without having to manually change the tint of the display and/or without having to manually change the presentation of the content presented on the display.

Changing tinting levels of one or more displays

In one implementation, a method for improving comfortability of virtual content during head roll motions includes: determining a scene roll origin value for an XR environment; detecting ahead pose with pose roll value; when a difference between the scene roll origin value and the pose roll value is less than a first angular threshold, presenting virtual content within the XR environment in a first presentation mode, wherein the virtual content is presented with a first content roll value in the first presentation mode based the pose roll value; and when the difference between the scene roll origin value and the pose roll value is not less than the first angular threshold, presenting the virtual content within the XR environment in a second presentation mode, wherein the virtual content is presented with a second content roll value in the second presentation mode based on the scene roll origin value.

Method and device for improving comfortability of virtual content

Various implementations disclosed herein include devices, systems, and methods that present virtual content based on detecting a reflective object and determining a three-dimensional (3D) position of the reflective object in a physical environment. For example, an example process may include obtaining sensor data in a physical environment that includes one or more objects. The method may further include detecting a reflection of a first object of the one or more objects upon a reflective surface of a reflective object based on the sensor data. The method may further include determining a 3D position of the reflective object in the physical environment based on determining a 3D position of the reflection of the first object. The method may further include presenting virtual content in a view of the physical environment. The virtual content may be positioned at a 3D location based on the 3D position of the reflective object.

Content transformations based on reflective object recognition

In an exemplary process for interacting with user interface objects using an eye gaze, a placement point for a selected object is designated at a first position based on a gaze position. In response to a user input, the placement point is moved to a second position that is not based on the gaze position, and the object is placed at the second position.

Gaze-based user interactions

Various implementations provide a method for determining how a second user prefers to be depicted/augmented in a first user's view of a multi-user environment in a privacy preserving way. For example, a method may include determining that a physical environment includes a second device, where a second user associated with the second device is to be depicted in a view of a three-dimensional (3D) environment. The method may further include determining position data indicative of a location of the second device relative to the first device. The method may further include sending the position data indicative of the location of the second device relative to the first device, to an information system (e.g., a user preference system). The method may further include receiving a user preference setting associated with the second user for depicting or augmenting the second user in the 3D environment from the information system.

Privately sharing user preferences

In accordance with some embodiments, exemplary processes for changing (e.g., non-linearly) the size of a virtual object are described.

Techniques for resizing virtual objects

A method performed by an audio system comprising a headset. The method sends a playback signal containing user-desired audio content to drive a speaker of the headset that is being worn by a user, receives a microphone signal from a microphone that is arranged to capture sounds within an ambient environment in which the user is located, performs a speech detection algorithm upon the microphone signal to detect speech contained therein, in response to a detection of speech, determines that the user intends to engage in a conversation with a person who is located within the ambient environment, and, in response to determining that the user intends to engage in the conversation, adjusts the playback signal based on the user-desired audio content.

Method and system for adjusting sound playback to account for speech detection

Various implementations disclosed herein include devices, systems, and methods for displaying a visual indication of audibility of an audible signal. In various implementations, a device includes a display, an audio sensor, a processor and a non-transitory memory. In various implementations, a method includes receiving, via the audio sensor, an audible signal and converting the audible signal to electronic signal data. In various implementations, the method includes obtaining environmental data that indicates audio response characteristics of a physical environment in which the device is located. In various implementations, the method includes displaying, on the display, an indicator that indicates a distance from a source of the audible signal at which the audible signal is audible. In some implementations, the distance is based on an amplitude associated with the electronic signal data and the audio response characteristics of the physical environment.

Visual indication of audibility

A method is performed at an electronic device with a one or more processors, a non-transitory memory, and a display. The method includes presenting, on the display, a plurality of objects including a first object and a second object. The method includes obtaining a first display priority value that is associated with the first object. The method includes prioritizing the first object over the second object based on a function of the first display priority value. The method includes, in response to determining that each of the first object and the second object satisfies an offscreen criterion, displaying, on the display, a first offscreen indicator that is associated with the first object according to the prioritization.

Displaying a prioritized offscreen indicator

One or more techniques for managing virtual objects between one or more displays are described. In accordance with some embodiments, exemplary techniques for displaying a virtual object are described.

Managing devices having additive displays

In one implementation, a method of authenticating a user is performed by a first device including a camera, an eye tracker, one or more processors, and non-transitory memory. The method includes obtaining, via the camera, an image of a physical environment. The method includes detecting, in the image of the physical environment, a second device. The method includes determining, using the eye tracker, a gaze of a user. The method includes determining that the gaze of the user is directed to the second device. The method includes, in response to determining that the gaze of the user is directed to the second device, transmitting authentication credentials to the second device.

Method and device for automatic authentication

Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.

Spatial audio navigation

In one implementation, a method of displaying a task list is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes obtaining, using the image sensor, a video stream of a physical environment. The method includes displaying, on the display in association with the physical environment, a task list including a plurality of task elements respectively associated with a plurality of tasks, wherein the plurality of task elements includes a first task element associated with a first task and a second task element associated with a second task. The method includes detecting, in the video stream of the physical environment, completion of the first task. The method includes, in response to detecting completion of the first task, changing display of the first task element.

Method and device for displaying a task list

In an exemplary technique, audio information responsive to received input is provided. While providing the audio information, one or more conditions for stopping the provision of audio information are detected, and in response, the provision of the audio information is stopped. After stopping the provision of the audio information, if the one or more conditions for stopping the provision of audio information have ceased, then resumed audio information is provided, where the resumed audio information includes a rephrased version of a previously provided segment of the audio information.

Providing audio information with a digital assistant

Various implementations disclosed herein include devices, systems, and methods that present virtual content based on detecting a reflective object and determining a three-dimensional (3D) position of the reflective object in a physical environment. For example, an example process may include obtaining sensor data (e.g., image, sound, motion, etc.) from a sensor of an electronic device in a physical environment that includes one or more objects. The method may further include detecting a reflective object amongst the one or more objects based on the sensor data. The method may further include determining a 3D position of the reflective object in the physical environment (e.g., where the plane of the mirror is located). The method may further include presenting virtual content in a view of the physical environment. The virtual content may be positioned at a 3D location based on the 3D position of the reflective object.

Growing community of inventors

Oakland, CA, United States of America

Rahul Nair