Microsoft Technology Licensing, LLC

Apple Inc.

Amazon Technologies, Inc.

Telefonaktiebolaget Lm Ericsson (publ)

Other

Microsoft Corporation

Avi Bar-Zeev

Gur Kimchi

Brian C Beckman

Alex Aben-Athar Kipman

John R Lewis

Daniel Buchmueller

Rahul Nair

Amir Navot

Eyal Ofek

Devin William Chalmers

Scott M Isaacs

Bob Crocco

Fletcher R Rothkopf

Geoffrey Grant Stahl

Alexis Henri Palangie

Luis R Deliz Centeno

John Allen Tardif

Arthur Yasheng Zhang

Ray Ling Chang

Jason S Flaks

Timothy Robert Oriol

Golnaz Abdollahian

Steven Gregory Dunn

Andrew John Fuller

Jae Hwang Lee

Stephen L Lawler

Fabian Hensel

Grant H Mulliken

Scott A Green

Severan Sylvain Jean-Michel Rault

Elad Gerson

Guy Cote

Brandon William Porter

Jim Chen Chou

Kathryn Stone Perez

Hao Pan

Blaise Aguera Y Arcas

Sheng Zhang

Gurjeet S Saund

Eran Yariv

Tobias Eble

Justin A Hensley

Shao Liu

Leonard Smith, Jr

Niranjan Manjunath

Ling Su

Ryan S Burgoyne

Blaise H Aguera Y Arcas

Meir Ben-Itay

Henricus Johannes Maria Meijer

Jeffrey Neil Margolis

Alex A Kipman

Mark Stefan Grossman

Robert L Crocco, Jr

J Andrew Goossen

David A Kalinowski

Bruno M Sommer

Harjit Singh

Stephen E Pinto

Sheridan Martin Small

Frank Angermann

Holly Gerhard

Seyedkoosha Mirhosseini

Paul Meade

Nathanael D Parkhill

Lilli I Jonsson

David H Y Huang

Kenn Cartier

Duncan A K Mcroberts

Lilli Ing-Marie Jonsson

Banafsheh Jalali

Jason Szabo

Christian F Huitema

Sagi Katz

Pasquale DeMaio

Mark James Finocchio

Gonzalo Alberto Ramos

Brett David Brewer

Chia-Jean Wang

Frederik Schaffalitzky

Atishkumar Kalyan

Eric Glenn Lang

Rudy Jacobus Poot

Georg Klein

Babak Amir Parviz

Richard E Moore

Selvi Chennai

Chris Miles

Jon Vincent

Scott Henson

Elad Ben-Israel

Michael Chowning Byron

Shawn Pile

Katie Stone Perez

Selvi Chenai

Roman Ormandy

Severan Sylvain Rault

Holly E Gerhard

A display system includes a head-mounted display unit and a wake control system. The head-mounted display unit provides content to a user and is operable in a low-power state and a high-power state that consumes more power to provide the content to the user than the low-power state. The wake control system determines when to operate in the high-power state. The wake control system may assess a first wake criterion with low power, assess a second wake criterion with higher power than the first wake criterion upon satisfaction of the first wake criterion, and cause the head-mounted display unit to operate in the high-power state upon satisfaction of the second wake criterion.

Display system

Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.

Spatial audio navigation

One exemplary implementation provides an improved user experience on a device by using physiological data to initiate a user interaction for the user experience based on an identified interest or intention of a user. For example, a sensor may obtain physiological data (e.g., pupil diameter) of a user during a user experience in which content is displayed on a display. The physiological data varies over time during the user experience and a pattern is detected. The detected pattern is used to identify an interest of the user in the content or an intention of the user regarding the content. The user interaction is then initiated based on the identified interest or the identified intention.

Pupil modulation as a cognitive control signal

In an exemplary technique, audio information responsive to received input is provided. While providing the audio information, one or more conditions for stopping the provision of audio information are detected, and in response, the provision of the audio information is stopped. After stopping the provision of the audio information, if the one or more conditions for stopping the provision of audio information have ceased, then resumed audio information is provided, where the resumed audio information includes a rephrased version of a previously provided segment of the audio information.

Providing audio information with a digital assistant

The present disclosure relates to techniques for providing tangibility visualization of virtual objects within a computer-generated reality (CGR) environment, such as a CGR environment based on virtual reality and/or a CGR environment based on mixed reality. A visual feedback indicating tangibility is provided for a virtual object within a CGR environment that does not correspond to a real, tangible object in the real environment. A visual feedback indicating tangibility is not provided for a virtual representation of a real object within a CGR environment that corresponds to a real, tangible object in the real environment.

Tangibility visualization of virtual objects within a computer-generated reality environment

In one implementation, a method of transforming a sound into a virtual sound for a synthesized reality (SR) setting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a microphone, a speaker, and a display. The method includes displaying, on the display, an image representation of a synthesized reality (SR) setting including a plurality of surfaces associated with an acoustic reverberation property of the SR setting. The method includes recording, via the microphone, a real sound produced in a physical setting. The method further includes generating, using the one or more processors, a virtual sound by transforming the real sound based on the acoustic reverberation property of the SR setting. The method further includes playing, via the speaker, the virtual sound.

Method and device for sound processing for a synthesized reality setting

A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

Video pipeline

A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.

Video compression methods and apparatus

In an exemplary technique, speech input including one or more instructions is received. After the speech input has stopped, if it is determined that one or more visual characteristics indicate that further speech input is not expected, a response to the one or more instructions is provided. If it is determined that one or more visual characteristics indicate that further speech input is expected, a response to the one or more instructions is not provided.

In one implementation, a method of providing contextual computer-generated reality (CGR) digital assistant is performed at a device provided to deliver a CGR scene, the device including one or more processors, non-transitory memory, and one or more displays. The method includes obtaining image data characterizing a field of view captured by an image sensor. The method further includes identifying in the image data a contextual trigger for one of a plurality of contextual CGR digital assistants. The method additionally includes selecting a visual representation of the one of the plurality of contextual CGR digital assistants, where the visual representation is selected based on context and in response to identifying the contextual trigger. The method also includes presenting the CGR scene by displaying the visual representation of the one of the plurality of contextual CGR digital assistants, where the visual representation provides information associated with the contextual trigger.

Contextual computer-generated reality (CGR) digital assistants

This disclosure describes an unmanned aerial vehicle ('UAV') configured to autonomously deliver items of inventory to various destinations. The UAV may receive inventory information and a destination location and autonomously retrieve the inventory from a location within a materials handling facility, compute a route from the materials handling facility to a destination and travel to the destination to deliver the inventory.

Aerial vehicle delivery location

Techniques for alerting a user, who is immersed in a virtual reality environment, to physical obstacles in their physical environment are disclosed.

Detecting physical boundaries

Growing community of inventors

Redmond, WA, United States of America

Avi Bar-Zeev