Microsoft Technology Licensing, LLC

Meta Platforms Technologies, LLC

Facebook Technologies, LLC

Roger Ibars Martinez

Chris Rojas

Oscar E Murillo

Pol Pla I Conesa

Jean-Louis Villecroze

Bryan Sparks

Nema Rao

Emron Jackson Henry

Etienne Pinchon

Jennifer Lynn Spurlock

Aaron S Faucher

Nathan Aschenbach

Gerrit Hendrik Hofmeester

Vikram Tank

Eric Ma

Joseph N Bravate

Ian Joseph Roth

Johnathon Simmons

Christopher Alan Baker

A non-transitory computer-readable storage medium including instructions for distributing tasks between a handheld intermediary processing device (HIPD) and communicatively coupled devices is disclosed. The instructions cause one or more processors to, while a HIPD and a head-wearable device are communicatively coupled and share operational data for performing one or more computational tasks, identify one or more back-end tasks and one or more front-end tasks associated with performing the one or more computational tasks. The instructions further cause performance of the one or more back-end tasks at the HIPD including updating the operational data to create updated operational data. The instructions further cause performance of the one or more front-end tasks at the head-wearable device using the updated operational data such that a representation based on the one or more computational tasks is presented to the user by the head-wearable device.

Intermediary device for offloading processing operations for an artificial-reality system and for enabling interactions and input paradigms, and systems and methods of use thereof

Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in the multiple modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.

Artificial reality input using multiple modalities

Embodiments described herein disclose methods and systems directed to input mode selection in artificial reality. In some implementations, various input modes enable a user to perform precise interactions with a target object without occluding the target object. Some input modes can include rays that extend along a line that intersects an origin point, a control point, and an interaction point. An interaction model can specify when the system switches between input modes, such as modes based solely on gaze, using long or short ray input, or with direct interaction between the user's hand(s) and objects. These transitions can be performed by evaluating rules that take context factors such as whether a user's hands are in view of the user, what posture the hands are in, whether a target object is selected, and whether a target object is within a threshold distance from the user.

Artificial reality multi-modal input switching model

A virtual reality headset system having a region configured to change its opacity is disclosed. The virtual reality headset system is configured to provide an immersive experience, but also to allow a user to see at least some portion of the outside world, at least some of the time. The headset has a casing that partially surrounds a display. The casing has an opening configured to receive the user's face. The casing has a region between the display and the user's face configured to change a degree of opacity. The region may be a window located in a non-front facing or lateral side of the casing.

Virtual reality headset

Growing community of inventors

Seattle, WA, United States of America

Roger Ibars Martinez