Meta Platforms Technologies, LLC

Facebook Technologies, LLC

Chris Rojas

Roger Ibars Martinez

Bryan Sparks

Emron Jackson Henry

Pol Pla I Conesa

Dong Zheng

Etienne Pinchon

Jennifer Lynn Spurlock

Cheng Chang

Aaron S Faucher

Yuting Fan

Eugene Gorbatov

Nathan Aschenbach

Gerrit Hendrik Hofmeester

Christopher Alan Baker

Johnathon Simmons

Zhiqing Rao

Ian Joseph Roth

Joseph N Bravate

Eric Ma

Vikram Tank

A non-transitory computer-readable storage medium including instructions for distributing tasks between a handheld intermediary processing device (HIPD) and communicatively coupled devices is disclosed. The instructions cause one or more processors to, while a HIPD and a head-wearable device are communicatively coupled and share operational data for performing one or more computational tasks, identify one or more back-end tasks and one or more front-end tasks associated with performing the one or more computational tasks. The instructions further cause performance of the one or more back-end tasks at the HIPD including updating the operational data to create updated operational data. The instructions further cause performance of the one or more front-end tasks at the head-wearable device using the updated operational data such that a representation based on the one or more computational tasks is presented to the user by the head-wearable device.

Intermediary device for offloading processing operations for an artificial-reality system and for enabling interactions and input paradigms, and systems and methods of use thereof

Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in the multiple modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.

Artificial reality input using multiple modalities

A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the first subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

Resilient rendering for augmented-reality devices

Embodiments described herein disclose methods and systems directed to input mode selection in artificial reality. In some implementations, various input modes enable a user to perform precise interactions with a target object without occluding the target object. Some input modes can include rays that extend along a line that intersects an origin point, a control point, and an interaction point. An interaction model can specify when the system switches between input modes, such as modes based solely on gaze, using long or short ray input, or with direct interaction between the user's hand(s) and objects. These transitions can be performed by evaluating rules that take context factors such as whether a user's hands are in view of the user, what posture the hands are in, whether a target object is selected, and whether a target object is within a threshold distance from the user.

Artificial reality multi-modal input switching model

Growing community of inventors

Seattle, WA, United States of America

Chris Rojas