Meta Platforms Technologies, LLC

Johnathon Simmons

Pol Pla I Conesa

Aaron S Faucher

Roger Ibars Martinez

Nathan Aschenbach

Chris Rojas

Bryan Sparks

Emron Jackson Henry

Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in the multiple modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.

Artificial reality input using multiple modalities

Growing community of inventors

Seattle, WA, United States of America

Johnathon Simmons