Facebook Technologies, LLC

Oculus, Vr, LLC

Meta Platforms Technologies, LLC

Sharvil Shailesh Talati

Jason Andrew Higgins

Peter Wesley Bristol

Robert Dale Cavin

Yi-Yaun Chen

Karol Constantine Hatzilias

Martin Henrik Tall

Thomas Scott Murdison

Neeraj Choubey

Bo Asp Andersen

Kelly Ingham

Andre Golard

Immo Andreas Schuetz

Andrew John Ouderkirk

Nicholas Daniel Trail

James Stocker Webb

Benjamin E Tunberg Rogoza

Pasi Saarikko

Hee Yoon Lee

Behnam Bastani

Neil Konzen

Byron Taylor

Ilias Pappas

Mark Shintaro Ando

Blake Francis Andersen

Bradley Morris Johnson

Benjamin Elliot Tunberg Rogoza

Benjamin Elliott Tunberg Rogoza

Hagar Edelstain

Yufeng Zhu

A handheld controller configured to be held by a user's hand. The handheld controller comprising a main body, and a handle extending from the main body, wherein the handle has a palm side and a finger side. A control button is positioned on the main body or handle, and a detection sensor is on the handle. The detection sensor is positioned to detect the presence of the finger or palm of a user's hand engaging the handle. The detection sensor can be a capacitive touch sensor, a proximity sensor or other detection sensor operative to detect the touch or spatial presence of the user's hand or fingers.

Handheld controller with hand detection sensors

A method for correcting artifacts in artificial reality headsets is provided. The method includes coupling a first image portion into a waveguide in a display for an artificial reality device, provided by a first array of pixels, coupling a second image portion into the waveguide in the display, provided by a second array of pixels, directing the first image portion through an eyebox, directing the second image portion through the eyebox, and tiling, in a user's retina, the first image portion and the second image portion to form an image having an extended field of view that includes an overlapping area comprising light provided by the first array of pixels and the second array of pixels. A system including a memory storing instructions and a processor to execute the instructions to cause the system to perform the above method are also provided.

Correcting artifacts in tiled display assemblies for artificial reality headsets

The disclosed computer-implemented method may include identifying a region within a user's eye gaze and calculating a ranking for the identified region within the user's eye gaze. The ranking may indicate the user's level of interest in the identified region. The method may then determine how the identified region is to be presented according to the calculated ranking and present the identified region in the determined manner according to the calculated ranking. Various other methods, systems, and computer-readable media are also disclosed.

Eye rank

A headset includes a display assembly. The display assembly has a primary portion and a peripheral portion. The primary portion of the display assembly is configured to emit a first portion of image light, and has a first field of view (FOV). The peripheral portion of the display assembly is configured to emit a second portion of the image light over a second FOV, and the peripheral portion is canted relative to the primary portion. The emitted first portion of image light and the emitted second portion of image light create a composite FOV from the perspective of an eyebox, and a seam between the first FOV and the second FOV is located in a peripheral region of the composite FOV.

Curved display assembly for artificial reality headset

A headset includes a first waveguide display and a second waveguide display. The first waveguide display is configured to emit a first portion of image light, the first waveguide display having a first field of view (FOV). The second display assembly is configured to emit a second portion of the image light, and the second display assembly has a second FOV. The first waveguide display and the second display assembly are tiled such that the emitted first portion of image light and the emitted second portion of image light create a tiled FOV from a perspective of an eyebox. And a seam between the first FOV and the second FOV is located in a peripheral region of the tiled FOV.

Tiled display assemblies for artificial reality headset

Systems and methods for virtual interest segmentation may include (1) performing a semantic segmentation of an image of a user's environment, captured by an artificial reality (AR) device being worn by the user, to identify objects within the user's environment, (2) in addition to performing the semantic segmentation, performing an interest segmentation of the image to determine a personal interest that the user may have in a particular object identified via the semantic segmentation, (3) creating virtual content relating to the particular object based on the user's personal interest in the particular object, and (4) displaying the virtual content within a display element of the AR device. Various other methods, systems, and computer-readable media are also disclosed.

Virtual interest segmentation

Systems and methods for enabling gaze-based virtual content control may include (1) displaying an artificial scene with one or more virtual elements to a user wearing a head-mounted display system, (2) identifying the user's eye gaze based on gazing data collected by one or more sensors in the head-mounted display system, (3) determining that the user's eye gaze is focused on a specific virtual element, and (4) in response to determining that the user's eye gaze is focused on the specific virtual element, increasing the specific virtual element's visibility to the user. Various other methods, systems, and computer-readable media are also disclosed.

Gaze-based virtual content control

The disclosed computer-implemented method may include: identifying, using an eye-tracking system, an object within a scene viewed by a user; identifying, within a database of object interaction commands, a subset of commands that apply to the object viewed by the user; and presenting, to the user, the subset of commands that apply to the object. Various other methods, systems, devices, and computer-readable media are also disclosed.

Systems and methods for using eye tracking to improve user interactions with objects in artificial reality

The disclosed computer-implemented method may include (i) determining, using an eye-tracking system, an orientation of at least one eye of a user, (ii) identifying, based at least in part on the orientation of the user's eye, a point of interest within a field of view of the user, (iii) determining that the point of interest is a candidate for tagging, and (iv) performing, in response to determining that the point of interest is the candidate for tagging, a tagging action that facilitates tagging of the point of interest. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for virtually tagging objects viewed by friends and influencers

A waveguide display is used for presenting media to a user. The waveguide display is part of a Near Eye Device (NED), and an output of the waveguide display is a light field directed to a user's eye that extends across the surface of an exit pupil. Light traveling in total internal reflection (TIR) is selectively interrupted through frustrated total internal reflection (FTIR). FTIR coupling between waveguides produces multiple expansions of an input light field. The coupling locations of FTIR are dynamic, allowing for adjustment of the location and size of the exit pupil.

Dynamic frustrated total internal reflection coupler

An electronic display uses pulse-width modulation (PWM) to drive light emitting devices (LEDs) with reduced power consumption. A modified digital word including a modified sequence of bits is generated by modifying a bit sequence of a greyscale value for a sub-pixel. The modified bit sequence includes fewer transitions from a first voltage level to a second voltage level higher than the first voltage level than the bit sequence of the grayscale value. A modified sequence of pulses is generated based on ordering pulses of the PWM signal according to the modified bit sequence. The modified digital word and the modified sequence of pulses are used to control a light emitting device of the electronic display. The reduction in voltage level transitions results in reduced charging of a storage capacitor in the control circuit for the LED, while maintaining brightness level as specified by grayscale value.

Low power pulse width modulation by controlling bits order

An augmented-reality system has canted waveguides. The waveguides are canted at a wrap angle and/or a tilt angle. Input couplers to the waveguides are designed differently because of the different cant angles. Having canted waveguides allows waveguides to be formed in glasses and/or sunglass that have a base curvature.

Canted augmented reality display for improved ergonomics

Handheld controllers having flexible thumbstick guards are disclosed herein for use with a handheld controller having a thumbstick or other pivotal control member. A representative guard has a tubular neck that sealably connects to a shaft portion of the thumbstick, and a skirt that sealably connects to an interior portion of the handheld controller around the control opening. The guard has a flexible joint portion interconnecting the neck and the skirt to allow the neck to move relative to the skirt upon pivoting the control member relative to the body.

Handheld controller with thumbstick guard

There is provided a hand-held controller for a virtual-reality system. The hand-held controller includes a user-input surface and a grip coupled to the user-input surface. The user-input surface includes a first user-input key situated on the user-input surface. The first user-input key includes a first capacitive touch sensor to detect a finger of a user hovering above the first user-input key and contacting the first user-input key.

Hand-held controllers with capacitive touch sensors for virtual-reality systems

A hand-held controller includes a user-input surface, a grip coupled to the user-input surface, and a cage coupled to the user-input surface at two points without the grip interposed between the user-input surface and the cage. The hand-held controller includes may further include a plurality of illumination sources on an outer surface of the cage.

Growing community of inventors

Seattle, WA, United States of America

Sharvil Shailesh Talati