Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Facebook, Inc.

Sebastian Sztuk

Javier San Agustin Lopez

Kirk Erik Burgess

Martin Henrik Tall

Alexander Jobe Fix

Scott Robert Ramsby

Mohamed Hegazy

Dmitri Model

Steven Paul Lansel

Mohammadhossein Daraeihajitooei

Karol Constantine Hatzilias

Sapna A Shroff

Andrew Wyman MacDonald

Salvael Ortega Estrada

Robert Dale Cavin

Jun Hu

Robin Sharma

Tony David

Antonio Yamil Layon Halun

Anders Bo Pedersen

John Paulin Hansen

Johana Gabriela Coyoc Escudero

Andrew John Ouderkirk

Brian M Wheelwright

Andrew Lovitt

Kurt Jenkins

Sheng Ye

Sam Padinjaremannil Alex

Yi Zhou

Robert David Ellis

Jonathan Ravasz

Kun Liu

Neeraj Choubey

Thomas Scott Murdison

Nabeel Ahmed

Simon Charles Tickner

Jeffrey Witthuhn

Jiangtao Kuang

Bo Asp Andersen

Saara Khan

Evan Gander

Yilei Li

Rasmus Dahl

Jixu Chen

Henrik Hegner Tomra Skovsgaard

Ankit Brahmbhatt

Zhaonian Zhang

Sune Alstrup Johansen

Lars Ola Axelsson

Kirk Eric Burgess

Mohammadhossein Daraeihajitooel

David Tao

Demetrios Basil Karanikos

Linsen Bie

Danni Luo

Omar John Pualuan

Nabeel Farooq Butt

Kayvon Asemani

A wearable device for use in immersive reality applications is provided. The wearable device includes eyepieces to provide a forward-image to a user, a first forward-looking camera mounted on the frame and having a field of view, a processor configured to identify a region of interest within the forward-image, and an interface device to indicate to the user that a field of view of the first forward-looking camera is misaligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.

User interface to select field of view of a camera in a smart glass

A method for using cameras in an augmented reality headset is provided. The method includes receiving a signal from a sensor mounted on a headset worn by a user, the signal being indicative of a user intention for capturing an image. The method also includes identifying the user intention for capturing the image, based on a model to classify the signal from the sensor according to the user intention, selecting a first image capturing device in the headset based on a specification of the first image capturing device and the user intention for capturing the image, and capturing the image with the first image capturing device. An augmented reality headset, a memory storing instructions, and a processor to execute the instructions to cause the augmented reality headset as above are also provided.

Camera control using system sensor data

A wearable device for use in immersive reality applications is provided. The wearable device has a frame including an eyepiece to provide a forward-image to a user, a first forward-looking camera mounted on the frame, the first forward-looking camera having a field of view within the forward-image, a sensor configured to receive a command from the user, the command indicative of a region of interest within the field of view, and an interface device to indicate to the user that a field of view of the first forward-looking camera is aligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.

A method for calibrating eye tracking data for a head wearable optical device includes receiving eye tracking data from an imaging device oriented towards a combiner. The method includes determining a gaze direction of an eye of a user based on the eye tracking data. The method includes receiving calibration data from the imaging device that includes an indication of positions of one or more calibration indicators. The method includes determining the gaze direction based at least in part on the calibration data received from the imaging device (or factors adjusted by the calibration data).

Systems and methods for calibrating eye tracking

Eye data is captured with one or more sensors of the head mounted device. The one or more sensors are configured to sense an eyebox region. User notifications are controlled based on the eye data.

Selective notifications from eye measurements

A method of operating a head mounted device includes capturing eye data with one or more sensors of the head mounted device. The one or more sensors are configured to sense an eyebox region. Operations of the head mounted device are adjusted in response to the eye data.

Eye data and operation of head mounted device

A method for managing a user interface in a smart glass is provided. The method includes identifying an eye gesture of the user of the smart glass, based on an eye-tracking signal indicative of a pupil location of the user, assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture, and activating the application based on the user intention. A smart glass for use with the above method is also provided.

Gaze-based user interface with assistant features for smart glasses in immersive reality applications

A gaze direction of a user is determined by an eye-tracking system of a head mounted device. Audio data generated by at least one microphone is captured. Gaze-guided audio is generated from the audio data based on the gaze direction of the user.

Gaze-guided audio

In one aspect, the systems and methods described herein may include a first device comprising a first ultra-wideband (UWB) antenna. The first device may establish a connection with a second device having a second UWB antenna. The first device may determine an orientation of the first device relative to the second device, according to one or more UWB measurements between the first UWB antenna of the first device and the second UWB antenna of the second device. The first device may receive audio signals corresponding to the second device, and can render the audio signals into audio output to a user of the first device according to the determined orientation.

Systems and methods for ultra-wideband applications

A disclosed computer-implemented method may include directing a display device included in a head-mounted display worn by a user to illuminate, via a projection of a line at an illumination time, a portion of a cornea of the user. The method may further include detecting, via an image sensor at a detection time, a portion of the projection of the line reflected by the portion of the cornea of the user and identifying a distortion of the projection of the line reflected by the portion of the cornea of the user. The method may also include determining a shape of the cornea of the user based on the illumination time, the detection time, and the distortion of the projection of the line reflected by the portion of the cornea. Various other methods, systems, apparatuses, and computer-readable media are also disclosed.

Apparatuses, systems, and methods for mapping corneal curvature

Various aspects of the subject technology relate to prediction of eye movements of a user of a head-mountable display device. Predictive foveated display systems and methods, using the predicted eye movements are also disclosed. Predictive variable focus display systems and methods using the predicted eye movements are also disclosed. Predicting eye movements may include predicting a future gaze location and/or predicting a future vergence plane for the user's eyes, based on the current motion of one or both of the user's eyes. The predicted gaze location may be used to pre-render a foveated display image frame with a high-resolution region at the predicted gaze location. The predicted vergence plane may be used to modify an image plane of a display assembly to mitigate or avoid a vergence/accommodation conflict for the user.

Predictive eye tracking systems and methods for foveated rendering for electronic displays

The disclosed eye-tracking systems may include a visible light display having visible light pixels, at least one infrared pixel positioned within bounds of the visible light display, and an infrared sensor positioned and configured to detect infrared light originating from the at least one infrared pixel and reflected from an eye of the user. Related head-mounted display systems and methods for eye tracking are also disclosed.

Systems and methods for using a display as an illumination source for eye tracking

An image capture system is configured to align a field of view of the image capture component with a field of view of a user of the system. In some cases, the image capture system may adjust the field of view of the image data based at least in part on orientation and position data associated with the capture device.

System for determining an expected field of view

An optical assembly includes an optically transparent substrate and a first lens removably coupled with the optically transparent substrate by one or more adhesive layers. The one or more adhesive layers are positioned between the optically transparent substrate and the first lens. Also disclosed are an eye-tracker and a display device, each of which includes the optical assembly.

Head-mounted display devices with removable prescription lenses

A case for a head-mounted device includes a body portion and a power supply. The body portion includes one or more walls defining an interior cavity that is configured to receive and house the head-mounted device. The power supply is included in the body portion for transferring power to the head-mounted device.

Case for head-mounted device

Growing community of inventors

Menlo Park, CA, United States of America

Sebastian Sztuk