Meta Platforms Technologies, LLC

Sebastian Sztuk

Alexander Sorkine Hornung

Kirk Erik Burgess

Nabeel Ahmed

Jun Hu

Saara Khan

Salvael Ortega Estrada

Ankit Brahmbhatt

Daniel Maskit

Ngoc Minh Dang

A wearable device for use in immersive reality applications is provided. The wearable device has a frame including an eyepiece to provide a forward-image to a user, a first forward-looking camera mounted on the frame, the first forward-looking camera having a field of view within the forward-image, a sensor configured to receive a command from the user, the command indicative of a region of interest within the field of view, and an interface device to indicate to the user that a field of view of the first forward-looking camera is aligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.

User interface to select field of view of a camera in a smart glass

In one aspect, the systems and methods described herein may include a first device comprising a first ultra-wideband (UWB) antenna. The first device may establish a connection with a second device having a second UWB antenna. The first device may determine an orientation of the first device relative to the second device, according to one or more UWB measurements between the first UWB antenna of the first device and the second UWB antenna of the second device. The first device may receive audio signals corresponding to the second device, and can render the audio signals into audio output to a user of the first device according to the determined orientation.

Systems and methods for ultra-wideband applications

A method includes receiving scene image data, comprising left and right images for each eye. Through an eye tracking module, the method includes determining the user's gaze direction or eye vergence. Using this information, the method includes identifying an object in the scene that the user is focusing on, and determining, using a depth estimation module, a left depth from the left eye to the object and a right depth from the right eye to the object. Further, based on the computed left and right depths, the method includes generating, for the left and right eye, constant left and right depth meshes, generating a left and right output images by projecting the left and right images on the corresponding constant left and right depth meshes. Additionally, the method includes displaying the left output image for the left eye and displaying the right output image for the right eye.

Eye-tracking assisted passthrough rendering

The disclosure describes artificial reality systems and techniques for providing artificial reality content to a user. For example, an artificial reality system includes a head-mounted display (HMD) configured to output artificial reality content, the HMD including a set of second image capture devices configured to capture image data indicative of a focal point of a gaze of the user and a varifocal display having a focal length that is modifiable based on the focal point of the user. Additionally, the system includes a depth engine configured to generate, based on the real-world image data and depth data associated with the real-world image data, a three-dimensional (3D) scene of the physical environment of the user and generate artificial reality content as an overlay to the 3D scene of the physical environment for display on the varifocal display of the HMD based on the focal point of the user.

Artificial reality system with varifocal display of artificial reality content

A method for managing a user interface in a smart glass is provided. The method includes identifying an eye gesture of the user of the smart glass, based on an eye-tracking signal indicative of a pupil location of the user, assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture, and activating the application based on the user intention. A smart glass for use with the above method is also provided.

Growing community of inventors

Virum, Denmark

Sebastian Sztuk