Facebook Technologies, LLC

Ams Sensors Singapore Pte. Ltd.

Meta Platforms Technologies, LLC

Heptagon Micro Optics Pte. Ltd.

Ohad Meitav

Vlad Fruchter

Markus Rossi

David Vakrat

Hartmut Rudmann

Jukka Alasirnio

Moshe Doron

Peter Roentgen

Mario Cesana

Tobias Senn

Alireza Yasan

Jens Geiger

Kai Engelhardt

Bassam Hallal

Florin Cutu

Daniel Pérez Calero

Stephan Heimgartner

Andrey Tovchigrechko

Reza Tusi

Dmitry Ryuma

Jeremy Snodgrass

A method for obtaining multiple frames of image data includes obtaining a first frame of image data of an entirety of a field of view by a camera sensor. The method also includes defining one or more regions of the field of view using the first frame of image data. The method includes determining at least one of a frame rate and an image capture resolution for each of the one or more regions. The method includes operating the camera sensor to obtain partial frames of image data by obtaining image data of the one or more regions of the field of view according to at least one of the frame rate and the image capture resolution, and re-constructing one or more full frames from partial frames of image data.

Systems and methods for dynamic image processing and segmentation

Image sensor modules include primary high-resolution imagers and secondary imagers. For example, an image sensor module may include a semiconductor chip including photosensitive regions defining, respectively, a primary camera and a secondary camera. The image sensor module may include an optical assembly that does not substantially obstruct the field-of-view of the secondary camera. Some modules include multiple secondary cameras that have a field-of-view at least as large as the field-of-view of the primary camera. Various features are described to facilitate acquisition of signals that can be used to calculate depth information.

Image sensor modules including primary high-resolution imagers and secondary imagers

The disclosed computer-implemented method may include (1) establishing a directional wireless link between a first computing device and a second computing device in a first direction, (2) exchanging, over the directional wireless link in the first direction, first data between the first computing device and the second computing device, (3) determining, via a sensor of the first computing device, a change to a position or an orientation of the first computing device, (4) redirecting, based on the change, the directional wireless link to a second direction, and (5) exchanging, over the directional wireless link in the second direction, second data between the first computing device and the second computing device. Various other methods and systems are also disclosed.

Systems and methods for maintaining directional wireless links of motile devices

In one embodiment, a method includes accessing image-sensor data generated by the image sensor, where the image sensor has a color filter array with a pre-determined number of filter sets, and where each set of filters has a single color, splitting the image-sensor data into a pre-determined number of images, where each image corresponds to a portion of the image-sensor data associated with one of the sets of filters, compressing each of the images using an image compression algorithm, and sending the compressed images to a second computing device, where the second computing device is configured to create an output image based on the compressed images.

Image-sensor data compression

A special-purpose hardware device for mitigating motion-to-photon latency in head-mounted displays may include an image signal processor that receives at least one image frame captured by a camera device of a head-mounted-display system. The special-purpose hardware device may also include an input-formatting component that receives the computer-generated imagery. The special-purpose hardware device may further include a blending component that generates at least one mixed-reality frame by overlaying the computer-generated imagery onto the image frame. The special-purpose hardware device may additionally include a frame-output interface that feeds the mixed-reality frame generated by the blending component to a display device of the head-mounted-display system to facilitate displaying the mixed-reality frame for presentation to a user wearing the head-mounted-display system. Various other apparatuses, systems, and methods are also disclosed.

Apparatus, system, and method for mitigating motion-to-photon latency in headmounted displays

A special-purpose hardware device for achieving intraframe image processing in head-mounted displays may include an image-correction component that receives a single image frame destined to be displayed for presentation to a user wearing a head-mounted-display system. The image-correction component may also receive user-motion data indicating that the user wearing the head-mounted-display system has made at least one movement since generation of the single image frame. The image-correction component may further perform hardware-accelerated intraframe processing operations on the single image frame in accordance with the user-motion data to compensate for the movement made by the user on a line-by-line basis. In addition, the special-purpose hardware device may include a frame-output interface that feeds the single image frame to a display device of the head-mounted-display system to facilitate displaying the single image frame for presentation to the user. Various other apparatuses, systems, and methods are also disclosed.

Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays

The disclosed special-purpose hardware device may include an image signal processor that receives, from a camera device of a head-mounted-display system, image frames of a physical environment. The special-purpose hardware device may also include a positional tracking component that (1) stores at least a portion of the image frames in a cache of the special-purpose hardware device that has a faster access speed than a main memory of the special-purpose hardware device, (2) tracks, based on the portion of the image frames stored in the cache, a change in the position of the head-mounted display system within the physical environment, and (3) stores the change in the position of the head-mounted-display system in the main memory for use in generating one or more augmented-reality frames. The special-purpose hardware device may further include a frame-output interface that feeds the augmented-reality frames to a display device of the head-mounted-display system.

Apparatus, system, and method for accelerating positional tracking of head-mounted displays

Optical assemblies include a stack of optical elements each of which has one or more alignment features. Each alignment feature traces a respective curve along a surface of one of the optical elements. The alignment feature(s) of one optical element fit within the alignment feature(s) of the other. In some cases, the alignment features can help establish more precise lateral alignment of the optical elements.

Optical assembly including passive optical elements having alignment features

The present disclosure describes structured-stereo imaging assemblies including separate imagers for different wavelengths. The imaging assembly can include, for example, multiple imager sub-arrays, each of which includes a first imager to sense light of a first wavelength or range of wavelengths and a second imager to sense light of a different second wavelength or range of wavelengths. Images acquired from the imagers can be processed to obtain depth information and/or improved accuracy. Various techniques are described that can facilitate determining whether any of the imagers or sub-arrays are misaligned.

Structured-stereo imaging assembly including separate imagers for different wavelengths

A wristwatch includes a case containing electronic components of the wristwatch. An optoelectronic module including at least one light emitting element and at least one light sensing element is disposed within the case or within a fastener for the wristwatch. The optoelectronic module is operable to obtain physiological data of a person wearing the wristwatch by using the light emitting element and the light sensing element.

Wristwatch including an integrated pulse oximeter or other modules that sense physiological data

Various stacks of arrays of beam shaping elements are described. Each array of beam shaping elements can be formed, for example, as part of a monolithic piece that includes a body portion as well as the beam shaping elements. In some implementations, the monolithic pieces may be formed, for example, as integrally formed molded pieces. The monolithic pieces can include one or more features to facilitate stacking, aligning and/or centering of the arrays with respect to one another.

Growing community of inventors

Sunnyvale, CA, United States of America

Ohad Meitav