Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Jeffrey Hung Wong

Jixu Chen

Martin Henrik Tall

Kapil Krishnakumar

Taehee Cho

An imaging device is configured to perform eye tracking. The imaging device comprises an image sensor and an image controller. The image sensor is configured to capture an image of a portion of a user's face. The image controller is configured to: in a first-access step, read out a set of sample pixels, from the image sensor to main memory; identify a pixel of interest from the set of sample pixels and a location of the pixel of interest; in a second-access step, read out remaining pixels in a photodetector group of interest corresponding to the location of the pixel of interest, from the image sensor to the main memory; generate a high-resolution region of interest by combining the pixel of interest and the remaining pixels in the photodetector group; and perform gaze estimation using the full resolution region of interest.

Region of interest sampling and retrieval for artificial reality systems

In one embodiment, a method for eye-tracking comprises capturing images of a user using one or more cameras, the captured images of the user depicting at least an eye of the user, storing the captured images of the user in a storage device, reading, from the storage device, a down-sampled version of the captured images of the user, detecting one or more first segments in the down-sampled version of the captured images by processing the down-sampled version of the captured images using a machine-learning model, the one or more first segments comprising features of the eye of the user, reading, from the storage device, one or more second segments in the captured images corresponding to the one or more first segments in the down-sampled version of the captured images, and computing a gaze of the user based on the one or more second segments in the captured images.

Growing community of inventors

San Francisco, CA, United States of America

Jeffrey Hung Wong