Meta Platforms, Inc.

Saurabh Mitra

Krishnan Ramnath

Lakshmie Narayan Viswanathan

Eric W Hwang

Alan Liu

Rahul Nallamothu

Samuel Franklin Pepose

Jeffrey Zhang

A mobile client device is localized based on a captured image by identifying where the client device is located from a set of known locations. The set of known locations is associated with a set of regions, where each region is associated with a set of key frames representing the important features of the region. Latent vectors and keypoints are calculated for each of the key frames and an image captured by the client device. The system compares the latent vectors of the captured image to the latent vectors associated with the regions to determine a subset of similar regions. The system compares the keypoints of the captured image to the keypoints associated with the regions in the subset to determine a best match. This determined location is considered the region of the client device and may be used with other localization information to maintain localization of the client device.

Indexing key frames for localization

In one embodiment, a method includes an intelligent communication device detecting that a person is visible to a camera of the device, determining a first biometric characteristic of the person discernable by the device, associating the first biometric characteristic with a user identifier unique to the person, determining, while the person is identifiable based on the first biometric characteristic, a second biometric characteristic of the person discernable by the device, and associating the second biometric characteristic with the user identifier. The method also includes the device determining that a detected person has a detected biometric characteristic, determining that the detected person is associated with the user identifier by matching the detected biometric characteristic to the first biometric characteristic or the second biometric characteristic, and applying, while the detected person is identifiable based on the detected biometric characteristic, a user-specific customization associated with the user identifier.

User-specific customization of video conferences using multimodal biometric characterization

Growing community of inventors

Mountain View, CA, United States of America

Saurabh Mitra