Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Kent Austin White

Vincent Charles Cheung

Tali Zvi

Kevin Lin

A multimedia query system is described that includes a multimedia capture system configured to capture raw multimedia data comprising at least one of raw video data or raw audio data, a metadata engine configured to extract one or more anchor points of metadata from the raw multimedia data and to store the one or more anchor points of metadata, wherein the anchor points of metadata includes references to respective portions of the raw multimedia data. The multimedia query system further includes a storage engine configured to store the raw multimedia data, a recall engine configured to receive a query and to apply the query to the one or more anchor points of metadata to identify one or more raw multimedia data candidates from the portions of the raw multimedia data, and a query engine configured to generate a response to the query based on the one or more raw multimedia data candidates.

Multimedia query system

A video conferencing system is described that includes an image capture system configured to capture image data of a participant in a video conferencing session, a pose tracker configured to track a pose of the participant based on the captured image data, a user interface (UI) element generator configured to generate a UI element, a rendering engine configured to render, based on the pose of the participant, at a position locked relative to a position of the participant in the image data, the UI element for display by the video conferencing system, a gesture detector configured to detect, from the image data, a gesture performed by the participant with respect to the rendered UI element, and a video conferencing application configured to perform an action in response to the gesture.

Growing community of inventors

Mountain View, CA, United States of America

Kent Austin White