Amazon Technologies, Inc.

Jatin Jain

Hooman Mahyar

Abhinav Misra

Vimal Bhat

Roya Hosseini

Udit Bhatia

Systems, methods, and computer-readable media are disclosed for systems and methods for automated identification and mapping of objects in video content. Example methods may include determining a first set of frames in video content, determining, using one or more object recognition algorithms, a first object present in the first set of frames, determining that a first product corresponding to the first object is present in a product catalog comprising a set of product images, associating a first product identifier of the first product with a video identifier of the video content, and causing presentation of a set of product identifiers associated with the video identifier.

Automated indication and mapping of objects in video content

Systems, methods, and computer-readable media are disclosed for systems and methods for semantic video segmentation to identify objects appearing in video content. Example methods may include determining a voice-based request at a first device to identify an object appearing in video content, determining a first video identifier for video content being consumed in association with the first device, determining a timestamp associated with the video content at a time the voice-based request was received, determining, using one or more knowledge graphs, a set of product identifiers for products present in the video content at a scene corresponding to the timestamp, and generating a response to the voice-based request comprising a first product identifier in the set of product identifiers.

Semantic video segmentation to identify objects appearing in video content

Automated identification and mapping of objects in video content

Systems, methods, and computer-readable media are disclosed for systems and methods for automated generation of textual descriptions of video content. Example methods may include determining, by one or more computer processors coupled to memory, a first segment of video content, the first segment including a first set of frames and first audio content, determining, using a first neural network, a first action that occurs in the first set of frames, and determining a first sound present in the first audio content. Some methods may include generating a vector representing the first action and the first sound, and generating, using a second neural network and the vector, a first textual description of the first segment, where the first textual description includes words that describe events of the first segment.

Growing community of inventors

Redmond, WA, United States of America

Jatin Jain