Amazon Technologies, Inc.

Roya Hosseini

Hooman Mahyar

Vimal Bhat

Jatin Jain

Udit Bhatia

Systems, methods, and computer-readable media are disclosed for systems and methods for automated generation of textual descriptions of video content. Example methods may include determining, by one or more computer processors coupled to memory, a first segment of video content, the first segment including a first set of frames and first audio content, determining, using a first neural network, a first action that occurs in the first set of frames, and determining a first sound present in the first audio content. Some methods may include generating a vector representing the first action and the first sound, and generating, using a second neural network and the vector, a first textual description of the first segment, where the first textual description includes words that describe events of the first segment.

Growing community of inventors

Bellevue, WA, United States of America

Roya Hosseini