Amazon Technologies, Inc.

Saravanan Santhamoorthy Theckyam

Anil Kumar Nelakanti

Mayank Sharma

Honey Gupta

Palanivelu Balakrishnan

Prabhakar Gupta

Methods and apparatus are described for evaluating dubbing of media content. Phonemes in dubbed audio are extracted and mapped to visemes. Lip poses in video frames of the media content corresponding to the phonemes of the dubbed audio are compared to the visemes determined from the dubbed audio. A notification may be generated based on the comparison that indicates synchronization of the dubbed audio to lip poses of the video.

Audio-lip movement correlation measurement for dubbed content

Methods and apparatus are described for evaluating dubbing of media content. Emotions are identified based on combinations of attributes determined for segments of a source language audio and a dubbed audio. The emotions may be compared to determine emotional prosody transfer between the source audio and dubbed audio. Based on the comparison, a notification is generated indicating whether an emotion classification associated with the source audio matches an emotion classification associated with the dubbed audio.

Multi-task and multi-lingual emotion mismatch detection for automated dubbing

Techniques and apparatus for selecting audio content for a content entity in audio-visual content are described. An example technique involves identifying at least one content entity associated with a content item that is accessible to one or more users in a first language over a communication network. One or more attributes of the at least one content entity are determined. A plurality of audio content samples in a second language are obtained. Each audio content sample includes a different audio sample of a portion of speech of the content entity in the second language. A first audio content sample that satisfies a predetermined condition is determined, based on the plurality of audio content samples and the one or more attributes of the at least one content entity. An indication of the first audio content sample is provided.

Growing community of inventors

Bengaluru, India

Saravanan Santhamoorthy Theckyam