Microsoft Technology Licensing, LLC

Roger Peng Yu

Frank Seide

Albert J K Thambiratnam

Alejandro Acero

Jun Liu

Ciprian Ioan Chelba

Asela J Gunawardana

Frank Torsten Bernd Seide

Erik Warren Selberg

Patrick Nguyen

Neema Moraveji

Kishan Thambiratnam

Frank Torsten B Seide

Kaijiang Chen

Content-based analysis is performed on multimedia content prior to encoding the multimedia content in the rendering chain of processing. A content-based index stream is generated based on the content-based analysis and the content-based index stream is embedded in the multimedia file during rendering. The content-based index stream can be used to generate a content-based searchable index when necessary.

Embedding content-based searchable indexes in multimedia files

The concurrent presentation technique provides information about content related to a source media currently being presented to a user in a fashion that allows the user to keep viewing the source media while either interactively or non-interactively perusing a list of related content. Thus, the user can see a list of related content without interrupting the presentation experience, and if desired, the user can choose to interact with the list to obtain further information about available related content.

Concurrent presentation of media and related content lists

A computer-implemented method of indexing a speech lattice for search of audio corresponding to the speech lattice is provided. The method includes identifying at least two speech recognition hypotheses for a word which have time ranges satisfying a criteria. The method further includes merging the at least two speech recognition hypotheses to generate a merged speech recognition hypothesis for the word.

Time-anchored posterior indexing of speech

Search results are provided in a format that allows users to efficiently determine whether audio or video documents identified from a search query actually contain the words in the query. This is achieved by returning snippets of text around query term matches and allowing the user to play a segment of the audio signal by selecting a word in the snippet. In other embodiments, markers are placed on a timeline that represents the duration of the audio signal. Each marker represents a query term match and when selected causes the audio signal to begin to play near the temporal location represented by the marker.

Clickable snippets in audio/video search results

A method of identifying a location of a query string in an audio signal is provided. Under the method, a segment of the audio signal is selected. A score for a query string in the segment of the audio signal is determined by determining the product of probabilities of overlapping sequences of tokens. The score is then used to decide if the segment of the audio signal is likely to contain the query string.

Vocabulary-independent search of spontaneous speech

Growing community of inventors

Beijing, China

Roger Peng Yu