Microsoft Technology Licensing, LLC

Frank Seide

Roger Peng Yu

Dong Yu

Albert J K Thambiratnam

Li Deng

Gang Li

Jun Liu

Eric I-Chao Chang

Kaisheng N Yao

Dennis George Cronin

Hang Su

Neema Moraveji

Kishan Thambiratnam

Kaijiang Chen

Ian Kennedy

Aligning a closed caption track to a media content includes calculating the offset and the drift between the closed caption track and the media content item. The closed caption track is aligned to the media content item as a function of the calculated offset and drift.

Closed caption alignment

Content-based analysis is performed on multimedia content prior to encoding the multimedia content in the rendering chain of processing. A content-based index stream is generated based on the content-based analysis and the content-based index stream is embedded in the multimedia file during rendering. The content-based index stream can be used to generate a content-based searchable index when necessary.

Embedding content-based searchable indexes in multimedia files

A deep tensor neural network (DTNN) is described herein, wherein the DTNN is suitable for employment in a computer-implemented recognition/classification system. Hidden layers in the DTNN comprise at least one projection layer, which includes a first subspace of hidden units and a second subspace of hidden units. The first subspace of hidden units receives a first nonlinear projection of input data to a projection layer and generates the first set of output data based at least in part thereon, and the second subspace of hidden units receives a second nonlinear projection of the input data to the projection layer and generates the second set of output data based at least in part thereon. A tensor layer, which can converted into a conventional layer of a DNN, generates the third set of output data based upon the first set of output data and the second set of output data.

Computer-implemented deep tensor neural network

Various technologies described herein pertain to conservatively adapting a deep neural network (DNN) in a recognition system for a particular user or context. A DNN is employed to output a probability distribution over models of context-dependent units responsive to receipt of captured user input. The DNN is adapted for a particular user based upon the captured user input, wherein the adaption is undertaken conservatively such that a deviation between outputs of the adapted DNN and the unadapted DNN is constrained.

Conservatively adapting a deep neural network in a recognition system

The concurrent presentation technique provides information about content related to a source media currently being presented to a user in a fashion that allows the user to keep viewing the source media while either interactively or non-interactively perusing a list of related content. Thus, the user can see a list of related content without interrupting the presentation experience, and if desired, the user can choose to interact with the list to obtain further information about available related content.

Concurrent presentation of media and related content lists

Search results are provided in a format that allows users to efficiently determine whether audio or video documents identified from a search query actually contain the words in the query. This is achieved by returning snippets of text around query term matches and allowing the user to play a segment of the audio signal by selecting a word in the snippet. In other embodiments, markers are placed on a timeline that represents the duration of the audio signal. Each marker represents a query term match and when selected causes the audio signal to begin to play near the temporal location represented by the marker.

Clickable snippets in audio/video search results

A method of identifying a location of a query string in an audio signal is provided. Under the method, a segment of the audio signal is selected. A score for a query string in the segment of the audio signal is determined by determining the product of probabilities of overlapping sequences of tokens. The score is then used to decide if the segment of the audio signal is likely to contain the query string.

Vocabulary-independent search of spontaneous speech

A method of searching audio data is provided including receiving a query defining multiple phonetic possibilities. The method also includes comparing the query with a lattice of phonetic hypotheses associated with the audio data to identify if at least one of the multiple phonetic possibilities is approximated by at least one phonetic hypothesis in the lattice of phonetic hypotheses.

Growing community of inventors

Beijing, China

Frank Seide