International Business Machines Corporation

Ronald E VanBuskirk

Peter J Guasti

Amado Nassiff

Frank Fado

James Robert Lewis

Huifang Wang

Kerry Alan Ortega

Steven Gary Woodward

Barbara E Ballard

Linda M Boyer

Harvey M Ruback

Gary Robert Hanson

Qing Gong

Daniel E Badt

Jonathan Louis Gabel

Larry A Brocious

David C Loose

Arthur Keller

Thomas A Kist

Carl A Smith

Edwin A Rodriguez

Oing Gong

A method and system for completing user input in a speech recognition system. The method can include a series of steps which can include receiving a user input. The user input can specify an attribute of a selection. The method can include comparing the user input with a set of selections in the speech recognition system. Also, the method can include limiting the set of selections to an available set of selections which can correspond to the received user input. The step of matching a received user spoken utterance with the selection in the available set of selections also can be included.

Method, system, and apparatus for limiting available selections in a speech recognition system

A method for concurrent presentation of multiple audio information sources. In the method, audio information from at least two audio information sources is concurrently presented, and a user speech selection of one of the audio information sources is accepted. At least one of the audio information sources can then be reconfigured. The reconfiguration audibly distinguishes the user selected audio information source from other audio information sources.

System and method for concurrent presentation of multiple audio information sources

A method and a system for improving recall of speech data in a computer speech system can include a plurality of speech cache management steps including providing a speech cache, receiving a speech system input and identifying a speech event in the received speech system input, the speech event comprising speech data. Subsequently, the speech data can be compared to pre-determined speech cache entry criteria; and, if the speech data meets one of the pre-determined entry criteria, at least one entry can be added to the speech cache, the at least one entry corresponding to the speech data. Additionally, the speech data can be compared to pre-determined speech cache exit criteria; and, if the speech data meets one of the pre-determined exit criteria, at least one entry can be purged from the speech cache, the at least one entry corresponding to the speech data. The entry criteria can include frequently used speech data, recently used speech data, and important speech data. Similarly, the exit criteria can include least frequently used speech data associated with each entry in the speech cache, least recently used speech data associated with each entry in the speech cache and least important speed data associated with each entry in the speech cache.

Method of managing a speech cache

A method for configuring an audio interface for a speech recognition application in a computer system comprises the steps of: (a) displaying a first graphical user interface prompting a user selection of an output audio device between: a headset having at least one earphone speaker and a microphone; external speakers connected to the computer system; and, internal speakers connected to the computer system; (b) in the event of the user selecting the headset: (1) displaying a second graphical user interface for prompting a user to connect the headset; (2) displaying a second graphical user interface illustrating proper placement of the headset and the microphone; and, (3) displaying a fourth graphical user interface for adjusting audio playback volume;(c) in the event of a user selecting one of the external and internal speakers, omitting displaying the second and third graphical user interfaces as in steps (b)(1) and (b)(2) respectively, and displaying the fourth graphical user interface as in step (b)(3). The method can further comprise the steps of: including in the fourth graphical user interface a user operable volume control, an animation sequence indicative of an output audio signal and a user operable switch for initiating the output audio signal; and, including in the fourth graphical user interface a picture corresponding to the audio output device selected in step (a).

Adaptively configuring an audio interface according to selected audio output device

A method for correcting errors of a speech recognition application in natural speech recognition of words or phrases represented by characters can include the steps of selecting a character corresponding to an incorrectly recognized spoken word or phrase and observing a list of alternative characters. The method also can include replacing the incorrect character with one of the alternative characters, if the alternative characters correctly represent the incorrectly recognized word or phrase. If none of the alternative characters in the list correctly represents the spoken word or phrase, the step of drawing some features of a character correctly representing the incorrectly recognized word or phrase by moving a cursor can be included. Also included in the method can be the step of updating the list of alternative characters responsive to the drawing step; and, repeating the replacing, drawing and updating steps until a character correctly representing the word or phrase is selected from the updated list. A graphical user interface can respond to keyboard, mouse and voice commands.

Method and interface for correcting speech recognition errors for character languages

A method for enabling dictation into a speech application from an audio-only interface, in accordance with an inventive arrangement, can include the following steps beginning with creating a dictation template with a plurality of named dictation fields and respective audio prompts identifying each of the dictation fields by a respective name. Second, the template can be opened in response to a command spoken through the audio-only interface. Third, a first one of the audio prompts corresponding to a first one of the dictation fields can be transmitted through the audio-only interface. Fourth, dictation can be accepted into the first one of the dictation fields through the audio-only interface. Fifth, a subsequent one of the dictation fields can be opened in response to another command spoken through the audio-only interface. Sixth, a subsequent one of the audio prompts corresponding to the subsequent one of the dictation fields can be transmitted through the audio-only interface. Seventh, dictation can be accepted into the subsequent one of the dictation fields through the audio-only interface. Finally, each of the fifth, sixth and seventh steps can be repeated until the dictation is complete.

Audio-only user speech interface with audio template

A method for managing a What Can I Say (WCIS) function in an application having a plurality of commands which can be voice activated comprises the steps of: storing a set of substantially all voice activatable commands associated with the application; identifying those of the commands in the set which are displayable by the application; and, in response to a user input, displaying in a graphical user interface (GUI) a subset of the voice activatable commands which are not displayable by the application. Moreover, the method includes displaying in the GUI, in response to a user input, a list of the stored set of substantially all voice activatable commands associated with the application; displaying in the GUI a pull down menu identifying different categories by which the commands can be viewed in the list; and, displaying the GUI with a pull down menu identifying commands that can be performed against a voice command.

Managing voice commands in speech applications

A multiple function graphical user interface for a speech recognition application adapted for generation by a computer programmed with a routine set of instructions, the interface comprising: an activatable icon defining an elongated screen display area, the icon having separately controllable foreground and background displays substantially coextensive with the display area; the background display being substantially fully changeable in response to user speech into a microphone having at least two states; text being displayable in the foreground display across substantially all of the display area; and, activation of the icon invoking a function related to the speech recognition application. A border can be selectively displayed around the elongated screen display area for indicating whether the speech application is in a navigation mode or a dictation mode.

Multiple function graphical user interface minibar for speech recognition

A method for configuring an audio interface for a speech recognition application in a computer system comprises the steps of: (a) displaying a first graphical user interface (GUI) prompting a user selection of an audio input device between: a headset having a microphone and at least one microphone not forming part of a headset; (b) in the event of the user selecting the headset having the microphone: (1) displaying a second GUI for prompting a user to connect the headset, the second GUI including a picture of a headset; (2) displaying a third GUI illustrating proper placement of the headset and the microphone, the third GUI including the picture of a headset; and, (3) displaying a fourth GUI for adjusting audio recording volume, the fourth GUI including the picture of a headset; and, (c) in the event of a user selecting the microphone not forming part of a headset: (1) omitting displaying the second and third GUIs as in steps (b)(1) and (b)(2) respectively; (2) displaying a fifth GUI for prompting the user to connect the microphone not forming part of a headset, the fifth GUI including a picture of a microphone not forming part of a headset; and, (3) displaying the fourth GUI as in step (b)(3), as modified to include the picture of a microphone not forming part of a headset instead of the picture of a headset.

Configuring microphones in an audio interface

A method for configuring an audio interface for a speech recognition application in a computer system comprises the steps of: (a) determining from a data storage registry of said speech recognition application whether a microphone operatively associated with said computer system has been previously successfully set up for operation with said speech recognition application; (b) displaying a first graphical user interface having a first user activatable icon for setting up said microphone and a second user activatable icon for adjusting an audio recording level for said microphone; (c) in the event said microphone is not registered as having been previously successfully set up, altering said second icon in appearance and disregarding attempted activation of said second icon; and, (d) in the event said microphone is registered as having been previously successfully set up, respectively initiating said setting up of said microphone and said adjusting of said audio recording level responsive to activation of said first or second icons respectively. The method can further comprise the steps of: (e) setting up said microphone responsive to activation of said first icon in any one of steps (c) and (d) in conjunction with displaying at least one additional graphical user interface; and, (f) redisplaying said first graphical user interface as recited in step (b).

Configuring an audio interface with contingent microphone setup

A method for configuring an audio interface for a speech recognition application in a computer system in accordance with an inventive arrangement comprises the steps of: (a) digitally storing representations of pictures of a plurality of audio input and output devices compatible with the computer system, including: a headset with a microphone and an earpiece speaker; a microphone not forming part of a headset; at least one external speaker connected to the computer system; at least one internal speaker connected to the computer system; and, different combinations of the input and output audio devices; (b) displaying a sequence of graphical user interface (GUI) displays for: (1) selecting an audio input device and an audio output device; (2) connecting the selected audio output device; (3) testing the selected audio output device; (4) connecting a microphone; (5) testing the connected microphone; and, (6) testing the speech recognition application; and, (c) during each of the steps (b)(1) through (b)(6), including in the sequence of the GUI displays pictures of the selected input and output audio devices.

Configuring audio interface for multiple combinations of microphones and

A method for configuring an audio interface for a speech recognition application in a computer system comprises the steps of: (a) determining how many sound cards present in the computer system are capable of supporting speech; (b) in the event at least two of the sound cards present in the computer system are speech capable, displaying a first graphical user interface for user selection of the speech capable sound cards; and, (c) in the event only one speech capable sound card is detected, and in the event one of at least two speech capable sound cards has been user selected, determining if an audio mixer is present in the computer system.

Configuring an audio interface contingent on sound card compatibility

A method for configuring an audio interface for a voice recognition application in a computer system comprises the steps of: (a) displaying a first graphical user interface having a message prompting a user to initiate testing of a microphone connection, a user activatable button and at least one icon representing recording status; (b) in response to activation of the button: (1) modifying the message section to instruct the user to remain silent; (2) recording background noise through the microphone; (3) initiating an animation of the at least one icon to represent an active recording status; and, (4) terminating the background noise recording and the animation of the at least one icon; (c) upon termination of the background noise recording: (1) modifying the message to instruct the user to speak into the microphone; (2) recording the user speaking through the microphone; (3) reinitiating the animation of the at least one icon; (4) terminating the recording of the user speaking and the animation of the icon; and, (d) processing the recordings of the background noise and the user speaking.

Configuring an audio interface with background noise and speech

A method for configuring an audio mixer in an audio interface for a speech recognition application in a computer system in accordance with an inventive arrangement comprises the steps of: (a) displaying at least one graphical user interface for selecting an audio input and output device from a plurality of audio input and output devices compatible with the speech recognition application, including: a headset with a microphone and an earpiece speaker; a microphone not forming part of a headset; at least one external speaker connected to the computer system; at least one internal speaker connected to the computer system; and, different combinations of the input and output audio devices; (b) selecting and adjusting microphone inputs of the mixer in accordance with an audio input device selected in step (a); and, (c) deselecting audio inputs and outputs of the audio mixer in accordance with the audio input device and an audio output device selected in step (a), whereby unneeded audio inputs and outputs of the mixer can not interfere with microphone operation.

Configuring an audio mixer in an audio interface

A method for correcting frequently misrecognized words and commands in a speech application. According to the method, when a need for correcting a frequently misrecognized word/command spoken by a user is detected, a recording is made of the misrecognized word/command in isolation. Subsequently, an in-isolation base form for the misrecognized word/command is established from the in-isolation recording. The in-isolation base form is then saved and the misrecognized word/command in recorded in context. Next, an in-context base form is established for the misrecognized word/command from the context recording and a comparison is made between the in-isolation and in-context base forms. The in-context base form is saved only if the in-isolation and in-context base forms are markedly different from one another. A sentence is displayed using the frequently misrecognized word/command in context and the user is prompted to speak the sentence. The sentence is then recognized using the speech application and the user is prompted to confirm whether or not the frequently misrecognized word/command was properly recognized. The method is terminated if the frequently misrecognized word/command was properly recognized.

Growing community of inventors

Louisville, CO, United States of America

Ronald E VanBuskirk