International Business Machines Corporation

Nuance Communications, Inc.

Leslie Robert Wilson

Soonthorn Ativanichayaphong

Steven Gary Woodward

Charles Willard Cross, Jr

Charles W Cross

William Kress Bodin

James Robert Lewis

Gerald Matthew McCobb

Ciprian Agapi

Hui Su

Shi Wan Zhao

James Jude Sliwa

Mark A Pietras

Steven M Hancock

Chang Yan Chi

David Jaramillo

Scott J Broussard

Girish Dhanakshirur

Ronald John Bowater

Marc Segre

Andrew John Smith

Yuk-Lun Wong

Charles T Rutherfoord

Robert F Kantner, Jr

Paul Joseph Milot

David Christopher Dryer

Gary Bischoff

Nicolae D Metianu

Arturo A Rodriquez

Jeffrey S Spencer

A method for prompting user input for a multimodal interface including the steps of providing a multimodal interface to a user, where the interface includes a visual interface having a plurality of input regions, each having at least one input field; selecting an input region and processing a multi-token speech input provided by the user, where the processed speech input includes at least one value for at least one input field of the selected input region; and storing at least one value in at least one input field.

Systems and methods for prompting multi-token input speech

A method of phone messaging includes encoding a data packet into an audio stream, said data packet comprising a message addressed to a mobile device operating in a wireless network, placing a call to said mobile device using a voice channel of said wireless network, transmitting said audio stream over said voice channel to said mobile device, and reconstructing said data packet from said audio stream.

Phone messaging using audio streams

A voice server can be located, temporarily allocated, and sent audio. The results are returned to a voice client, and the voice server is deallocated for use by the next person talking into their client browser. Voice channels and IVR ports are initially set up by a switch and the IVR using conventional audio protocols. The voice channels are not initially connected to the client. The switch handles the allocation and deallocation of IVR voice channels without having to communicate further with the IVR. A user indicates to the client device that he wishes to initiate a voice interaction during an X+V session. This translates to a request on the CTRL channel to synchronise XHTML and VXML forms as a trigger for the VXML browser to execute a conversational turn. A multiplexer intercepts this control command and establishes a virtual voice circuit between the client device and an existing open but unattached voice port. The virtual circuit is established without having to set up an RTP channel. The CTRL signal is then forwarded to an interaction manager so that the conversation can take place. At the end of the conversation the virtual circuit is disconnected.

Method and apparatus for multimodal voice and web services

System and methods for prompting user speech in multimodal devices

A method for alleviating ambiguity issues of new user-defined speech commands. An original command for a user-defined speech command can be received. It can then be determined if the original command is likely to be confused with a set of existing speech commands. When confusion is unlikely, the original command can be automatically stored. When confusion is likely, a substitute command that is unlikely to be confused with existing commands can be automatically determined. The substitute can be presented as an alternative to the original command and can be selectively stored as the user-defined speech command.

Automatically providing a user with substitutes for potentially ambiguous user-defined speech commands

A method for speech enabling an application can include the step of specifying a speech input within a speech-enabled markup. The speech-enabled markup can also specify an application operation that is to be executed responsive to the detection of the speech input. After the speech input has been defined within the speech-enabled markup, the application can be instantiated. The specified speech input can then be detected and the application operation can be responsively executed in accordance with the specified speech-enabled markup.

Enabling speech within a multimodal program using markup

A method of accessing an Extensible Hypertext Markup Language Plus Voice Web page can include the step of receiving a request for an Extensible Hypertext Markup Language Plus Voice Web page from a source that lacks the ability to directly render the Web page. The Web page can be segmented into a multitude of fragments, where each fragment can consist of a single interface category, such as a graphical user interface category or a voice category. These fragments can be used to provide the requesting source with information from the Web page.

Presenting multimodal web page content on sequential multimode devices

A method for alleviating ambiguity issues of new user defined speech commands. An original command for a user-defined speech command can be received. It can then be determined if the original command is likely to be confused with a set of existing speech commands. When confusion is unlikely, the original command can be automatically stored. When confusion is likely, a substitute command that is unlikely to be confused with existing commands can be automatically determined. The substitute can be presented as an alternative to the original command and can be selectively stored as the user-defined speech command.

Intelligent computer implemented agents are associated with computer user interface tasks by dividing the tasks into statistically distinct clusters based on sampled user assessments. The assessments collect data on multiple user variables. Multivariate statistical analysis is used to divide the tasks into distinct clusters. The clusters are validated using univariate analysis on each of the measured variables. Intelligent agents are associated based on the measured variables to ensure that agents are effective. The objective assessment and association avoids costly creation and overhead of agents applied where not effective.

Selection of graphical user interface agents by cluster analysis

A method for enhancing voice interactions within a portable multimodal computing device using visual messages. A multimodal interface can be provided that includes an audio interface and a visual interface. A speech input can then be received and a voice recognition task can be performed upon at least a portion of the speech input. At least one message within the multimodal interface can be visually presented, wherein the message is a prompt for the speech input and/or a confirmation of the speech input.

Method of enhancing voice interactions using visual messages

A method of coordinating the presentation of multiple modes of interaction for network-based electronic content can include receiving a markup language document of a first modality and identifying within the markup language document a reference to another markup language document of a second and different modality. The markup language document of the first modality can be modified by removing the reference. The modified markup language document of the first modality can be provided to an associated browser.

Method and system for distributed coordination of multiple modalities of computer-user interaction

Growing community of inventors

Boca Raton, FL, United States of America

Leslie Robert Wilson