Sap Ag

Li Gong

Richard James Swan

Jie Weng

Samir Raiyani

Hartmut K Vogler

Andrew Yinger

Townsend Duong

Karl Christian Roediger

Ju-Kay Kwek

Matthias Winkler

Ben-Shaul Yair

Alexander Rosenbaum

Vinod Guddad

John Hanley

Wai Or

Jordan Anderson

Christoph Lessmoellmann

Samir Rayiani

Arkadi Kagan

The invention provides a method and apparatus, including computer program products, for interfacing communication between a warehouse management system and a portable device, the device being adapted for processing voice XML data, the method comprising: receiving, from the warehouse management system, GUI screen data comprising visual content; generating voice XML data one the basis of the visual content, the voice XML data comprising at least one portion which is representative of voice information; and transmitting the generated voice XML data to the device.

Voice XML web console

A sales system is described that enables fast, efficient shopping by customers, and thereby increases sales and encourages customer loyalty, while simultaneously improving store management. An electronic device, which may be mobile or stationary, and which may belong or be assigned to (or accessed by) each customer, is used to access shopping information that might not otherwise be available to the customer during shopping. For example, a personal digital assistant or information kiosk may be used to provide specific product information and complete a sale thereof, or to provide suggested purchase lists and best routes through the store during shopping. The sales system is multi-modal, so that a plurality of input modalities (such as voice or auto-id techniques) are simultaneously available to the customer. Additionally, because it is multi-modal, the system can communicate with other store items, such as shelves or shopping carts, to gain (and integrate) information about customers and the products the customers are purchasing.

Multi-modal sales applications

Methods and systems, including computer program products, for speech animation. The system includes a speech animation server and one or more speech animation clients. The speech animation server generates speech animation content that drives the expressions and behaviors of talking agents displayed by the speech animation clients. The data used by the server includes one or more references to behavioral contexts. A behavioral context corresponds to a particular application scenario and includes a set of expressions that are appropriate to the particular application scenario. A behavioral context can also be defined as a combination of two or more other behavioral contexts. The server automatically incorporates the expressions of a particular behavioral context into any data that references the particular behavioral context.

Speech animation with behavioral contexts for application scenarios

Methods and systems, including computer program products, for speech animation. The system includes a speech animation engine and a client application in communication with the speech animation engine. The client application sends a request for speech animation to the speech animation engine. The request identifies data to be used to generate the speech animation, where speech animation is speech synchronized with facial expressions. The client application receives a response from the speech animation engine. The response identifies the generated speech animation. The client application uses the generated speech animation to animate a talking agent displayed on a user interface of the client application. The speech animation engine receives the request for speech animation from the client application, retrieves the data identified in the request without user intervention, generates the speech animation using the retrieved data and sends the response identifying the generated speech animation to the client application.

Speech animation

Automatically searching for one or more matches to a search string includes accessing a first part and a second part of a search string. A first search space is searched for a match for the first part of the search string, and a second search space is limited based on a result of searching the first search space. The limited second search space is searched for a match for the second part of the search string. Various approaches are described for structuring a grammar of a voice recognition engine to allow efficient, quick recognition, and to enhance recognition by limiting the amount of the grammar that is searched, thus minimizing the incidence of misrecognition. Search strings can be recognized and searched using a multi-cluster approach. Recognition and searching can also be performed using a multi-level, multi-parameter cascade approach. Approaches can also be applied to recognition of other modes of input.

User interface for data access and entry

A system for synchronizing multiple modalities is described. A user may use multiple modalities, such as voice and browser, to interact with data on a network, such as the World Wide Web. All of the modalities may be synchronized so that all are updated when the user enters information in just one. A method of communicating between devices includes receiving a request for first-modality data that includes first content, and sending a message in response to receiving the request, the message including information allowing the request of second-modality data that includes second content overlapping the first content. Another method includes requesting first data for a first modality, the first data including first content, and automatically requesting second data for a second modality, wherein the second data includes second content that overlaps the first content.

Multi-modal synchronization

A graphical user interface may include a form with a plurality of fields, each field associated with a predetermined category. Each category may have its own, independent, discrete grammar associated therewith, and the independent grammars may be individually activated, simultaneously with their respective categories. In this way, a voice-recognition system that is inputting spoken data for each of the fields may have a restricted grammar to search when attempting to match a particular voice input with an entry for a particular field in the form. Moreover, a global grammar that is active with any one of the independent grammars may be used to move between the fields or perform other high-level functionality not associated with any one of the independent grammars.

Growing community of inventors

San Francisco, CA, United States of America

Li Gong