Sap Ag

Samir Raiyani

Robert Pei

Tim Kaldewey

Jie Weng

Hartmut K Vogler

Richard James Swan

Li Gong

Sneschana Sobol

Ju-Kay Kwek

Jordan Anderson

Wai Or

John Hanley

Vinod Guddad

Provided are systems and methods for tracking resources at a site and initiating audio and video communication with tracked resources using multiple input and output modalities. The systems include a location tracking system, including a positioning engine and a presentation engine, an environmental tracking system, location and environmental sensors, either permanently installed or temporarily deployed, and portable devices such as mobile phones or personal digital assistants carried by the tracked resources and users. The methods include tracking such resources at a site, displaying their locations on a portable device using a visual map display, and providing the ability to initiate bidirectional audio and video communications with one of more of the tracked resources.

Incident command post

Systems and methods are described for enabling the monitoring and navigation of a complex of known rooms or facilities having known objects, attributes and/or people associated therewith, wherein different locations of the objects, attributes and/or people within the facilities are related and accessible over known, well-defined alternate paths. Sensor information may be used to facilitate the monitoring and navigation of the facility. At least some systems and methods may be used to enable the navigation of a building or a set of buildings by displaying an interactive graphical map of the building on a display device carried by a user.

System and method for navigating a facility

Provided are systems and methods for tracking resources at a site and initiating audio and video communication with tracked resources using multiple input and output modalities. The systems include a location tracking system, including a positioning engine and a presentation engine, an environmental tracking system, location and environmental sensors, either permanently installed or temporarily deployed, and portable devices such as mobile phones or personal digital assistants carried by the tracked resources and users. The methods include tracking such resources at a site, displaying their locations on a portable device using a visual map display, and providing the ability to initiate bi-directional audio and video communications with one of more of the tracked resources.

A sales system is described that enables fast, efficient shopping by customers, and thereby increases sales and encourages customer loyalty, while simultaneously improving store management. An electronic device, which may be mobile or stationary, and which may belong or be assigned to (or accessed by) each customer, is used to access shopping information that might not otherwise be available to the customer during shopping. For example, a personal digital assistant or information kiosk may be used to provide specific product information and complete a sale thereof, or to provide suggested purchase lists and best routes through the store during shopping. The sales system is multi-modal, so that a plurality of input modalities (such as voice or auto-id techniques) are simultaneously available to the customer. Additionally, because it is multi-modal, the system can communicate with other store items, such as shelves or shopping carts, to gain (and integrate) information about customers and the products the customers are purchasing.

Multi-modal sales applications

A system for synchronizing multiple modalities is described. A user may use multiple modalities, such as voice and browser, to interact with data on a network, such as the World Wide Web. All of the modalities may be synchronized so that all are updated when the user enters information in just one. A method of communicating between devices includes receiving a request for first-modality data that includes first content, and sending a message in response to receiving the request, the message including information allowing the request of second-modality data that includes second content overlapping the first content. Another method includes requesting first data for a first modality, the first data including first content, and automatically requesting second data for a second modality, wherein the second data includes second content that overlaps the first content.

Multi-modal synchronization

A first-modality gateway and a second-modality gateway are synchronized, with both gateways interfacing between a user and a server system. The synchronizing allows the user to use either of the first-modality gateway or the second-modality gateway at a given point in time to interface with specific information in the server system. A method includes accessing a communication sent from a first-modality gateway, and providing a synchronizing mechanism in response to accessing the communication. Another method includes receiving a request for a first-modality data from a first-modality entity, determining a second-modality data, and providing the second-modality data to a second-modality entity, where the second-modality data corresponds to the first-modality data. An article includes a first-modality interface, a second-modality interface, and a controller interface. The controller interface includes instructions that when executed by a machine result in interfacing the first-modality interface and the second-modality interface to a controller that provides synchronization.

A graphical user interface may include a form with a plurality of fields, each field associated with a predetermined category. Each category may have its own, independent, discrete grammar associated therewith, and the independent grammars may be individually activated, simultaneously with their respective categories. In this way, a voice-recognition system that is inputting spoken data for each of the fields may have a restricted grammar to search when attempting to match a particular voice input with an entry for a particular field in the form. Moreover, a global grammar that is active with any one of the independent grammars may be used to move between the fields or perform other high-level functionality not associated with any one of the independent grammars.

Growing community of inventors

Sunnyvale, CA, United States of America

Samir Raiyani