Microsoft Technology Licensing, LLC

Jacobus A Rommelse

David Earl Heckerman

Eric I Horvitz

John S Breese

David O Hovel

Adrian C Klein

Samuel D Hobson

Gregory L Shaw

An intelligent user assistance system is disclosed. The system is constructed using a reasoning model to determine the probability of a user's intentions, goals, or informational needs in the context of a software program. This is accomplished through analysis of information about the user's actions, the program state, and spoken words. The system monitors user interaction with the software program and applies probabilistic reasoning to sense that the user may need assistance in using a particular feature or to accomplish a specific task. The inference system accesses a thorough and updateable user profile system to continually check for competencies and changes assistance that is given based on the competencies.

Intelligent user assistance facility

A general event composing and monitoring system that allows high-level events to be created from combinations of low-level events. An event specification tool allows for rapid development of a general event processor that creates high-level events from combinations of user actions. The event system, in combination with a reasoning system, is able to monitor and perform inference about several classes of events for a variety of purposes. The various classes of events include the current context, the state of key data structures in a program, general sequences of user inputs, including actions with a mouse-controlled cursor while interacting with a graphical user interface, words typed in free-text queries for assistance, visual information about users, such as gaze and gesture information, and speech information. Additionally, a method is provided for building an intelligent user interface system by constructing a reasoning model to compute the probability of alternative user's intentions, goals, or informational needs through analysis of information about a user's actions, program state, and words. The intelligent user interface system monitors user interaction with a software application and applies probabilistic reasoning to sense that the user may need assistance in using a particular feature or to accomplish a specific task. The intelligent user interface also accepts a free-text query from the user asking for help and combines the inference analysis of user actions and program state with an inference analysis of the free-text query. The inference system accesses a rich, updatable user profile system to continually check for competencies and changes assistance that is given based on user competence.

Intelligent user assistance facility for a software program

An event composing and monitoring system that allows high-level events to be created from combinations of low-level events. An event specification tool, contained in the system, allows for rapidly developing a general event processor that creates high-level events from combinations of user actions. An event system, in combination with an inference system, monitors and infers, for various purposes, about several classes of events including: current program context; state of key data structures; user input sequences, including actions with a mouse-controlled cursor while interacting with a graphical user interface; words typed in free-text help queries; visual user information, such as gaze and gesture information; and user speech information. Additionally, an intelligent user interface is provided by constructing a reasoning model that computes probability of alternative user intentions, goals or information needs through analyzing information regarding program state, and that user's actions and free-text query words. Specifically, the interface monitors user interaction with a program and probabilistically reasons to sense that a user may need assistance in using a particular feature or to accomplish a specific task. This interface accepts a free-text help query from the user and combines the inference analysis of user actions and the program state with an inference analysis of the query. The inference system, using an updateable user profile, continually checks for user competencies and, based on such competencies, changes assistance that is offered.

Growing community of inventors

Westerhoven, Netherlands

Jacobus A Rommelse