International Business Machines Corporation

Activision Publishing, Inc.

Daniel A Oblinger

Vittorio R Castelli

Lawrence David Bergman

Tessa Ann Lau

Neal Martin Keller

Debra L Biebesheimer

Stephen J Rolando

Mark Edward Podlaseck

Donn P Jasura

Dimitri Kanevsky

Sara H Basson

Eugene Rogan Creswick

Peter Kenneth Malkin

Thomas David Erickson

Prabhakar Nandavar Kudva

Emmanuel Yashchin

Brent Tzion Hailpern

Wendy Anne Kellogg

Dynamic modification of user interfaces is disclosed, based upon identification of the current state of the user and the sensing of a particular situation in which the user is involved and/or environment in which the user is situated. In particular, emotional and mental states of a user are identified and these states are taken into consideration when creating and/or adapting an interface to be used by the user. The interface is modified/created automatically based on identified user biometrics, that is, measured physical properties of the user.

Predictive user modeling in user interface design

Systems and methods for dynamically generating computer executable technical support procedures, as well as updating/augmenting such executable procedures, by tracking and processing sequences of actions (execution traces) that are taken by experts (or users) when performing a procedure or when executing an executable procedure.

Systems and methods for generating and distributing executable procedures for technical desk-side support

Under the present invention, an illustrative feature is to provide a method and system/structure for remotely controlling multiple computer systems by interacting with GUIs. Specifically, the present invention allows a controlled computer/system to be remotely controlled via a controlling computer/system. To this extent, data/action capture instrumentation is provided on the controlling system for automatically creating a representation of content of the GUI of the controlling system, for automatically observing a set of actions performed by a user on the GUI of the controlling system, for automatically creating a representation of the observed actions, and for sending to the controlled system the representation of the observed actions. In addition, execution instrumentation is provided on the controlled system for receiving the representation and replicating the actions on the controlled system by interacting with a GUI of the controlled system.

Remote GUI control by replication of local interactions

There is provided an apparatus for aligning document actions specified in a documented procedure with demonstrated user actions. The apparatus includes an alignment device for computing an alignment between the document actions and the demonstrated user actions based on at least one similarity metric.

Method for aligning demonstrated user actions with existing documentation

As indicated above, an exemplary feature of the present invention is to automatically identify corresponding GUI elements on different computer systems, or the same computer system at different points in time. Specifically, under the present invention, a user action on a widget of a GUI provided by an application loaded a first computer system is observed, and information about the widget(s) involved in the user action as well as on all other widget(s) in the GUI is collected and associated with the user action. Thereafter a widget(s) (on which the user action is to be performed) of a GUI provided by the application as loaded on a second computer system is robustly identified using the collection information. Then, the action is performed on the identified widget(s). In identifying the widget(s), the present invention utilizes a set of hard and soft constraints to identify a matching widget(s).

Method and system for mapping GUI widgets

Techniques for altering application user-interface controls are provided. More particularly the customization of a new or existing user-interface control in an application user-interface is provided. In one aspect of the invention, a method for customizing user-interface controls of an existing application comprises the recording of a procedure description performed by a user in the application user-interface. A new or modified application user-interface control relating to the procedure description is then installed in the existing application.

Methods and apparatus for customizing user-interface control in existing application

A system and method for obtaining a process definition; determining the current process; determining the current process step; determining whether a whether a user has requested creation or modification of an annotation of the current process or step; receiving information from the user for creating the annotation when a user has requested creation of an annotation; and displaying the annotation.

Method for providing dynamic process step annotations

A system for and method of constructing an executable reusable procedure which includes determining an executable procedure from at least one scored trace of a procedure execution.

Method for constructing autonomic advisors and learning procedural knowledge from scored examples

A method and system for generating one or more Computer-executable procedures simultaneously learns from a collection of procedure instances recorded by different users on a variety of computers aligning multiple traces and using the aligned traces to generalize.

Alignment and generalization of demonstrated procedure traces

A method and apparatus improve the synchronization and presentation of an exchange of messages between two or more users during an on-line Internet messaging session. This method and apparatus discriminate which messages from a sender correspond to replies from a recipient and presents these messages in an orderly, time-sequenced fashion using color schemes or separate presentation windows which improves the overall readability and efficiency of the communication. Additionally, the method and apparatus provide a level of identity security. As a user enters messages, the typing style, speech patterns, or biometrics of all the users are monitored and will issue warnings whenever a change is detected, possibly indicating someone other then the original user is now sending messages. Alternatively, or in addition, a user may be asked a series of random questions and another user will evaluate answers provided to those questions to determine whether a user's identity is false.

Smart messenger

A system and method for clustering user contexts in a customer self service system that performs resource search and selection. The customer self service system includes a context attribute database comprising types of user contexts and one or more context attributes associated with each user context for processing by the system, and context attribute function database comprising functions for computing values for each context attribute. The context clustering system receives user interaction data from among a database of user interaction records and a distance metric for associating closeness of the user interaction data and clusters the user interaction data according to the distance metric to determine new user contexts and associated attributes for use in subsequent resource searches initiated by users in the system. Improved user query definition and resource lookup results from the new determined user context attributes. The user interaction data comprises past and present user queries, system responses to user queries, raw context information including: one or more of static, historical context, transient context, organizational context, community context, and environment context, and, other raw context associated with the user and dependent upon that user's interaction state and customer query domain.

Growing community of inventors

New York, NY, United States of America

Daniel A Oblinger