Other

Openstream Inc.

Voicebox Technologies Corporation

Cerence Operating Company

Philip R Cohen

David R McGee

Rajasekhar Tumuluri

Lucian Galescu

Paulo Barthelmess

Scott Lind

Edward C Kaiser

Methods and systems for multimodal collaborative plan-based dialogue. The multimodal collaborative plan-based dialogue system includes multiple sensors to detect multimodal inputs from a user. The multimodal collaborative plan-based dialogue system includes a multimodal sematic parser that generates logical forms based on the multimodal inputs. The multimodal collaborative plan-based dialogue system includes a dialogue manager that infers a goal of the user from the logical forms and develops a plan that includes communicative actions with regard to the goal.

Multimodal collaborative plan-based dialogue

Methods and systems for multimodal collaborative conversational dialogue are disclosed. The multimodal collaborative conversational dialogue system include a multimodal avatar interface and one or more sensors, which obtains one or more multimodal inputs. A multimodal semantic parser generates one or more logical form representations based on the one or more multimodal inputs. A collaborative dialogue manager infers a goal of the user from the one or more logical form representations, and develops a plan including communicative actions and non-communicative actions with regard to the goal. The multimodal avatar interface outputs one or more multimodal collaborative plan-based dialogue system-generated communications with respect to execution of at least one communicative action. The collaborative dialogue manager maintains a collaborative dialogue with the user until obtainment of the goal.

Collaborative plan-based dialogue system and method

A system and method is provided for adjusting natural language conversations between a human user and a computer based on the human user's cognitive state and/or situational state, particularly when the user is operating a vehicle. The system may disengage in conversation with the user (e.g., the driver) or take other actions based on various situational and/or user states. For example, the system may disengage conversation when the system detects that the driving situation is complex (e.g., car merging onto a highway, turning right with multiple pedestrians trying to cross, etc.). The system may (in addition or instead) sense the user's cognitive load and disengage conversation based on the cognitive load. The system may alter its personality (e.g. by engaging in mentally non-taxing conversations such as telling jokes based on situational and/or user states.

System and method of conversational adjustment based on user's cognitive state and/or situational state

A decision assistance device provides a user the ability to access and obtain actionable intelligence or other information to make tactical and strategic decisions. The decision assistance device allows the user to obtain information for future, near-future, and/or real time scenarios. The device advantageously provides the information to the user in a manner that minimizes an amount of attention and interaction required by the user while still permitting the user to rapidly manipulate the device while moving down a desired decision path. The decision assistance device may take a physical or virtual form.

Decision assistance device and methods of using same

The system and method as described herein can be advantageously used in a plurality of scenarios, two of which include field markup and data collection and collaborative review. The system and method handles the allocation of digital paper pattern background and the creation of required page definition files embedded into digital paper enabled PDFs. Optionally, action palettes can be automatically overlaid on the drawings as legend boxes to enable field personnel to select the operations they want to perform on the digital paper as they would on a computer interface. For instance letting users select the types of callouts and clouds to add to their markup. These drawings can be printed or plotted onto paper and sent to a work site for markup.

Growing community of inventors

Deer Harbor, WA, United States of America

Philip R Cohen