Motorola Corporation

Anurag Kumar Gupta

Tasos Anastasakos

William K Thompson

Ying Catherine Cheng

Hang S Lee

A method and system for assisting a user in interacting with a multi-modal dialog system () is provided. The method includes interpreting a 'What Can I Do? (WCID)' question from a user in a turn of the dialog. A multi-modal grammar () is generated, based on the current context of the dialog. One or more user multi-modal utterances are generated, based on the WCID question and the multi-modal grammar. One or more user multi-modal utterances are conveyed to the user.

Method and system for assisting users in interacting with multi-modal dialog systems

A method used in an electronic equipment () generates a set of joint multimodal interpretations () from a set of multimodal interpretations () generated by one or more modalities () during a turn, generates a set of integrated multimodal interpretations () including an integrated multimodal interpretation formed from each joint multimodal interpretation by unifying the type feature structure of each multimodal interpretation in the joint multimodal interpretation, and generates a multilevel confidence score for each integrated multimodal interpretation based on at least one of a context score, a content score, and a confidence score of the integrated multimodal interpretation. The method classifies the multimodal interpretations and generates a set of joint multimodal interpretations that comprises essentially all possible joint multimodal interpretations. The multilevel confidence scoring is based on up to eleven factors, which provides for an accurate ranking of the integrated multimodal interpretations.

Method and apparatus for classifying and ranking interpretations for multimodal input fusion

A method for multi-modal data fusion (), a multi-modal system data fusion system () and module () that in use operates by receiving segments () of multi-modal data associated respectively with a modalitiy. Initiating () a dynamically variable wait period after one of the segments is received is then performed. The dynamically variable wait period has a duration determined from data fusion timing statistics of the system (). A waiting () for reception of any further segments during the dynamically variable wait period is then effected and thereafter a fusing () of the segments received provides fused data that is sent () to a dialog manager ().

Growing community of inventors

Calcutta, India

Anurag Kumar Gupta