Other

Apple Inc.

Douglas A Bowman

Wolf Kienzle

Patrick Steven Piemonte

Shaun D Budhram

Daniel De Rocha Rosario

Vyacheslav Leizerovich

Madhurani R Sapre

A first set of signals corresponding to a first signal modality (such as the direction of a gaze) during a time interval is collected from an individual. A second set of signals corresponding to a different signal modality (such as hand-pointing gestures made by the individual) is also collected. In response to a command, where the command does not identify a particular object to which the command is directed, the first and second set of signals is used to identify candidate objects of interest, and an operation associated with a selected object from the candidates is performed.

Command processing using multimodal signal analysis

Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, a system is provided that receives an input from a user of a mobile machine which indicates or describes an object in the world. In one example, the user may gesture to the object which is detected by a visual sensor. In another example, the user may verbally describe the object which is detected by an audio sensor. The system receiving the input may then determine which object near the location of the user that the user is indicating. Such a determination may include utilizing known objects near the geographic location of the user or the autonomous or mobile machine.

Systems and methods for determining an object through a disambiguated selection in a mixed reality interface

Growing community of inventors

Blacksburg, VA, United States of America

Douglas A Bowman