Siemens Aktiengesellschaft

Xin Ye

Wolfgang Friedrich

Wolfgang Wohlgemuth

A system and method for operating and monitoring, in particular, an automation system and/or a production machine and/or machine tool. The visual field () of a user () directed onto at least one display () is recorded and an item of speech information () of the user () is evaluated at least intermittently, such that specifically predefined information data, which is linked to the recorded visual field () and to the recorded speech information, is depicted on the display (). The predefined information data is displayed in accordance with the speech information () that is given by the user () and recognized by a speech recognition component () and in accordance with the recorded visual field (). This provides a hands-free operation of the system, machine and/or tool, and enables the user to navigate in an environment of augmented reality applications even when complex technical systems are involved.

System and method for eye tracking controlled speech processing

A system and a method for operating and monitoring, in particular, an automation system and/or a production machine or machine tool. The visual field () of a user () directed onto at least one display () is recorded. Speech information () from the user () is at least intermittently determined and a visual feedback signal is generated in response to a processing status regarding the determined speech information (). An improved speech interaction is thus obtained, in particular, in the field of augmented-reality applications and in complex technical plants.

Growing community of inventors

Erlangen, Germany

Xin Ye