Honeywell International Inc.

Michal Kosik

Marketa Szydlowska

David Chrapek

Katerina Chmelarova

Dominik Kadlcek

Sergij Cernicko

Ondrej Pokorny

Dinkar A Mylaraswamy

Jiri Vasek

Matej Dusik

Patrik Moravek

Jindrich Finda

A method and system for generating attention pointers, including: displaying, in a display of a mobile device, an object within and outside a field of view (FOV) of an user wherein the object outside the FOV are real objects; monitoring, by a processor of the mobile device, for a change in the object within and outside the FOV; in response to a change, generating by the processor one or more attention pointers within the FOV of the user for directing user attention to the change in the object which is either inside or outside the FOV; and displaying, by the processor, on a virtual screen within the FOV to the user, the one or more attention pointers wherein the one or more attention pointers are dynamically configured to interact with the user in response to detections based on a movement of the user or the object within or outside the FOV of the user.

Method and system for spawning attention pointers (APT) for drawing attention of an user in a virtual screen display with augmented and virtual reality

Disclosed are systems, methods, and non-transitory computer-readable medium for data input with multi-format validation. The method may include receiving data input via a microphone mounted on a user device and receiving the data input via a camera mounted on the user device. Additionally, the method may include comparing the data input via the microphone and the data input via the camera and determining whether the comparison of the data input exceeds a predetermined confidence level. Additionally, the method may include storing the data input, upon determining that the comparison of the data input exceeds the predetermined confidence level and presenting to the user a notification of validation upon determining that the comparison of the data input does not exceed the predetermined confidence level. Additionally, the method may include receiving from the user a validation of the data input based on the notification of validation and storing the data input based on the validation of the data input.

Systems and methods to verify values input via optical character recognition and speech recognition

Systems and methods for augmented reality (AR) safe visualization for use with a near to eye (NTE) display system worn by a user are provided. The system includes: a processor programmed with an AR program and a task database storing task data; and, a camera mounted to the NTE display system and providing video input. The processor receives the video input and coordinates video image processing of the video input to identify therein a user's hand and an object. The processor receives an intended task from the user and retrieves associated task data based thereon. The processor processes the task data with the intended task to render a visualized item, such as a job card. The processor determines when the visualized item is in front of the hand while the user is performing the task and removes the visualized item responsive thereto.

Methods and systems for augmented reality safe visualization during performance of tasks

According to certain aspects of the disclosure, a computer-implemented method may be used for overlay display. The method may include displaying, by the one or more processors, information in an overlay; determining, by the one or more processors, a field of view of the user based on determining a positioning of the user device; determining, by the one or more processors, whether the overlay meets a minimum visibility criteria based on the positioning of the user device; and displaying, by the one or more processors, a minimum viewable portion of the overlay in the field of view of the user upon determining that the overlay does not meet the minimum visibility criteria.

Systems and methods for overlays in an augmented and virtual reality environment

Method and system for spawning attention pointers (ATP) for drawing attention of an user in a virtual screen display with augmented and virtual reality

A method to augment, virtualize, or present mixed reality of content to display a larger amount of content on a head worn device (HWD) including: creating a set of virtual screens in the display of the HWD deployed in a manner to both surround and positionally shift from a movement of the viewer to provide an immersive viewing experience wherein the set of virtual screens include: at least a primary virtual screen and one or more secondary virtual screens; enabling the immersive viewing experience by generating dynamic virtual screen arrangements; connecting a first sensor attached to a head of the viewer and a second sensor attached to a torso of the viewer for generating sensed data of rotating differences of the positionally shift of the viewer; and configuring the content on each of the virtual screens to determine a particular virtual screen having a visual attention of the viewer.

Method and system for user-related multi-screen solution for augmented reality for use in performing maintenance

Systems and methods for an enhanced computer vision module are presented. The system receives host locating information, and determines a position and a location of the host based on the host locating information. The system determines a field of view (FOV) of the host based on the host locating information, and controls a camera associated with the host that is configured to record a video stream comprising the FOV. The system and method provide an improvement over conventional computer vision (CV) systems by utilizing object locating information that is transmitted, and also by keeping a storage table of learned and fixed objects. The provided system and method improve the efficiency of object recognition and computer aided maintenance (CAM).

Enhanced computer vision using object location information

A maintenance assistance system and method of operating are provided. The maintenance assistance system may include, but is not limited to, a camera, a heads-up display, a memory configured to maintenance task data, and a processor communicatively coupled to the camera, the heads-up display and the memory, the processor configured to determine a component to be serviced, determine a location of the component based upon data from the camera and the maintenance task data stored in the memory, generate graphical data based upon a maintenance step associated with the component, and output the generated graphical data to the heads-up display

Growing community of inventors

Dolny Kubin, Slovakia

Michal Kosik