Abb Research Ltd.

Thomas Pettersen

John Pretlove

Charlotte Skourup

Ole Arnt Anfindsen

Pierre Öberg

Christoffer Apneseth

A system that enables a user to interact with a virtual control panel using a user controlled pointing object. The system includes a portable identification element, a tracking unit adapted to capture data representing the position of the pointing object and the position of the identification element, a storage unit, storing at least one pre-defined graphical interface representing a control panel of a device, a graphics unit, generating a graphical representation of the control panel, a registering unit, registering the graphical representation of the control panel in a fixed relation to the portable identification element to produce a virtual control panel and a display unit, showing the user a view including the real world and the virtual control panel.

Virtual control panel

A method to generate technical information about a device or process by recognizing the identity of a device or process, retrieving a stored image dependent on the device, combining the stored virtual image together with an image of a real device object, displaying the combination on a display and providing a virtual control HMI means to the user for monitoring and/or controlling the device or process. A graphical user interface, computer program and a system are also described.

Method to generate a human machine interface

An augmented reality system including a camera movably located at a local site captures an image. A registering unit generates graphics and registers the generated graphics to the image from the camera to provide a composite augmented reality image. A display device located at a remote site, physically separated from the local site, displays a view including the composite augmented reality image. A communication link communicates information between the local and the remote site. A specifying unit specifies a position and an orientation in the remote site. The registering unit is adapted to register the generated graphical representation to the image in dependence of the specified position and orientation. The camera is arranged such that its position and orientation is dependent on the specified position and orientation.

Interactive and shared augmented reality system and method having local and remote access

A method and a system for use in connection with off-line programming of an industrial robot. The robot is taught a path having a number of waypoints located on or in the vicinity of at least one object to be processed by the robot. The system includes a tracking system unit adapted to provide information about the position of a part of the body of an operator pointing by the part at points on or in the vicinity of the object, a visual feed-back unit generating a visual feed-back to the operator of the position of the point being presently pointed at by the part of the body, in relation to the object, and a storage unit adapted for storing the position of the part of the body as a waypoint upon receiving a recording command.

Method and a system for programming an industrial robot

A method and a system for use in connection with programming of an industrial robot. The programming includes teaching the robot a path having a number of waypoints located on or in the vicinity of an object to be processed by the robot. The system includes elements for obtaining information about the waypoints of the path in relation to the object, a storage unit for storing the obtained information, a simulation unit for simulating the robot path based on the obtained information about the waypoints and a model of the robot, a graphics generator for generating a graphical representation of the simulated robot path, and a display member for displaying a view comprising the object and the graphical representation of the robot path projected on the object.

A method for programming an industrial robot having a tool. The method includes obtaining configuration data for the tool and for the robot path and information about the position and orientation of the object in relation to the robot, obtaining a sequence of waypoints, which defines the process in relation to the object, obtaining at least one distance for adjusting the position of a waypoint, deciding whether an obtained waypoint should be modified or not, based on the obtained information about the waypoints, generating a modified sequence of waypoints by modifying the waypoints in the obtained sequence of waypoints, based on the decision, the obtained distance and the obtained information about the waypoints and generating the actual robot path based on the modified sequence of waypoints and the obtained configuration data.

Growing community of inventors

Borgenhaugen, Norway

Thomas Pettersen