Abb Schweiz Ag

Hitachi Energy Switzerland Ag

Abb Power Grids Switzerland Ag

Carlos Winsor Morato

Biao Zhang

Thomas A Fuhlbrigge

Jianjun Wang

Carlos Martinez

Remus Boca

Daniel T Lasko

Gregory A Cole

William John Eakins

Luiz V Cheim

Harshang Shah

Poorvi Patel

Sang Joon Choi

Will J Eakins

Jan Nyqvist

Gregory F Rossano

Saumya Sharma

Andrew Salm

Harald Josef Staab

Johnny Holmberg

Jinmiao Huang

Zhou Teng

A submersible inspection drone used for inspection of liquid cooled electrical transformers can include a number of separate cameras for imaging the internal structure of the transformer. The submersible can be configured to communicate to a base station using a wireless transmitter and receiver. The cameras on the submersible can be fixed in place and can be either static or motion picture cameras. The submersible can include an input/output selector capable of switching between the camera images, either through commanded action of a user or through computer based switching. In one form the input/output selector is a multiplexer. The base station can be configured to display images from the cameras one at a time, or can include a number of separate viewing portals in which real time images are displayed. The base station can include a demultiplexer synchronized to the multiplexer of the submersible.

Submersible inspection device and wireless communication with a base station

A submersible remotely operable vehicle used for inspection of liquid cooled electrical transformers can include a number of separate cameras and sensors for mapping and navigating the internal structure of the transformer with liquid coolant remaining in the transformer. The remotely operable vehicle can be wirelessly controlled to perform various inspection functions while the number of cameras provide video streams for processing to produce a three dimensional field of view based on an observation position of the remotely operable vehicle.

Submersible inspection vehicle with navigation and mapping capabilities

A submersible vehicle which includes a plurality of cameras can be used to collect visual images of an object of interest submerged in a liquid environment, such as in a tank (e.g. transformer tank). In one form the submersible vehicle is remotely operated such as an ROV or an autonomous vehicle. Image information from the submersible along with inertial measurements in some embodiments is used with a vision based modelling system to form a model of an internal object of interest in the tank. The vision based modelling system can include a number of processes to form the model such as but not limited to tracking, sparse and dense reconstruction, model generation, and rectification.

Submersible inspection device and vision based modelling

A robot is configured to perform a task on an object using a method for generating a 3D model sufficient to determine a collision free path and identify the object in an industrial scene. The method includes determining a predefined collision free path and scanning an industrial scene around the robot. Stored images of the industrial scene are retrieved from a memory and analyzed to construct a new 3D model. After an object is detected in the new 3D model, the robot can further scan the image in the industrial scene while moving along a collision free path until the object is identified at a predefined certainty level. The robot can then perform a robot task on the object.

Method and system to generate a 3D model for a robot scene

A robotic unit for manipulating items and products may receive assistance from a product management system if an exception occurs indicating the robotic unit cannot complete a given task with respect to handling the product. The product management system may be associated with a plurality of different assistance centers and response centers providing different types or levels of assistance. The product management system can classify the exception according to hierarchal tiers to determine the type of assistance required. The product management system can then generate and direct an intervention request to one of the response centers based on the classification. The assistance and response centers may be equipped and staffed to provide particularized assistance to the robotic unit. In an example, the robotic unit may store data and instructions received from the assistance and response center for future implementation.

Exception handling for robot assisted product management

A submersible inspection device used for inspection of, for example, liquid cooled electrical transformers can include a number of separate cameras for imaging the internal structure of the transformer. The submersible can be configured to communicate to a base station using a number of wireless transmitters and receivers. Signals transmitted to the submersible include command signals useful to effect an action on the submersible but also a heartbeat signal to indicate health of the transmitted signal. A redundant channel selection logic is provided to switch from a channel which no longer receives a heartbeat to another channel that includes a current heartbeat. Multiple signals can be received and evaluated in software, and another signal received via a firmware radio.

Submersible inspection device and redundant wireless communication with a base station

In one embodiment, the present disclosure provides a robot automated mining method. In one embodiment, a method includes a robot positioning a charging component for entry into a drill hole. In one embodiment, a method includes a robot moving a charging component within a drill hole. In one embodiment, a method includes a robot filling a drill hole with explosive material. In one embodiment, a method includes operating a robot within a mining environment.

Robot automated mining

Automatic scanning and representing an environment having a plurality of features, for example, includes scanning the environment along a scanning path, interspersing a plurality of localized scanning of the plurality of features in the environment during the scanning along the scanning path of the environment wherein the interspersed localized scanning of the plurality of features in the environment being different from the scanning the environment along the scanning path, and obtaining a representation of at least a portion of the environment based on the scanning of the environment and the interspersed localized scanning of the plurality of features in the environment.

Automatically scanning and representing an environment having a plurality of features

Automatic scanning and representing an environment with collision avoidance includes, for example, obtaining a first representation of the environment using a first scanning path, determining a second scanning path based on the first representation of the environment operable to avoid contact with the environment when obtaining a second representation of the environment, obtaining the second representation of the environment based on the second scanning path, and wherein the second representation of the environment is different from the first representation of the environment. The method may be employed in imaging and/or representing a rock wall having a plurality of spaced-apart holes for receiving charges for mining.

Automatically scanning and representing an environment with collision avoidance

Robot positioning is facilitated by obtaining, for each time of a first sampling schedule, a respective indication of a pose of a camera system of a robot relative to a reference coordinate frame, the respective indication of the pose of the camera system being based on a comparison of multiple three-dimensional images of a scene of an environment, the obtaining providing a plurality of indications of poses of the camera system; obtaining, for each time of a second sampling schedule, a respective indication of a pose of the robot, the obtaining providing a plurality of indications of poses of the robot; and determining, using the plurality of indications of poses of the camera system and the plurality of indications of poses of the robot, an indication of the reference coordinate frame and an indication of a reference point of the camera system relative to pose of the robot.

Facilitating robot positioning

Three-dimensional visual servoing for positioning a robot in an environment is facilitated. Three-dimensional point cloud data of a scene of the environment is obtained, the scene including a feature. The three-dimensional point cloud data is converted into a two-dimensional image, and a three-dimensional position of the feature is identified based on the two-dimensional image. An indication of the identified three-dimensional position of the feature is then provided.

Growing community of inventors

Avon, CT, United States of America

Carlos Winsor Morato