Siemens Energy, Inc.

Siemens Corporation

Siemens Corporate Research, Inc.

Siemens Medical Solutions Usa, Inc.

Siemens Healthcare Diagnostics Gmbh

Siemens Product Lifecycle Management Software Inc.

Yakup Genc

Clifford Hatcher

Nassir Navab

Xiang Zhang

Gang Li

Richard Michael Hatley

Forrest R Ruhge

Dennis H Lemieux

Yanghai Tsin

Binglong Xie

Himanshu Bhatnagar

Visvanathan Ramesh

Jan Ernst

Sajjad Hussain Baloch

Robert E Shannon

Fredrick Michael Davis

Hesam Najafi

Mihran Tuceryan

Frank Sauer

Alexander Gelbman

Anton Schick

Erwan Baleine

Sandeep M Naik

Edward Slavin, Iii

Roy Barr

Xiang Gao

Siddharth Ram Chhatpar

Vijay Kumar

Daniel Sacco

Sergey Kabanov

Yan Li

Frank Dierkes

Erin McGarrity

Jr Clifford Hatcher

Systems and methods for inspecting a device include arranging the device in a known position relative to a plurality of movable cameras mounted on a controllable actuator controlled by a computing device and pointed at the device by controlling the controllable actuator to position a camera with a user interface on the computing device with a display, and the display displays a virtual image from the camera into CAD model of the device and an image of the device generated by the camera in a side-by-side or in an overlay fashion or both.

System and method for side-by-side inspection of a device

A rotating rotor in a turbine has blades attached. At least one blade is a reference blade of which a reference position is determined by a Once-Per-Rotation sensor. A camera positioned at a viewing port takes a sequence of images of all the blades during a rotation at a trigger moment determined by a controller. The controller receives a signal indicating that the reference blade passes its reference point. The controller is provided with data about the number of blades, the position of the camera and a desired dwell of an image related to the blade. The controller calculates the trigger moments and generates trigger signals to the camera. The trigger moment is adjusted for changing rotor speed by extracting a blade feature from blade images. The camera records images that are labeled and stored as image data on a storage device.

Trigger for blade imaging based on a controller

Computer assisted design data is rendered in the cloud. A client-server relationship is provided for 3D rendering. To reduce the burden on the server, the 3D rendering adapts based on the client capabilities. Where possible, some of the 3D rendering is performed by the server and some by the client machine. The 3D rendering by the client machine may be limited to avoid transfer of geometrical data of the CAD data. Different textures or shaders are used for rendering images associated with motion. Dictionary information is accumulated by the client machine to reduce the number of coefficients later transferred to the client machine for 3D rendering. The model represented by the CAD data is used to predict rendered images so that video compression may be performed. The server sparsely renders an image and compressive sensing is used by the client machine to generate the complete image.

Rendering of design data

A multi-view stereo approach generates an inventory of objects located on an object holder. An object may be a sample tube and an object holder may be a tube rack as used in lab automation for healthcare diagnostics. A processor performs 3D tracking of the object holder and the geometric analysis of multiple images generated by a calibrated camera. A homography mapping between images is utilized to warp a second image to a viewpoint of a first image. Plane induced parallax causes a normalized cross-correlation score between the first image and the warped second image of a location on the holder that has an object that is significantly different from a normalized cross-correlation score of a location that has not an object and enables the processor to infer tube inventory and absence or presence of a tube at a location in a rack.

Multi-view stereo systems and methods for tube inventory in healthcare diagnostics

An on-line optical inspection and monitoring system is externally mounted to existing man way service access within the combustor housing. A replacement man way cover having an optical window is mounted to the combustor housing. One or more optical cameras are oriented so that the camera field of view (FOV) is directed through the man way cover optical window. The camera FOV is moved to plural positions within the combustion section, such as under control of an automated motion control system, and images are captured. Multiple images are combined to form a composite image, which may include an image of an entire transition within the combustion section. Visual images and/or infrared (IR) thermal images may be captured. Thermal image information is correlated with component temperature. Image information is utilized to determine vibration characteristics of the imaged components.

System and method for on line monitoring within a gas turbine combustor section

Active lighting is provided for stereo reconstruction () of edges () of a Delta-8 bundle. Stereo images of a device with edges () are captured (). The image capture () is repeated under different lighting conditions, such as illuminating () the edges () from different directions. The images from each viewing or capture direction are combined (). The combined images are used to stereographically reconstruct () the edges ().

Active lighting for stereo reconstruction of edges

Two adjacent objects with a gap between the objects rotate in a hot atmosphere with a temperature greater than 300 F in a gas turbine. Automatic and accurate contactless measurement of the gap is performed by taking images of the gap. An image, preferably an infra-red image is taken from the gap, a processor extracts the two edges from the image of the gap. The processor also determines a line through the pixels of an edge by applying a Hough transform on the pixels. The edges are substantially parallel. A line substantially perpendicular to the lines is also determined. Using the substantially parallel lines and the line substantially perpendicular to the substantially parallel lines the processor determines a width of the gap.

Hough transform approach to gap measurement in blade inspection

Internal components of gas or steam turbines are inspected with a 3D scanning camera inspection system that is inserted and positioned within the turbine, for example through a gas turbine combustor nozzle port. Three dimensional internal component measurements are performed using projected light patterns generated by a stripe projector and a 3D white light matrix camera. Real time dimensional information is gathered without physical contact, which is helpful for extracting off-line engineering information about the scanned structures. Exemplary 3D scans, preferably with additional visual images, are performed of the gas path side of a gas turbine combustor support housing, combustor basket and transition with or without human intervention.

System and method for visual inspection and 3D white light scanning of off-line industrial gas turbines and other power generation machinery

Internal components of power generation machinery, such as gas and steam turbines are inspected with an optical camera inspection system that is capable of automatically positioning the camera field of view (FOV) to an area of interest within the machinery along a pre-designated navigation path and capturing images without human intervention. Automatic camera positioning and image capture can be initiated automatically or after receipt of operator permission. The pre-designated navigation path can be defined by operator manual positioning of an inspection scope within the power machine or a similar one of the same type and recording of positioning steps for future replication. The navigation path can also be defined by virtual simulation.

System and method for automated optical inspection of industrial gas turbines and other power generation machinery

Systems and methods for inspecting a device are disclosed. The method includes arranging the device in a known position relative to a plurality of movable cameras. The plurality of movable cameras is mounted on a controllable actuator. The plurality of cameras is pointed at the device by controlling the controllable actuator to position the camera with a user interface. An image of the device generated by the camera is displayed on a mobile and wireless display. The computing device also causes a rendered virtual image of the device to be displayed on the mobile and wireless display. A stream of interest and a region of interest is selected at the mobile and wireless display from the images generated by the cameras.

Systems and methods for hands free inspection

A system and methods for geometric calibration and use of head-worn multi-camera eye tracking system are provided. The system calibrates the internal and external parameters of the cameras as well as the parameters of a compact geometric model of the human eye. An exo-camera determines a relative pose with regard to a computer monitor and endo-cameras determine the eyeball position and orientation. An endo-exo calibration and an endo-eye calibration each with an optimization step are included. A homography and a joint optimization step are also provided. A single point calibration re-establishes calibration. The system in operational mode determines a user's gaze direction to perform a computer input function.

Geometric calibration of head-worn multi-camera eye tracking system

A method for determining geometric properties of a target shape such as a shape of a perimeter of a strut shield () for use in a gas turbine (). The method includes obtaining a digital image of at least a portion of a first object including a first feature () (). The image including the first feature () is displayed on a display device (). During a reconstruction process, one or more control points (A,B,C,D) are associated with feature points (A,B,C) along an extent of the displayed first feature () (). Using the associated one or more control points (A,B,C andD), a data file is created that corresponds to the first feature () (). The data file includes geometric properties of the feature points (A,B,C).

Mapping of a contour shape to an X and Y coordinate system

Internal components of power generation machinery, such as gas and steam turbines are inspected with an optical camera inspection system that is capable of automatically positioning the camera field of view (FOV) to an area of interest within the machinery along a pre-designated navigation path and capturing images without human intervention. Automatic camera positioning and image capture can be initiated automatically or after receipt of operator permission. The pre-designated navigation path can be defined by operator manual positioning of an inspection scope within the power machine or a similar one of the same type and recording of positioning steps for future replication. The navigation path can also be defined by virtual simulation. The inspection system includes an articulated multi-axis inspection scope.

System and method for automated optical inspection of industrial gas turbines and other power generation machinery with articulated multi-axis inspection scope

An object in a hot atmosphere with a temperature greater than 400 F in a gas turbine moves in a 3D space. The movement may include a vibrational movement. The movement includes a rotational movement about an axis and a translational movement along the axis. Images of the object are recorded with a camera, which may be a high-speed camera. The object is provided with a pattern that is tracked in images. Warpings of sub-patches in a reference image of the object are determined to form standard format warped areas. The warpings are applied piece-wise to areas in following images to create corrected images. Standard tracking such as SSD tracking is applied to the piece-wise corrected images to determine a movement of the object. The image correction and object tracking are performed by a processor.

Motion analysis through geometry correction and warping

A method of using a Graphic User Interface (GUI) for interactive virtual inspection of modeled objects. The method includes acquiring a three-dimensional model of a modeled object and displaying a first view of the modeled object for a user to identify locations of interest on a surface of the modeled object visible within the first view. The user enters information to create a markup tag that annotates the location of interest, and the markup tag is automatically associated with the location of interest on the modeled object. A second view of the modeled object is displayed including the user identified location of interest and the markup tag.

Growing community of inventors

Dayton, NJ, United States of America

Yakup Genc