Cognex Corporation

Cognex Technology and Investment Corporation

Other

Michael, David J.

Aaron S Wallack

David J Michael

William M Silver

Adam Wagman

Lifeng Liu

Cyril C Marrion

Xiangyun Ye

Robert A Wolff

Hongwei Zhu

Ruibing Wang

Michael C Moed

Juha Tapio Koljonen

Gang Liu

Robert Tremblay

Willard P Foster

George J Costigan

Mikhail Akopyan

Ivan A Bachelder

David Y Li

Randolph Brost

Arman M Garakani

John F Filhaber

Guruprasad Shivaram

Simon Barker

John Canny

Raymond A Fix

Kenneth Y Goldberg

Robert Shillman

Laurens Nunnink

Nathaniel R Bogan

Karen B Sarachik

Nigel John Foster

Andrew Hoelscher

Xiaoguang Wang

Russ Weinzimmer

Ali Moghaddam Zadeh

Karen Roberts

Hongjun Jia

Matthew R Reome

Edward Collins

Benjamin D Klass

Roger Sumner

This invention provides an easy-to-manufacture, easy-to-analyze calibration object which combines measurable and repeatable, but not necessarily accurate, 3D features&#x2014;such as a two-sided calibration object/target in (e.g.) the form of a frustum, with a pair of accurate and measurable features, more particularly parallel faces separated by a precise specified thickness, so as to provide for simple field calibration of opposite-facing DS sensors. Illustratively, a composite calibration object can be constructed, which includes the two-sided frustum that has been sandblasted and anodized (to provide measurable, repeatable features), with a flange whose above/below parallel surfaces have been ground to a precise specified thickness. The 3D corner positions of the two-sided frustum are used to calibrate the two sensors in X and Y, but cannot establish absolute Z without accurate information about the thickness of the two-sided frustum; the flange provides the absolute Z information.

System and method for calibrating a plurality of 3D sensors with respect to a motion conveyance

This invention provides a system and method for training and performing runtime 3D pose determination of an object using a plurality of camera assemblies in a 3D vision system. The cameras are arranged at different orientations with respect to a scene, so as to acquire contemporaneous images of an object, both at training and runtime. Each of the camera assemblies includes a non-perspective lens that acquires a respective non-perspective image for use in the process. The searched object features in one of the acquired non-perspective image can be used to define the expected location of object features in the second (or subsequent) non-perspective images based upon an affine transform, which is computed based upon at least a subset of the intrinsics and extrinsics of each camera. The locations of features in the second, and subsequent, non-perspective images can be refined by searching within the expected location of those images. This approach can be used in training, to generate the training model, and in runtime operating on acquired images of runtime objects. The non-perspective cameras can employ telecentric lenses.

System and method for training a model in a plurality of non-perspective cameras and determining 3D pose of an object at runtime with the same

A system and method for robustly calibrating a vision system and a robot is provided. The system and method enables a plurality of cameras to be calibrated into a robot base coordinate system to enable a machine vision/robot control system to accurately identify the location of objects of interest within robot base coordinates.

System and method for robust calibration between a machine vision system and a robot

This invention provides a system and method for concurrently (i.e. non-serially) calibrating a plurality of 3D sensors to provide therefrom a single FOV in a vision system that allows for straightforward setup using a series of relatively straightforward steps that are supported by an intuitive graphical user interface (GUI). The system and method requires minimal data input about the scene or calibration object used to calibrate the sensors. 3D features of a stable object, typically employing one or more subobjects, are first measured by one of the image sensors, and then the feature measurements are used in a calibration in which each of the 3D sensors images a discrete one of the subobjects, resolves features thereon and computes a common coordinate space between the plurality of 3D sensors. Sensor(s) can be mounted on the arm of an encoderless robot or other conveyance and motion speed can be measured in setup.

System and method for calibrating one or more 3D sensors mounted on a moving manipulator

The present disclosure provides a high resolution structured light system that is also capable of maintaining high throughput. The high resolution structured light system includes one or more image capture devices, such as a camera and/or an image sensor, a projector, and a blurring element. The projector is configured to project a binary pattern so that the projector can operate at high throughput. The binary projection pattern is subsequently filtered by the blurring element to remove high frequency components of the binary projection pattern. This filtering smoothes out sharp edges of the binary projection pattern, thereby creating a blurred projection pattern that changes gradually from the low value to the high value. This gradual change can be used by the structured light system to resolve spatial changes in the 3D profile that could not otherwise be resolved using a binary pattern.

High speed structured light system

This invention provides a system for measuring displacement of an object surface having a displacement sensor that projects a line on the object surface and receives light from the projected line at an imager in a manner defines a plurality of displacement values in a height direction. A vision system processor operates on rows of imager pixels to determine a laser line center in columns of imager pixels in each of a plurality of regions of interest. Each region of interest defines a plurality of rows that correspond with expected locations of the projected line on the object surface. A GUI can be used to establish the regions. In further embodiments, the system generates grayscale images with the imager. These grayscale images can be compared to a generated height image to compensate for contrast-induced false height readings. Imager pixels can be compared to a reference voltage to locate the line.

System and method for efficient surface measurement using a laser displacement sensor

This invention provides a system and method for concurrently (i.e. non-serially) calibrating a plurality of 3D sensors to provide therefrom a single FOV in a vision system that allows for straightforward setup using a series of relatively straightforward steps that are supported by an intuitive graphical user interface (GUI). The system and method requires minimal input significant data about the imaged scene or calibration object used to calibrate the sensors, thereby effecting a substantially 'automatic' calibration procedure. 3D features of a stable object, typically employing a plurality of 3D subobjects are first measured by one of the plurality of image sensors, and then the feature measurements are used in a calibration in which each of the 3D sensors images a discrete one of the subobjects, resolves features thereon and computes a common coordinate space between the plurality of 3D sensors. Laser displacement sensors and a conveyor/motion stage can be employed.

This invention provides a system and method for estimating match of a 3D alignment pose of a runtime 3D point cloud relative to a trained model 3D point cloud. It includes scoring a match of a candidate pose of the runtime 3D point cloud relative to the trained model 3D point cloud, including a visibility check that comprises (a) receiving a 3D camera optical center (b) receiving the trained model 3D point cloud; (c) receiving the runtime 3D point cloud; and (d) constructing a plurality of line segments from the optical center to a plurality of 3D points in the 3D point cloud at the runtime candidate pose. A system and method for determining an accurate representation of a 3D imaged object by omitting spurious points from a composite point cloud based on the presence or absence of such points in a given number of point clouds is also provided.

System and method for improved scoring of 3D poses and spurious point removal in 3D image data

This invention provides a system and method for reading and decoding ID features located on a surface of a curved, sloped and/or annular object, such as a tire moving on a conveyor. A plurality of 3D sensors are operatively connected to a vision system processor. The sensors are calibrated by calibration parameters to generate a stitched-together 3D image of a field of view in a common coordinate space. A motion conveyance (e.g. a conveyor) causes the object and the 3D sensors to move in relative motion, and the conveyance provides motion information to the vision system processor. An ID finder locates ID features within a version of the 3D image and a decoder (e.g. an OCR reader) generates data from the ID features. The ID finder can locate a trained portion of the ID and the search for variable code elements at a known orientation relative to the trained portion.

System and method for reading and decoding ID codes on a curved, sloped and/or annular object

This invention provides a system and method to validate the accuracy of camera calibration in a single or multiple-camera embodiment, utilizing either 2D cameras or 3D imaging sensors. It relies upon an initial calibration process that generates and stores camera calibration parameters and residual statistics based upon images of a first calibration object. A subsequent validation process (a) acquires images of the first calibration object or a second calibration object having a known pattern and dimensions; (b) extracts features of the images of the first calibration object or the second calibration object; (c) predicts positions expected of features of the first calibration object or the second calibration object using the camera calibration parameters; and (d) computes a set of discrepancies between positions of the extracted features and the predicted positions of the features. The validation process then uses the computed set of discrepancies in a decision process that determines whether at least one of the discrepancies exceeds a predetermined threshold value. If so, recalibration is required. Where multiple cameras are employed, extrinsic parameters are determined and used in conjunction with the intrinsics.

System and method for validating camera calibration in a vision system

The disclosed apparatus, systems, and methods provide for a displacement sensor with a multi-position image sensor. The displacement sensor includes an optical lens. The displacement sensor includes an image sensor configured to view an object through the lens along a plane of focus that is not parallel to an image plane of the image sensor. The displacement sensor includes a laser for illuminating the object by the displacement sensor, wherein the laser is: spaced from the lens at a fixed distance, and configured to project a line of light along the plane of focus of the image sensor. The displacement sensor comprises a first configuration wherein the image sensor is at a first location along an image plane with a first field of view along the plane of focus, and a second configuration at a second location with a different field of view.

Apparatus, systems, and methods for a multi-position image sensor

Growing community of inventors

Natick, MA, United States of America

Aaron S Wallack