Cognex Corporation

Cognex Technology and Investment Corporation

Gognex Technology and Investment Corporation

Xiangyun Ye

James A Negro

Aaron S Wallack

Xianju Wang

Sateesha Nadabar

Lifeng Liu

Ahmed El-Barkouky

David Y Li

Guruprasad Shivaram

Cyril C Marrion

David J Michael

William M Silver

Ivan A Bachelder

Nigel John Foster

Sateesh Nadabar

Earle Stokes

Steven G Webster

Robb Robles

Jozsef Borovszki

Fenghua Jin

David Vekony

Xiangju Wang

A system may comprise a transport device for moving at least one object, wherein at least one substantially planar surface of the object is moved in a known plane locally around a viewing area, wherein the substantially planar surface of the object is occluded except when the at least one substantially planar surface passes by the viewing area, at least one 2D digital optical sensor configured to capture at least two sequential 2D digital images of the at least one substantially planar surface of the at least one object that is moved in the known plane around the viewing area, and a controller operatively coupled to the 2D digital optical sensor, the controller performing the steps of: a) receiving a first digital image, b) receiving a second digital image, and c) stitching the first digital image and the second digital image using a stitching algorithm to generate a stitched image.

Systems and methods for stitching sequential images of an object

In accordance with some embodiments of the disclosed subject matter, methods, systems, and media for generating images of multiple sides of an object are provided. In some embodiments, a method comprises receiving information indicative of a 3D pose of a first object in a first coordinate space at a first time; receiving a group of images captured using at least one image sensor, each image associated with a field of view within the first coordinate space; mapping at least a portion of a surface of the first object to a 2D area with respect to the image based on the 3D pose of the first object; associating, for images including the surface, a portion of that image with the surface of the first object based on the 2D area; and generating a composite image of the surface using images associated with the surface.

Methods, systems, and media for generating images of multiple sides of an object

This invention provides a system and method for runtime determination (self-diagnosis) of camera miscalibration (accuracy), typically related to camera extrinsics, based on historical statistics of runtime alignment scores for objects acquired in the scene, which are defined based on matching of observed and expected image data of trained object models. This arrangement avoids a need to cease runtime operation of the vision system and/or stop the production line that is served by the vision system to diagnose if the system's camera(s) remain calibrated. Under the assumption that objects or features inspected by the vision system over time are substantially the same, the vision system accumulates statistics of part alignment results and stores intermediate results to be used as indicator of current system accuracy. For multi-camera vision systems, cross validation is illustratively employed to identify individual problematic cameras. The system and method allows for faster, less-expensive and more-straightforward diagnosis of vision system failures related to deteriorating camera calibration.

System and method for runtime determination of camera miscalibration

Systems and methods for reading a two-dimensional matrix symbol or for determining if a two-dimensional matrix symbol is decodable are disclosed. The systems and methods can include a data reading algorithm that receives an image, locates at least a portion of the data modules within the image without using a fixed pattern, fits a model of the module positions from the image, extrapolates the model resulting in predicted module positions, determines module values from the image at the predicted module positions, and extracts a binary matrix from the module values.

Systems and methods for decoding two-dimensional matrix symbols with incomplete or absent fixed patterns

A system and method for robustly calibrating a vision system and a robot is provided. The system and method enables a plurality of cameras to be calibrated into a robot base coordinate system to enable a machine vision/robot control system to accurately identify the location of objects of interest within robot base coordinates.

System and method for robust calibration between a machine vision system and a robot

A method and apparatus for decoding codes applied to objects for use with an image sensor that includes a two dimensional field of view (FOV), the method comprising the steps of providing a processor programmed to perform the steps of obtaining an image of the FOV and applying different decode algorithms to code candidates in the obtained image to attempt to decode the code candidates wherein the decode algorithm applied to each candidate is a function of the location of the code candidate in the FOV.

Method and apparatus for performing different decoding algorithms in different locations

This invention provides a system and method for finding features in images that exhibit saddle point-like structures using relatively computationally low-intensive processes, illustratively consisting of an anti-correlation process, and associated anti-correlation kernel, which operates upon a plurality of pixel neighborhoods within the image. This process enables an entire image to be quickly analyzed for any features that exhibit such saddle point-like structures by determining whether the anti-correlation kernel generates a weak or strong response in various positions within the image. The anti-correlation kernel is designed to generate a strong response regardless of the orientation of a saddle point-like structure. The anti-correlation process examines a plurality of pixel neighborhoods in the image, thereby locating any saddle point-like structures regardless of orientation, as it is angle-independent. The structures are then grouped and refined (for example in a grid) in an effort to locate and decode ID topologies within the image.

System and method for finding saddle point-like structures in an image and determining information from the same

Systems and methods for decoding two-dimensional matrix symbols

A method and apparatus for decoding codes applied to objects for use with an image sensor that includes a two dimensional field of view (FOV), the method including the steps of providing a processor programmed to perform the steps of obtaining an image of the FOV, attempting to decode a code candidate in the image using a first decode algorithm, and where the attempt to decode the code candidate fails, maintaining the image in memory. The method including repeating the above steps until one of a threshold number of attempts to decode the code candidate have failed and the code candidate has been successfully decoded. Further, the method includes accessing the images maintained in memory and attempting to decode the code candidate in at least a subset of the images stored in memory using a second decode algorithm that is different than the first decode algorithm.

Method and apparatus for performing different decoding algorithms using number of attempts

This invention provides a system and method to validate the accuracy of camera calibration in a single or multiple-camera embodiment, utilizing either 2D cameras or 3D imaging sensors. It relies upon an initial calibration process that generates and stores camera calibration parameters and residual statistics based upon images of a first calibration object. A subsequent validation process (a) acquires images of the first calibration object or a second calibration object having a known pattern and dimensions; (b) extracts features of the images of the first calibration object or the second calibration object; (c) predicts positions expected of features of the first calibration object or the second calibration object using the camera calibration parameters; and (d) computes a set of discrepancies between positions of the extracted features and the predicted positions of the features. The validation process then uses the computed set of discrepancies in a decision process that determines whether at least one of the discrepancies exceeds a predetermined threshold value. If so, recalibration is required. Where multiple cameras are employed, extrinsic parameters are determined and used in conjunction with the intrinsics.

Growing community of inventors

Framingham, MA, United States of America

Xiangyun Ye