Cognex Corporation

Pelco, Inc.

Hongwei Zhu

Farzin Aghdasi

David J Michael

Greg Max Millar

Lei Wang

Nitin M Vaidya

Aaron S Wallack

Daniel Moreno

Ruibing Wang

Ben R Carey

Nickolas James Mullan

Gilbert Chiang

Yukang Liu

Robert A Wolff

Chien-Min Huang

Zhan Jiang Ma

Gang Liu

Nathaniel R Bogan

Ali Moghaddam Zadeh

Shu Yang

Stephen J Mitchell

Matthew R Reome

Benjamin D Klass

This invention provides a system and method that efficiently detects objects imaged using a 3D camera arrangement by referencing a cylindrical or spherical surface represented by a point cloud, and measures variant features of an extracted object including volume, height, and center of mass, bounding box, and other relevant metrics. The system and method, advantageously, operates directly on unorganized and un-ordered points, requiring neither a mesh/surface reconstruction nor voxel grid representation of object surfaces in a point cloud. Based upon a cylinder/sphere reference model, an acquired 3D point cloud is flattened. Object (blob) detection is carried out in the flattened 3D space, and objects are converted back to the 3D space to compute the features, which can include regions that differ from the regular shape of the cylinder/sphere. Downstream utilization devices and/or processes, such as part reject mechanism and/or robot manipulators can act on the identified feature data.

System and method for extracting and measuring shapes of objects having curved surfaces with a vision system

The techniques described herein relate to methods, apparatus, and computer readable media configured to determining a two-dimensional (2D) profile of a portion of a three-dimensional (3D) point cloud. A 3D region of interest is determined that includes a width along a first axis, a height along a second axis, and a depth along a third axis. The 3D points within the 3D region of interest are represented as a set of 2D points based on coordinate values of the first and second axes. The 2D points are grouped into a plurality of 2D bins arranged along the first axis. For each 2D bin, a representative 2D position is determined based on the associated set of 2D points. Each of the representative 2D positions are connected to neighboring representative 2D positions to generate the 2D profile.

Methods and apparatus for extracting profiles from three-dimensional images

The techniques described herein relate to methods, apparatus, and computer readable media configured to generate point cloud histograms. A one-dimensional histogram can be generated by determining a distance to a reference for each 3D point of a 3D point cloud. A one-dimensional histogram is generated by adding, for each histogram entry, distances that are within the entry's range of distances. A two-dimensional histogram can be determined by generating a set of orientations by determining, for each 3D point, an orientation with at least a first value for a first component and a second value for a second component. A two-dimensional histogram can be generated based on the set of orientations. Each bin can be associated with ranges of values for the first and second components. Orientations can be added for each bin that have first and second values within the first and second ranges of values, respectively, of the bin.

Methods and apparatus for generating point cloud histograms

A system and method for estimating dimensions of an approximately cuboidal object from a 3D image of the object acquired by an image sensor of the vision system processor is provided. An identification module, associated with the vision system processor, automatically identifies a 3D region in the 3D image that contains the cuboidal object. A selection module, associated with the vision system processor, automatically selects 3D image data from the 3D image that corresponds to approximate faces or boundaries of the cuboidal object. An analysis module statistically analyzes, and generates statistics for, the selected 3D image data that correspond to approximate cuboidal object faces or boundaries. A refinement module chooses statistics that correspond to improved cuboidal dimensions from among cuboidal object length, width and height. The improved cuboidal dimensions are provided as dimensions for the object. A user interface displays a plurality of interface screens for setup and runtime operation.

System and method for refining dimensions of a generally cuboidal 3D object imaged by 3D vision system and controls for the same

This invention provides an easy-to-manufacture, easy-to-analyze calibration object which combines measurable and repeatable, but not necessarily accurate, 3D features&#x2014;such as a two-sided calibration object/target in (e.g.) the form of a frustum, with a pair of accurate and measurable features, more particularly parallel faces separated by a precise specified thickness, so as to provide for simple field calibration of opposite-facing DS sensors. Illustratively, a composite calibration object can be constructed, which includes the two-sided frustum that has been sandblasted and anodized (to provide measurable, repeatable features), with a flange whose above/below parallel surfaces have been ground to a precise specified thickness. The 3D corner positions of the two-sided frustum are used to calibrate the two sensors in X and Y, but cannot establish absolute Z without accurate information about the thickness of the two-sided frustum; the flange provides the absolute Z information.

System and method for calibrating a plurality of 3D sensors with respect to a motion conveyance

This invention provides a system and method for concurrently (i.e. non-serially) calibrating a plurality of 3D sensors to provide therefrom a single FOV in a vision system that allows for straightforward setup using a series of relatively straightforward steps that are supported by an intuitive graphical user interface (GUI). The system and method requires minimal data input about the scene or calibration object used to calibrate the sensors. 3D features of a stable object, typically employing one or more subobjects, are first measured by one of the image sensors, and then the feature measurements are used in a calibration in which each of the 3D sensors images a discrete one of the subobjects, resolves features thereon and computes a common coordinate space between the plurality of 3D sensors. Sensor(s) can be mounted on the arm of an encoderless robot or other conveyance and motion speed can be measured in setup.

System and method for calibrating one or more 3D sensors mounted on a moving manipulator

Systems and methods are described herein that provide a three-tier intelligent video surveillance management system. An example of a system described herein includes a gateway configured to obtain video content and metadata relating to the video content from a plurality of network devices, a metadata processing module communicatively coupled to the gateway and configured to filter the metadata according to one or more criteria to obtain a filtered set of metadata, a video processing module communicatively coupled to the gateway and the metadata processing module and configured to isolate video portions, of video the content, associated with respective first portions of the filtered set of metadata, and a cloud services interface communicatively coupled to the gateway, the metadata processing module and the video processing module and configured to provide at least some of the filtered set of metadata or the isolated video portions to a cloud computing service.

Cloud-based video surveillance management system

This invention provides a system and method for concurrently (i.e. non-serially) calibrating a plurality of 3D sensors to provide therefrom a single FOV in a vision system that allows for straightforward setup using a series of relatively straightforward steps that are supported by an intuitive graphical user interface (GUI). The system and method requires minimal input significant data about the imaged scene or calibration object used to calibrate the sensors, thereby effecting a substantially 'automatic' calibration procedure. 3D features of a stable object, typically employing a plurality of 3D subobjects are first measured by one of the plurality of image sensors, and then the feature measurements are used in a calibration in which each of the 3D sensors images a discrete one of the subobjects, resolves features thereon and computes a common coordinate space between the plurality of 3D sensors. Laser displacement sensors and a conveyor/motion stage can be employed.

This invention provides a system and method for reading and decoding ID features located on a surface of a curved, sloped and/or annular object, such as a tire moving on a conveyor. A plurality of 3D sensors are operatively connected to a vision system processor. The sensors are calibrated by calibration parameters to generate a stitched-together 3D image of a field of view in a common coordinate space. A motion conveyance (e.g. a conveyor) causes the object and the 3D sensors to move in relative motion, and the conveyance provides motion information to the vision system processor. An ID finder locates ID features within a version of the 3D image and a decoder (e.g. an OCR reader) generates data from the ID features. The ID finder can locate a trained portion of the ID and the search for variable code elements at a known orientation relative to the trained portion.

System and method for reading and decoding ID codes on a curved, sloped and/or annular object

A method of video coding includes receiving a video image having a plurality of pixels, selecting a plurality of Gaussian models for each pixel, classifying each pixel as a background or foreground pixel, determining if an object is always moving locally by detecting if an object is always moving within a predetermined distance and changing the direction of moving frequently for a second predetermined period of time, removing an object from classification as an object and ignoring motion of the object if the object is always moving locally, marking the area that the object moves within as a noisy area on a noise mask buffer, updating background models based on motion detection and noise filtering, updating current and evolving background images, and coding the current background image, background update blocks and objects for transmission.

Method and system for video coding with noise filtering

People detection can provide valuable metrics that can be used by businesses, such as retail stores. Such information can be used to influence any number of business decisions such a employment hiring and product orders. The business value of this data hinges upon its accuracy. Thus, a method according to the principles of the current invention outputs metrics regarding people in a video frame within a stream of video frames through use of an object classifier configured to detect people. The method further comprises automatically updating the object classifier using data in at least a subset of the video frames in the stream of video frames.

Online learning method for people detection and counting for retail stores

An embodiment of the present invention includes a master camera that may record master metadata regarding an object of interest and communicate the master metadata to a slave camera. The slave camera may zoom, pan, or tilt to isolate and record more detailed image data regarding the object of interest based on the master metadata. In addition, the slave camera may record slave metadata regarding the object of interest. The master and slave metadata may be stored associated with the recorded image data enabling a later search for the object of interest to be expedited. The recorded image data including the object of interest may be identified with greater ease as it may be guided by the master or slave metadata, or a combination thereof. According to embodiments presented herein, processing time for searching and identifying an object of interest may be reduced by enabling a search on the metadata associated with image data, rather than by searching the image data itself.

Growing community of inventors

Fresno, CA, United States of America

Hongwei Zhu