Aquifi, Inc.

Packsize LLC

Imimtek, Inc.

Carlo Dal Mutto

Abbas Rafii

Michele Stoppa

Giuliano Pasqualotto

Francesco Peruch

Giridhar Murali

Giulio Marin

Jason A Trachewsky

Kinh Tieu

Britta Silke Hummel

Aryan Hazeghi

Alvise Memo

Tony Zuccarino

Keith Blackstone

David Demirdjian

Teresa Mao

Ahmed Tashrif Kamal

Robert Hayes

Duc Nguyen

Amir Hossein Khalili

Chase Garber

Alexander Ou

Paolo Di Febbo

Jackson Masters

Pietro Salvagnini

Eric Webb

David Girdwood

A keypoint detection system includes: a camera system including at least one camera; and a processor and memory, the processor and memory being configured to: receive an image captured by the camera system; compute a plurality of keypoints in the image using a convolutional neural network including: a first layer implementing a first convolutional kernel; a second layer implementing a second convolutional kernel; an output layer; and a plurality of connections between the first layer and the second layer and between the second layer and the output layer, each of the connections having a corresponding weight stored in the memory; and output the plurality of keypoints of the image computed by the convolutional neural network.

Systems and methods for keypoint detection with convolutional neural networks

A method for calibrating a camera group includes: controlling a first and second cameras to capture first and second images of a first scene, the first camera having a first field of view (FOV), the second camera having a second FOV overlapping the first FOV in a first overlap region; the first scene including a calibration target in the first overlap region; computing a first relative pose based on the first and second images; controlling the second camera and a third camera to capture third and fourth images of a second scene, the third camera having a third FOV overlapping the second FOV in a second overlap region, the second scene including a calibration target in the second overlap region; computing a second relative pose based on the third and fourth images; and computing a third relative pose based on the first and second relative poses.

Systems and methods for multi-camera placement

A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.

System and method for three-dimensional scanning and for capturing a bidirectional reflectance distribution function

A method for performing automatic visual inspection includes: capturing visual information of an object using a scanning system including a plurality of cameras; extracting, by a computing system including a processor and memory, one or more feature maps from the visual information using one or more feature extractors; classifying, by the computing system, the object by supplying the one or more feature maps to a complex classifier to compute a classification of the object, the complex classifier including: a plurality of simple classifiers, each simple classifier of the plurality of simple classifiers being configured to compute outputs representing a characteristic of the object; and one or more logical operators configured to combine the outputs of the simple classifiers to compute the classification of the object; and outputting, by the computing system, the classification of the object as a result of the automatic visual inspection.

Systems and methods for joint learning of complex visual inspection tasks using computer vision

A method for estimating tightly enclosing bounding boxes by a computing system includes: controlling a scanning system including one or more depth cameras to capture visual information of the scene including one or more objects; detecting the one or more objects of the scene based on the visual information; singulating each the one or more objects from the frame of the scene to generate one or more 3D models corresponding to the one or more objects, the one or more 3D models including a partial 3D model of a corresponding one of the one or more objects; extrapolating a more complete 3D model of the corresponding one of the one or more objects based on the partial 3D model; and estimating a tightly enclosing bounding box of the corresponding one of the one or more objects based on the more complete 3D model.

Systems and methods for object dimensioning based on partial visual information

A method for automatically recognizing content of labels on objects includes: capturing visual information of an object using a scanning system including one or more cameras, the object having one or more labels on one or more exterior surfaces; detecting, by a computing system, one or more surfaces of the object having labels; rectifying, by the computing system, the visual information of the one or more surfaces of the object to compute one or more rectified images; and decoding, by the computing system, content of a label depicted in at least one of the one or more rectified images.

Systems and methods for text and barcode reading under perspective distortion

A system for acquiring three-dimensional (3-D) models of objects includes a first camera group including: a first plurality of depth cameras having overlapping fields of view; a first processor; and a first memory storing instructions that, when executed by the first processor, cause the first processor to: control the first depth cameras to simultaneously capture a first group of images of a first portion of a first object; compute a partial 3-D model representing the first portion of the first object; and detect defects in the first object based on the partial 3-D model representing the first portion of the first object.

Systems and methods for three-dimensional data acquisition and processing under timing constraints

A method for classifying physical objects includes: controlling, by a processor, one or more depth cameras to capture depth images of a query object; controlling, by the processor, one or more color cameras to capture a color images of the query object; computing, by the processor, a three-dimensional (3D) model of the query object using the depth images; combining, by the processor, the color images with the 3D model; computing, by the processor, a descriptor from the 3D model and the color images, the descriptor including: a multi-dimensional shape descriptor space representation of a 3D shape of the query object; a multi-dimensional color descriptor space representation of a texture of the query object; and a one-dimensional size descriptor space representation of a size of query object; supplying, by the processor, the descriptor to a classifier to compute a classification of the query object; and outputting the classification of the query object.

Systems and methods for shape-based object retrieval

A method for generating a three-dimensional model of an object, by a scanning system including a client-side device including: an acquisition system configured to capture images; and an interaction system including a display device and a network interface includes: capturing a plurality of images of the object by the acquisition system, the images being captured from a plurality of different poses of the acquisition system; computing depth maps from the images of the objects, each of the depth maps corresponding to one of the poses of the acquisition system; combining the depth maps to generate a combined point cloud; and displaying, on the display device, the combined point cloud or a 3D mesh model generated from the combined point cloud.

System and method for portable active 3D scanning

A method for identifying and tracking objects includes: capturing one or more 3-D models of one or more objects in a scene using a three-dimensional (3-D) scanning system, the one or more 3-D models including color and geometry information of the one or more objects; and computing, by an analysis agent, one or more descriptors of the one or more 3-D models, each descriptor corresponding to a fixed-length feature vector; and retrieving metadata identifying the one or more objects based on the one or more descriptors.

Systems and methods for object identification using a three-dimensional scanning system

Growing community of inventors

Sunnyvale, CA, United States of America

Carlo Dal Mutto