Motion Metrics International Corp.

Roboticvisiontech LLC

Braintech Canada, Inc.

Mohammad Sameti

Shahram Tafazoli Bilandi

Saman Nouranian

Mahdi Ramezani

Simona Liliana Pescaru

Remus Boca

Babak Habibi

Ian Law Bell

Saeed Karimifard

Purang Abolmaesumi

Nima Ziraknejad

Amin Suzani

Nazanin Hamzei

Haobing Chu

Aylin Azmin

Enoch Chow

Sahar Ghavidel

Kenneth Smith

Glen Richard Floyd Turner

Hou-Yin Daniel Ko

Matthew Alexander Baumann

Neda Parnian

An apparatus for analyzing a payload being transported in a load carrying container of a vehicle is disclosed. The apparatus includes a camera disposed to successively capture images of vehicles traversing a field of view of the camera. The apparatus also includes at least one processor in communication with the camera, the at least one processor being operably configured to select at least one image from the successively captured images in response to a likelihood of a vehicle and load carrying container being within the field of view in the at least one image, and image data associated with the least one image meeting a suitability criterion for further processing. The further processing includes causing the at least one processor to process the selected image to identify a payload region of interest within the image and to generate a payload analysis within the identified payload region of interest based the image data associated with the least one image.

Apparatus for analyzing a payload being transported in a load carrying container of a vehicle

A computer processor implemented method and system for monitoring a condition associated with operating heavy equipment is disclosed. The method involves receiving a plurality of images at an interface of an embedded processor disposed on the heavy equipment, the images providing a view of at least an operating implement of the heavy equipment. The method also involves processing each of the plurality of images using a first neural network implemented on the embedded processor, the first neural network having been previously trained to identify regions of interest within the image. Each region of interest has an associated designation as at least one of a critical region suitable for extraction of critical operating condition information required for operation of the heavy equipment, and a non-critical region suitable for extraction of non-critical operating condition information associated with the operation of the heavy equipment. The method further involves causing the embedded processor to initiate further processing of image data associated with critical regions to generate local output operable to alert an operator of the heavy equipment of the associated critical operating condition. The method also involves transmitting image data associated with non-critical regions to a remote processor, the remote processor being operably configured for further processing of the image data and to generate output signals representing results of the further processing. The method further involves receiving the output signals generated by the remote processor at one of the embedded processor or another processor associated with a heavy equipment operations worksite, the output signals being presentable via an electronic user interface based at least in part on the output signals to indicate the results of the further processing.

Method, apparatus and system for monitoring a condition associated with operating heavy equipment such as a mining shovel or excavator

A method and apparatus for processing an image of fragmented material to identify fragmented material portions within the image is disclosed. The method involves receiving pixel data associated with an input plurality of pixels representing the image of the fragmented material. The method also involves processing the pixel data using a convolutional neural network, the convolutional neural network having a plurality of layers and producing a pixel classification output indicating whether pixels in the input plurality of pixels are located at one of an edge of a fragmented material portion, inwardly from the edge, and at interstices between fragmented material portions. The convolutional neural network includes at least one convolution layer configured to produce a convolution of the input plurality of pixels, the convolutional neural network having been previously trained using a plurality of training images including previously identified fragmented material portions. The method further involves processing the pixel classification output to associate identified edges with fragmented material portions.

Method and apparatus for identifying fragmented material portions within an image

A method and apparatus for locating and/or determining the condition of a wear part in an image of an operating implement associated with heavy equipment is disclosed. The method involves capturing at least one image of the operating implement during operation of the heavy equipment, the image including a plurality of pixels each having an intensity value. The method also involves selecting successive pixel subsets within the plurality of pixels, and processing each pixel subset to determine whether pixel intensity values in the pixel subset meet a matching criterion indicating a likelihood that the pixel subset corresponds to the wear part. The matching criterion is based on processing a labeled set of training images during a training exercise prior to capturing the at least one image of the operating implement.

Method and apparatus for locating a wear part in an image of an operating implement

A method and apparatus for performing a fragmentation assessment of a material including fragmented material portions is disclosed. The method involves receiving two-dimensional image data representing a region of interest of the material, and processing the 2D image data to identify features of the fragmented material portions. The method also involves receiving a plurality of three dimensional point locations on surfaces of the fragmented material portions within the region of interest, identifying 3D point locations within the plurality of three dimensional point locations that correspond to identified features in the 2D image, and using the identified corresponding 3D point locations to determine dimensional attributes of the fragmented material portions.

Method and apparatus for performing a fragmentation assessment of a material

A method of three-dimensional object location and guidance to allow robotic manipulation of an object with variable position and orientation using a sensor array which is a collection of one or more sensors capable of forming a single image.

Method and apparatus for single image 3D vision guided robotics

A system and method facilitate machine-vision, for example three-dimensional pose estimation for target objects, using one or more images sensors to acquire images of the target object at one or more positions, and to identify features of the target object in the resulting images. A set of equations is set up exploiting invariant physical relationships between features such as constancy of distances, angles, and areas or volumes enclosed by or between features. The set of equations may be solved to estimate a 3D pose. The number of positions may be determined based on the number of image sensors, number of features identified, and/or number of known physical relationships between less than all features. Knowledge of physical relationships between image sensors and/or between features and image sensors may be employed. A robot path may be transformed based on the pose, to align the path with the target object.

Method and apparatus for machine-vision

Growing community of inventors

Coquitlam, Canada

Mohammad Sameti