Huawei Technologies Co., Limited

Ran Cheng

Bingbing Liu

Ryan Razani

Yuan Ren

Systems, methods and apparatus for sematic segmentation of 3D point clouds using deep neural networks. The deep neural network generally has two primary subsystems: a multi-branch cascaded subnetwork that includes an encoder and a decoder, and is configured to receive a sparse 3D point cloud, and capture and fuse spatial feature information in the sparse 3D point cloud at multiple scales and multi hierarchical levels; and a spatial feature transformer subnetwork that is configured to transform the cascaded features generated by the multi-branch cascaded subnetwork and fuse these scaled features using a shared decoder attention framework to assist in the prediction of sematic classes for the sparse 3D point cloud.

Methods and systems for semantic segmentation of a point cloud

A system and method for processing a 3D point cloud to generate a segmented point cloud in real time are disclosed, the method includes: receiving a sparse 3D point cloud captured by a detection and ranging sensor mounted to a vehicle, the 3D point cloud comprising a plurality of data points, each data point in the 3D point cloud having a set of coordinates in a coordinate system of the detection and ranging sensor; generating, from the 3D point cloud, a range map comprising a plurality of elements, each of the plurality of data points of the 3D point cloud occupying a respective element of the plurality of elements; labelling the data point in each respective element of the range map as one of a pole-like data point or a vertical-plane-like data point; and generating the segmented point cloud including one or more of the labeled data points.

Method and system for real-time landmark extraction from a sparse three-dimensional point cloud

In methods and systems for graph-based panoptic segmentation of point clouds, points of a point cloud are received with a semantic label from a first category. Further, a plurality of unified cluster feature vectors from a second category are received, each being extracted from a cluster of points in the point cloud. Nodes of a constructed graph represent the unified feature vectors, and edges indicate the relationship between pairs of nodes. The edges are represented as an adjacency matrix indicating the existence or absence of an edge between pairs of nodes. A graph convolutional neural network uses the graph to predict an instance label for each node or an attribute for each edge, wherein the attribute of each edge is used for assigning the instance label to each node.

Growing community of inventors

Markham, Canada

Ran Cheng