Apple Inc.

Jingwei Wang

Kjell Fredrik Larsson

Huy Tho Ho

Ulrich Berger

Systems and methods for moving point detection for point clouds. Some implementations may include obtaining a sequence of point clouds, wherein the sequence of point clouds includes a current point cloud, a previous point cloud that precedes the current point cloud, and a next point cloud that follows the current point cloud; inputting a voxelized representation of the current point cloud to a forward-pass recurrent neural network with a hidden state based on the previous point cloud to obtain a first voxelized activation; inputting the voxelized representation of the current point cloud to a backward-pass recurrent neural network with a hidden state based on the next point cloud to obtain a second voxelized activation; combining the first voxelized activation and the second voxelized activation to obtain a prediction of whether respective points are moving or static; and updating the current point cloud based on the prediction.

Moving point detection

Systems and methods for semantic labeling of point clouds using images. Some implementations may include obtaining a point cloud that is based on lidar data reflecting one or more objects in a space; obtaining an image that includes a view of at least one of the one or more objects in the space; determining a projection of points from the point cloud onto the image; generating, using the projection, an augmented image that includes one or more channels of data from the point cloud and one or more channels of data from the image; inputting the augmented image to a two dimensional convolutional neural network to obtain a semantic labeled image wherein elements of the semantic labeled image include respective predictions; and mapping, by reversing the projection, predictions of the semantic labeled image to respective points of the point cloud to obtain a semantic labeled point cloud.

Growing community of inventors

San Jose, CA, United States of America

Jingwei Wang