Honda Motor Co., Ltd.

Karankumar Patel

Nawid Jamali

Soshi Iba

Huckleberry Febbo

Itoshi Naramura

Akinobu Hayashi

Snehal Dikhale

Daksh Dhingra

Systems and methods for visuo-tactile object pose estimation are provided. In one embodiment, a computer implemented method includes receiving image data, depth data, and tactile data about the object in the environment. The computer implemented method also includes generating a visual estimate of the object that includes an object point cloud. The computer implemented method further includes generating a tactile estimate of the object that includes a surface point cloud based on the tactile data. The computer implemented method yet further includes estimating a pose of the object based on the visual estimate and the tactile estimate by fusing the object point cloud and the surface point cloud in a 3D space. The pose is a six-dimensional pose.

Systems and methods for visuo-tactile object pose estimation

Systems and methods for tactile output estimation are provided. In one embodiment, the system includes a depth map module, an estimation module, and a surface module. The depth map module is configured to identify a region of interest (RoI) of an object. The area of the RoI corresponds to a tactile sensor size of a tactile sensor. The depth module is further configured to receive depth data for the RoI from a depth sensor and generate a depth map for the RoI based on a volume of the depth data relative to a frame of reference of the RoI. The estimation module is configured to estimate a tactile sensor output based on the depth map. The surface module configured to determine surface properties based on the estimated tactile sensor output.

Systems and methods for estimating tactile output based on depth data

Systems and methods for visuo-tactile object pose estimation are provided. In one embodiment, a method includes receiving image data about an object and receiving depth data about the object. The method also includes generating a visual estimate of the object based on the image data and the depth data. The method further includes receiving tactile data about the object. The method yet further includes generating a tactile estimate of the object based on the tactile data. The method includes estimating a pose of the object based on the visual estimate and the tactile estimate.

Growing community of inventors

Sunnyvale, CA, United States of America

Karankumar Patel