Massachusetts Institute of Technology

Yunzhu Li

Wojciech Matusik

Tomas Apostol Palacios

Antonio Torralba

Wan Shou

Michael J Foshey

Yiyue Luo

Pratyusha Sharma

Systems and methods are provided for estimating 3D poses of a subject based on tactile interactions with the ground. Test subject interactions with the ground are recorded using a sensor system along with reference information (e.g., synchronized video information) for use in correlating tactile information with specific 3D poses, e.g., by training a neural network based on the reference information. Then, tactile information received in response to a given subject interacting with the ground can be used to estimate the 3D pose of the given subject directly, i.e., without reference to corresponding reference information. Certain exemplary embodiments use a sensor system in the form of a pressure sensing carpet or mat, although other types of sensor systems using pressure or other sensors can be used in various alternative embodiments.

Systems and methods for estimating 3D position and movement from tactile signals

Growing community of inventors

Cambridge, MA, United States of America

Yunzhu Li