Sony Depthsensing Solutions Sa/nv

Softkinetic Software

Sony Depthsensing Solutions

Antoine Rennuit

Laurent Guigues

Kevin Simons

David Dal Zot

Jeremie Roy

Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions. From depth images provided by a range finding imaging system, the method enables efficient and robust detection of a particular sequence of natural gestures including a beginning (start), and an ending (stop) of a predetermined type of natural gestures for delimiting the period during which a control (interaction) gesture is operating in an environment wherein a user is freely moving his hands. The invention is more particularly, although not exclusively, concerned by detection without any false positives nor delay, of intentionally performed natural gesture subsequent to a starting finger tip or hand tip based natural gesture so as to provide efficient and robust navigation, zooming and scrolling interactions within a graphical user interface up until the ending finger tip or hand tip based natural gesture is detected.

Human-to-computer natural three-dimensional hand gesture based navigation method

Described herein is a method and system for marker-less three-dimensional modelling, fitting and tracking of a skeletal representation of an object in a three-dimensional point cloud. In particular, it concerns the tracking of a human user skeletal representation with respect to time. The method comprises inputting a three-dimensional point cloud derived from a depth map; predetermining a set of control points representing the skeleton of the user, determining a start-up skeleton pose, obtaining an orthographic representation of the user 3D point cloud projected onto a grid by sampling the 3D point cloud with a predetermined static size, determining a set of curvature centers points approximating central axes of main parts of the user, determining the torso plane, and refining and/or defining the principal direction of the body. The method comprises then the step of performing iterative local and global fittings of the set of control points onto the user 3D point cloud and the associated data such as the curvature center points, using topological and geometric constraints so that to track skeleton posture along the time. Stabilizing the skeleton pose; resolving ambiguities; and providing a suitable output are then the last steps of a preferred embodiment of the invention.

Three-dimensional object modeling fitting and tracking

Growing community of inventors

La Madeleine, France

Antoine Rennuit