Microsoft Technology Licensing, LLC

Muhammad Jabir Kapasi

Christopher Douglas Edmonds

Daniel Joseph McCulloch

Arthur Charles Tomlin

Adam G Poulos

Yuri Pekelny

Jeffrey Alan Kohler

Anthony James Ambrus

Szymon Piotr Stachniak

Nicholas Fajt

Michael Edward Samples

Lev Cherkashin

Constantin Dulu

Michael Grabner

James Dack

Eric Scott Rehmeyer

Michelle Brook

Varun Ramesh Mani

Edward Daniel Parker

Brent Charles Allen

Cecilia Bong

Miguel Angel Susffalich

Rahul Sawhney

Improved techniques for performing object segmentation are disclosed. Surface reconstruction (SR) data corresponding to an environment is accessed. This SR data is used to generate a detailed three-dimensional (3D) representation of the environment. The SR data is also used to infer a high-level 3D structural representation of the environment. The high-level 3D structural representation is inferred using machine learning that is performed on the surface reconstruction data to identify a structure of the environment. The high-level 3D structural representation is then cut from the detailed 3D representation. This cutting process generates a clutter mesh comprising objects that remain after the cut and that are distinct from the structure. Object segmentation is then performed on the remaining objects to identify those objects.

Object segmentation using high-level structural meshes

In embodiments of a camera-based input device, the input device includes an inertial measurement unit that collects motion data associated with velocity and acceleration of the input device in an environment, such as in three-dimensional (3D) space. The input device also includes at least two visual light cameras that capture images of the environment. A positioning application is implemented to receive the motion data from the inertial measurement unit, and receive the images of the environment from the at least two visual light cameras. The positioning application can then determine positions of the input device based on the motion data and the images correlated with a map of the environment, and track a motion of the input device in the environment based on the determined positions of the input device.

Position-determining input device

Growing community of inventors

Sammamish, WA, United States of America

Muhammad Jabir Kapasi