Vorwerk & Co Interholding Gmbh

Zspace, Inc.

Mark Wilson

Ron Domingo

Pawel Orzechowski

Stephanie Blankley

Systems and methods for six-degree of freedom (6-DoF) pose estimation of a user input device, e.g., in a three-dimensional (3D) system rendering interactive augmented reality (AR) and/or virtual reality (VR) experiences include the user input device capturing, via a camera disposed at a forward-facing tip of the user input device, images in a direction the user input device is directed and providing the images to a computer system. The user input device provides inertial measurement unit (IMU) data to the computer system as well. The computer system may then determine pose information associated with the user input device based on the images and IMU data of the user input device. The determination of the pose information may be via usage of at least one of a neural network model, estimation model trained on a set of unique and identifiable patterns, and/or an estimation model trained on a dataset of images.

Six-degree of freedom pose estimation of a stylus

Embodiments provide a method for obstacle avoidance in a mobile robot. Images of objects are captured with mobile robot image sensors with a floor level perspective. Data corresponding to the images is used to train a neural network. The identified objects are classified by indicating whether the objects are a potential hazard. In one embodiment, an image sensor on a robot provides intensity and depth data for each of a plurality of pixels of the images. The intensity and depth data are fused to produce fused data. The fused data is then used to train the neural network.

Growing community of inventors

San Jose, CA, United States of America

Mark Wilson