Siemens Healthcare Gmbh

Siemens Mobility Gmbh

Oliver Lehmann

Terrence Chen

Stefan Kluckner

Shanhui Sun

Ziyan Wu

Vivek Kumar Singh

Srikrishna Karanam

Kai Ma

Jan Ernst

Jiangping Wang

The present embodiments relate to automatically estimating a three-dimensional pose of an object from an image captured using a camera with a structured light sensor. By way of introduction, the present embodiments described below include apparatuses and methods for training a system for and estimating a pose of an object from a test image. Training and test images are sampled to generate local image patches. Features are extracted from the local image patches to generate feature databased used to estimate nearest neighbor poses for each local image patch. The closest nearest neighbor pose to the test image is selected as the estimated three-dimensional pose.

Image indexing and retrieval using local image patches for object three-dimensional pose estimation

The present embodiments relate to localizing a mobile device in a complex, three-dimensional scene. By way of introduction, the present embodiments described below include apparatuses and methods for using multiple, independent pose estimations to increase the accuracy of a single, resulting pose estimation. The present embodiments increase the amount of input data by windowing a single depth image, using multiple depth images from the same sensor, and/or using multiple depth image from different sensors. The resulting pose estimation uses the input data with a multi-window model, a multi-shot model, a multi-sensor model, or a combination thereof to accurately estimate the pose of a mobile device.

Mobile device localization in complex, three-dimensional scenes

A system and method includes creation of a combined network comprising an image segmentation network and an image representation network, the combined network to generate an image descriptor based on an input query image, training of the combined network based on a plurality of first images and a segmentation mask associated with each of the plurality of first images, reception of a first input query image, use of the combined network to generate an image descriptor based on the first input query image, determination of a matching image descriptor from a plurality of stored image descriptors, determination of a camera pose associated with the matching image descriptor, registration of the first input query image with image data based on the determined camera pose, generation of a composite image based on the registered first input query image and image data, and presentation of the composite image.

Segmentation and representation network for pose discrimination

Growing community of inventors

Princeton, NJ, United States of America

Oliver Lehmann