Siemens Corporate Research, Inc.

Siemens Energy, Inc.

Siemens Corporation

Xiang Zhang

Yakup Genc

Nassir Navab

Robert E Shannon

Fredrick Michael Davis

Vijay Kumar

Visvanathan Ramesh

Yanghai Tsin

Benedicte Bascle

Sergey Kabanov

A method of using a Graphic User Interface (GUI) for interactive virtual inspection of modeled objects. The method includes acquiring a three-dimensional model of a modeled object and displaying a first view of the modeled object for a user to identify locations of interest on a surface of the modeled object visible within the first view. The user enters information to create a markup tag that annotates the location of interest, and the markup tag is automatically associated with the location of interest on the modeled object. A second view of the modeled object is displayed including the user identified location of interest and the markup tag.

Method and system for interactive virtual inspection of modeled objects

A method of coalescing information about inspected objects. The method includes acquiring an image set of an object to be inspected, the image set having a three-dimensional model of the object and a plurality of two-dimensional images of the object. A location of interest is identified on a surface of the modeled object and global coordinate points of the three-dimensional model are designated that characterize the location of interest of the modeled object. A markup tag annotating the location of interest is associate with the designated global coordinate points of the three-dimensional model, and the markup tag is conveyed when viewing any one of the plurality of two-dimensional images of the image set that have at least one image point that correlates to a corresponding designated global coordinate point of the three-dimensional model that characterize the location of interest.

Method of coalescing information about inspected objects

A method for determining a pose of a user is provided including the steps of capturing a video image sequence of an environment including at least one coded marker; detecting if the coded marker is present in the video images; if the marker is present, extracting feature correspondences of the coded marker; determining a code of the coded marker using the feature correspondences; and comparing the determined code with a database of predetermined codes to determine the pose of the user. According to an embodiment, the coded marker includes four color blocks arranged in a square formation and the determining a code of the at least one marker further includes determining a color of each of the four blocks. According to another embodiment, the marker includes a coding matrix and a code of the marker being determined by numbered squares of the coding matrix being covered by a circle.

Coded visual markers for tracking and camera calibration in mobile computing systems

A method of tracking a pose of a moving camera includes receiving a first image from a camera, receiving a sequence of digitized images from said camera, recording, for each of said sequence of digitized images, the pose and 2D correspondences of landmarks, reconstructing a location and appearance of a 2-dimensional texture patch from 2D correspondences of the landmarks by triangulation and optimization, computing back-projection errors by comparing said reconstructed texture patch with said first received image; and reconstructing said location and appearance of said 2-dimensional texture patch from the 2D correspondences of the landmarks of said sequence of digitized images by triangulation and optimization after eliminating those landmarks with large back-projection errors.

System and method for using texture landmarks for improved markerless tracking in augmented reality applications

A computer-implemented method for object localization includes providing a plurality of tags having fixed positions within an environment and known identifications, and providing a reader, for detecting the tags and reading the identifications, wherein the reader detects a plurality of tags within a scanning volume having a known shape. The method further includes determining positions for the plurality of tags within the scanning volume, and determining a position of the reader according to the positions for the plurality of tags within the scanning volume and the known shape of the scanning volume.

Object localization

An augmented reality system includes a video source, and a database. The video source resides at a location and produces an image. At least one encoded marker resides within the image. A marker detector is coupled to the video source and is adapted to derive encoded data from the marker residing within the image. A localization processor is adapted to receive data from the marker detector and to generate data regarding location and orientation of the marker. The localization processor retrieves information from the database that is related to the location and orientation of the marker. The localization processor makes the information retrieved from the database available to a user.

Augmented reality system

A method and system for computer assisted site navigation includes capturing an image of a scene for providing real-time image data, calibrating a camera and localizing the image by utilizing the image data and retrieved marker registration and floor-map data for providing position and orientation data, transmitting the data to a web server, utilizing the image data and information on the scene retrieved from a database for deriving an augmented view, and displaying the augmented view.

Growing community of inventors

Lawrenceville, NJ, United States of America

Xiang Zhang