Microsoft Technology Licensing, LLC

Intel Corporation

Nokia Corporation

Leland Stanford Junior University

Nokia Technologies Oy

Gabriel Takacs

Yi Wu

Igor V Kozintsev

Radek Grzeszczuk

Bernd Girod

Maha El Choubassi

Vijay Chandrasekhar

David Maxwell Gedye

Gavin Dean Lazarow

David Chen

Matthew Sammis Ashman

Mei Chen

Ali Reza Emami

Victor Manuel Fragoso Rojas

Tracy K Ard

Shang-Hsuan Tsai

James Fletcher

Skyler Mark Goodell

Jason Matthew Cahill

David Richard Reed

Gregg Robert Wygonik

Jeroen Vanturennout

Timo Juhani Ahonen

Torfi Frans Olafsson

Jesse Dylan Merriam

Timothy Arthur Gill

Tushar Cyril Bhatnagar

Andrew Nicholas Bond

Jonathan David Hildebrandt

Jason Randall Wadsworth

Evan Lincoln Tice

Bogdan Cosmin Bucur

Richard Renchi Ma

Erik Manfred Schulz

Andrea Wolf

A scale and pose estimation method for a camera system is disclosed. Camera data for a scene acquired by the camera system is received. A scale prior parameter characterizing scale of the camera system is received. A cost of a cost function is calculated for a similarity transformation. The cost of the cost function is influenced at least by the scale prior parameter. Based at least on the cost function being less than a threshold cost, an estimated scale and pose of the camera system is output based on the similarity transformation.

Prior informed pose and scale estimation

One example provides a computing device configured to capture, via the camera, first image data imaging a first physical world location, create a first spatial representation of the first physical world location based on the first image data, receive a user input defining a pose of a first virtual spatial anchor point relative to a feature imaged in the first image data, track user movement to a second physical world location, capture second image data imaging the second physical world location, receive a user input defining a pose of a second virtual spatial anchor point relative to a feature imaged in the second image data, and send, to a remote computing device, data representing the first spatial representation, the pose of first spatial anchor point, the second spatial representation, the pose of second spatial anchor point, and a positional relationship between first and second spatial anchor points.

Connecting spatial anchors for augmented reality

In one example, a solver engine may execute a reverse calculation to determine a recipe ingredient set based on a goal descriptor describing a ceramic glaze. A descriptor interface of the solver engine may receive a goal descriptor describing a ceramic glaze. A model applicator of the solver engine may apply a glaze process model to the goal descriptor. The model applicator may automatically reverse calculate a glaze recipe describing a recipe ingredient set to produce the ceramic glaze described by the goal descriptor. A glaze mixing machine interface may direct a glaze mixing machine to mix the recipe ingredient set to produce the ceramic glaze.

Ceramic glaze mixer control

A scale and pose estimation method for a camera system is disclosed. Camera data for a scene acquired by the camera system is received. A rotation prior parameter characterizing a gravity direction is received. A scale prior parameter characterizing scale of the camera system is received. A cost of a cost function is calculated for a similarity transformation that is configured to encode a scale and pose of the camera system. The cost of the cost function is influenced by the rotation prior parameter and the scale prior parameter. A solved similarity transformation is determined upon calculating a cost for the cost function that is less than a threshold cost. An estimated scale and pose of the camera system is output based on the solved similarity transformation.

Systems, apparatuses and methods to provide image data, augmented with related data, to be displayed on a mobile computing device are disclosed. An example mobile device includes a camera to provide images of a scene from different angles to a server, at least one sensor to sense a position and an orientation of the camera, and a screen to present augmented reality data over the scene based on the position and the orientation of the camera and on a three-dimensional representation of the scene based on the images.

Mobile augmented reality system

Described herein is a system and method of generating precise location information. Feature points of an image are received from a user device (e.g., mobile phone). Location information of the user device (e.g., GPS coordinates) and relative transform information from the user device are also received. An image anchor is identified based upon the received feature points, relative transform information, and the received location information. Precise location information of the identified image anchor is provided to the user device. The precise location information of the identified image anchor is based upon filtered feature points, location information and relative transform information received from a plurality of user devices over a period of time (e.g., hours, days, weeks, months). The precise location information of the identified image anchor is updated based upon the location information of the user device and the relative transform information received from the user device.

Generation of precise geospatial coordinates

A computing device and method are provided for accelerating the coarse relocalization process of the computing device by generating a current fingerprint using signal data detected by sensors, statistically analyzing the current fingerprint for proximity to candidate fingerprints in fingerprint data to generate a ranked list, and subsequently retrieving map data corresponding to the closest matching fingerprints in the ranked list. The computing device may comprise a processor, a memory operatively coupled to the processor, and a fingerprint program stored in the memory and executed by the processor.

Coarse relocalization using signal fingerprints

Mixed-reality systems are provided for using anchor data structures, such as anchor graphs, within a mixed-reality environment. These systems utilize anchor components, such as anchor vertexes, that comprise at least one first key frame, a first mixed-reality element, and at least one first transform connecting the at least one first key frame to the first mixed-reality element. Anchor connecting components, such as anchor edges, comprise transformations that connect the anchor components (e.g., anchor vertexes).

Sharing of sparse slam coordinate systems

Mixed-reality systems are provided for using anchor graphs within a mixed-reality environment. These systems utilize anchor vertexes that comprise at least one first key frame, a first mixed-reality element, and at least one first transform connecting the at least one first key frame to the first mixed-reality element. Anchor edges comprising transformations connect the anchor vertexes.

Systems and methods for utilizing anchor graphs in mixed reality environments

Embodiments of the invention relate to systems, apparatuses and methods to provide image data, augmented with related data, to be displayed on a mobile computing device. Embodiments of the invention display a live view augmented with information identifying an object amongst other objects. Embodiments of the invention may utilize other related data, such as 3D point cloud data, image data and location data related to the object, to obtain a specific location of an object within the live view. Embodiments of the invention may further display a live view with augmented data three-dimensionally consistent with the position and orientation of the image sensor of the mobile computing device.

A method, apparatus and computer program product may be provided for generating a plurality of compressed feature descriptors that can be represented by a relatively small number of bits, thereby facilitating transmission and storage of the feature descriptors. A method, apparatus and computer program product may also be provided for permitting a compressed representation of a feature descriptor to be compared with a plurality of compressed representations of feature descriptors of respective predefined features. By permitting the comparison to be performed utilizing compressed representations of feature descriptors, a respective feature descriptor may be identified without having to first decompress the feature descriptor, thereby potentially increasing the efficiency with which feature descriptors may be identified.

Method and apparatus for representing and identifying feature descriptors utilizing a compressed histogram of gradients

The disclosure relates to a method in which one or more local descriptors relating to an interest point of an image are received. A global descriptor is determined for the image on the basis of the one or more local descriptors; and the global descriptor is compressed. The disclosure also relates to an apparatus comprising a processor and a memory including computer program code, and storage medium having stored thereon a computer executable program code for use by an apparatus.

Method for image processing and an apparatus

Growing community of inventors

Santa Clara, CA, United States of America

Gabriel Takacs