Uber Technologies, Inc.

Microsoft Technology Licensing, LLC

Taehun Yoon

Aaron Matthew Rogan

Gregory Mark Mahowald

Bradford R Clark

Michael Harrell

Systems and methods are disclosed herein for monitoring a location of a client device associated with a transportation service and generating augmented reality images for display on the client device. The systems and methods use sensor data from the client device and a device localization process to monitor the location of the client device by comparing renderings of images captured by the client device to renderings of the vicinity of the pickup location. The systems and methods determine navigation instructions from the user's current location to the pickup location and select one or more augmented reality elements associated with the navigation instructions and/or landmarks along the route to the pickup location. The systems and methods instruct the client device to overlay the selected augmented reality elements on a video feed of the client device.

Generating augmented reality images for display on a mobile device based on ground truth image rendering

Two-dimensional and three-dimensional data of a physical scene are combined and analyzed together to identify physical objects physically present in the physical scene. Image features obtained from the two-dimensional data and geometric features obtained from the three-dimensional data are combined with one another such that corresponding image features are associated with corresponding geometric features. Automated object detection mechanisms are directed to the combination of image and geographic features and consider them together in identifying physical objects from the physical scene. Such automated object detection mechanisms utilize machine learning such as selecting and tuning multiple classifiers, with each classifier identifying potential objects based on a specific set of image and geographic features, and further identifying and adjusting weighting factors to be applied to the results of such classifiers, with the weighted combination of the output of the multiple classifiers providing the resulting object identification.

Growing community of inventors

Superior, CO, United States of America

Taehun Yoon