Microsoft Technology Licensing, LLC

Guojun Chen

Xin Tong

Yue Dong

Pingchao Yu

Yingnan Ju

Implementations of the subject matter described herein relate to mixed reality object rendering based on ambient light conditions. According to the embodiments of the subject matter described herein, while rendering an object a wearable computing device acquires light conditions of the real world, thereby increasing the reality of the rendered object. In particular, the wearable computing deice is configured to acquire an image of an environment where the wearable computing deice is located. The image is adjusted based on a cement parameter used when the image is captured. Subsequently, ambient light information is determined based on the adjusted image. In this way, the wearable computing deice can obtain more real and accurate emblem light information, so as to render to the user an object with enhanced reality. Accordingly, the user can have a better interaction experience.

Ambient light based mixed reality object rendering

Implementations of the subject matter described herein relate to mixed reality object rendering based on ambient light conditions. According to the embodiments of the subject matter described herein, while rendering an object, a wearable computing device acquires light conditions of the real world, thereby increasing the reality of the rendered object. In particular, the wearable computing device is configured to acquire an image of an environment where the wearable computing device is located. The image is adjusted based on a camera parameter used when the image is captured. Subsequently, ambient light information is determined based on the adjusted image. In this way, the wearable computing device can obtain more real and accurate ambient light information, so as to render to the user an object with enhanced reality. Accordingly, the user can have a better interaction experience.

Implementations of the subject matter described herein relate to mixed reality rendering of objects. According to the embodiments of the subject matter described herein, while rendering an object, a wearable computing device takes lighting conditions in the real world into account, thereby increasing the reality of the rendered object. In particular, the wearable computing device acquires environment lighting information of an object to be rendered and renders the object to a user based on the environment lighting information. In this way, the object rendered by the wearable computing device can be more real and accurate. The user will thus have a better interaction experience.

Mixed reality object rendering based on environment lighting

In accordance with implementations of the subject matter described herein, there is provided a solution of lighting estimation. In the solution, an input image about a real object and a depth map corresponding to the input image are obtained. A geometric structure of the scene in the input image is determined based on the depth map. Shading and shadow information on the real object caused by a light source in the scene is determined based on the determined geometric structure of the scene. Then, a lighting condition in the scene caused by the light source is determined based on the input image and the shading and shadow information. The virtual object rendered using the lighting condition obtained according to the solution can exhibit a realistic effect consistent with the real object.

Growing community of inventors

Redmond, WA, United States of America

Guojun Chen