Varjo Technologies Oy

Varjo Technologies Dy

Oleksandr Dovzhenko

Roman Golovanov

Juha Ala-luhtala

Ville Timonen

Petteri Timonen

Joni-Matti Määttä

Tuomas Tölli

Tarek Mohsen

A tracking system includes light sources arranged spatially around user-interaction controller(s) of head-mounted device; a controller-pose-tracking means is arranged in the user-interaction controller(s); an HMD-pose-tracking means and camera(s) arranged on a portion of HMD that faces a real-world environment. Processor(s) are configured to estimate a relative pose of the controller(s) with respect to the HMD, determine current value and/or pulse width modulation (PWM) value to be employed for controlling brightness of light source(s) from amongst the light sources, generate control signal for setting current value and/or PWM value for light source(s), and send a control signal to controller(s). The process image(s) captured by camera(s) identify blob(s) representing light source(s) and correct estimated relative pose, based on at least one of: position, orientation, brightness, size, shape, of the blob(s).

Adjusting brightness of light sources of controller

A method including: receiving visible-light images captured using camera(s) and depth data corresponding to said images; identifying image segments of visible-light image that represent objects or their parts belonging to different material categories; detecting whether at least two adjacent image segments in visible-light image pertain to at least two different material categories related to same object category; and when it is detected that at least two adjacent image segments pertain to at least two different material categories related to same object category, identifying at least two adjacent depth segments of depth data corresponding to at least two adjacent image segments; and correcting errors in optical depths represented in at least one of at least two adjacent depth segments, based on optical depths represented in remaining of at least two adjacent depth segments.

Depth maps and 3D reconstruction with segmentation masks

A tracking system for use in head-mounted device (HMD) includes light sources arranged spatially around user-interaction controller(s); controller-pose-tracking means arranged in user-interaction controller(s); HMD-pose-tracking means; camera(s) arranged on portion of HMD that faces real-world environment in which HMD is in use; and processor(s) configured to estimate relative pose, based on controller-pose-tracking data and HMD-pose-tracking data; determine sub-set of light sources, based on estimated relative pose and arrangement of light sources; selectively control light sources such that light sources of sub-set are activated, whereas remaining light sources are deactivated; process at least one image, captured by camera(s), to identify operational state of light source(s) of sub-set that is visible in image(s), wherein image(s) is indicative of actual relative pose; and correct estimated relative pose to determine actual relative pose, based on operational state.

Tracking system and method incorporating selective control of light sources of controller

Growing community of inventors

Espoo, Finland

Oleksandr Dovzhenko