Varjo Technologies Oy

Vago Technologies Oy

Tomi Lehto

Ari Antti Peuhkurinen

Evgeny Zuev

Aleksei Romanov

Yuri Popov

Urho Konttori

Akseli Anttila

Ville Miettinen

Thomas Carlsson

Jaakko Viitanen

Kaj Harri Wikberg

Iurii Popov

Oleksii Shtankevych

A display system including: display apparatus; display-apparatus-tracking means; input device; processor. The processor is configured to: detect input event and identify actionable area of input device; process display-apparatus-tracking data to determine pose of display apparatus in global coordinate space; process first image to identify input device and determine relative pose thereof with respect to display apparatus; determine pose of input device and actionable area in global coordinate space; process second image to identify user's hand and determine relative pose thereof with respect to display apparatus; determine pose of hand in global coordinate space; adjust poses of input device and actionable area and pose of hand such that adjusted poses align with each other; process first image, to generate extended-reality image in which virtual representation of hand is superimposed over virtual representation of actionable area; and render extended-reality image.

Display systems and methods for aligning different tracking means

A gaze-tracking system for use in head-mounted display apparatus. The gaze-tracking system includes: illuminators; camera; and processor configured to: illuminate illuminators in sequential manner; control camera to capture eye images of user's eye during illumination of illuminators; identify reflection(s) of illuminator in eye image; determine extent of deformation in shape of reflection(s) with respect to shape of illuminator; determine extent of displacement in position of reflection(s) with respect to position of illuminator; compute user-specific score for illuminator based on extents of deformation and displacement; select illuminator(s) based on user-specific scores; illuminate illuminator(s); control camera to capture eye image of user's eye during illumination of illuminator(s); and detect gaze direction of user based upon relative position of pupil of user's eye with respect to reflections of illuminator(s) in eye image.

Gaze-tracking system and method employing selective glints

An imaging system and a method for producing extended-reality images for a display apparatus. The imaging system includes camera and processor. The processor is configured to: control camera to capture image of real-world environment; analyse captured image to identify first image segment representing input device and to determine location of at least one actionable area of input device in first image segment; determine at least one functional element to be presented for the actionable area, the functional element being indicative of at least one of: functionality of the at least one actionable area, status of the at least one actionable area; and process captured image to generate extended-reality image in which the functional element is virtually superimposed over the actionable area of input device or a virtual representation of the actionable area of input device.

Imaging system and method for producing images with virtually-superimposed functional elements

A display apparatus including image renderer, camera and processor. The processor or external processor communicably coupled to said processor is configured to: render at least one extended-reality image during first mode of operation of display apparatus; determine second mode of operation to which display apparatus is to be switched; control camera to capture at least one real-world image of real-world environment; generate at least one composite image from at least one next extended-reality image and at least one real-world image, wherein first portion of at least one composite image is derived from at least one next extended-reality image, and second portion of at least one composite image is derived from at least one real-world image; and render at least one composite image during second mode of operation of display apparatus.

Display apparatus and method for generating and rendering composite images

Growing community of inventors

Helsinki, Finland

Tomi Lehto