Varjo Technologies Oy

Distance Technologies Oy

Varjo Technologies 0y

Mikko Strandborg

Mikko Ollila

Urho Konttori

Ville Miettinen

Kimmo Tapio Roimela

Thomas Carlsson

Antti Hirvonen

Joona Petrell

Petteri Timonen

Klaus Melakari

Oiva Arvo Oskari Sahlsten

Tarmo Räntilä

Ari Antti Erik Peuhkurinen

Petri Savolainen

Mikko Juhola

Ari Antti Peuhkurinen

Ville Vehkaperä

Evgeny Zuev

Antti Peuhkurinen

Harri Kapanen

Pekka Väänänen

Timo Toivanen

Juho Saarinen

Jetro Lauha

Dhiraj Neve

Disclosed is a system with an image sensor comprising a plurality of photo-sensitive cells; and processor(s) configured to: receive, from the image sensor, a plurality of image signals captured by corresponding photo-sensitive cells of the image sensor; obtain information indicative of a current pupil size of a user of a display apparatus; determine a given luminosity range corresponding to the current pupil size; and selectively perform a sequence of image signal processes on the plurality of image signals and control a plurality of parameters employed for performing the sequence of image signal processes, based on the given luminosity range, to generate an image.

Eye-directed image signal processing

At least one monocular camera is installed in a vehicle in addition to in-cabin camera(s). Images captured by the in-cabin camera(s) at a first frame rate are processed to determine first positions of facial landmark features of a user and first poses of the user's face. Images captured by the at least one monocular camera at a second frame rate, higher than the first frame rate, are processed to identify facial landmark features of the user in the second images. Second positions of the facial landmark features are determined at the second frame rate, by correlating the facial landmark features identified in the second images with the first positions of the facial landmark features determined from the first images. Second poses of the user's face are determined at the second frame rate based on the second positions of the facial landmark features and the first poses of the user's face.

Hybrid face tracking for vehicles

A multiscopic display includes an array of light-emitting cells and a multiscopic optical element including a plurality of multiscopic cells. For a given multiscopic cell, distinct sets of light-emitting cells whose emitted light is directed toward respective eyes of at least one user are identified, and at least one additional set of light-emitting cells that does not emit light directed toward any of the eyes, is separated by a distance smaller than a first predefined threshold from a single distinct set of light-emitting cells, and is separated by a distance greater than a second predefined threshold from other distinct sets of light-emitting cells is determined. Pixel values are retrieved corresponding to the distinct sets and the at least one additional set from images to be presented to the respective eyes, and are used to generate an output image for display via the multiscopic display.

View-extended multiscopic rendering

A graphical element is rasterized onto a set of light-emitting elements based on perceived shapes, perceived angular sizes and relative perceived positions of the light-emitting elements from a perspective of a given eye. Colour values, computed for the light-emitting elements based on the rasterization of the graphical element, are stored along with cadence information indicating a reference cadence of a reference light-emitting element in the set with respect to a multiscopic cell. When a cadence of a corresponding light-emitting element in another set matches the reference cadence within a predefined similarity threshold, the stored colour values are reused for light-emitting elements of the another set to display the graphical element to the given eye.

Reusing pixel-accurate graphics rasterization in multiscopic displays

A light field image is displayed via a light field display unit to produce a synthetic light field. A light-steering optical device is controlled, based on a relative location of a first eye and a second eye of user(s) with respect to an imaginary image plane, to direct light emanating from a first set of photo-emitting cells towards the first eye and light emanating from a second set of photo-emitting cells of the light-emitting surface towards the second eye. When controlling the light-steering optical device, a first viewing direction and a second viewing direction are determined for a given first photo-emitting cell and a given second photo-emitting cell, respectively. Light emanating from the given first photo-emitting cell and from the given second photo-emitting cell is directed along the first viewing direction and the second viewing direction, respectively.

Dynamic light steering based on relative location of viewer

A light field image is displayed via a light field display unit to produce a synthetic light field. A first viewing direction and a second viewing direction are determined for a given first photo-emitting cell and a given second photo-emitting cell of the light field display unit, based on a relative location of a first eye and a second eye with respect to an image plane of the light field display unit, respectively. A given first portion and a given second portion of an active optical element that lie respectively on optical paths of the given first photo-emitting cell and the given second photo-emitting cell are controlled, to direct light corresponding to the given first photo-emitting cell and light corresponding to the given second photo-emitting cell along the first viewing direction and the second viewing direction, respectively.

Parallax barrier with dynamic light steering based on relative location of viewer

A system including a tracker, a display, an optical combiner arranged on an optical path of the display and of a real-world light field of a real-world environment, at least one real-world facing camera, and at least one processor. The processor is configured to determine a relative position of each eye of at least one user with respect to the optical combiner using the tracker, generate or retrieve an image to be displayed based on the relative position of each eye of the at least one user with respect to the optical combiner, and determine a corresponding portion of the optical combiner for a given region of the image. The processor is further configured to capture at least one real-world image, calculate a colour difference and a luminance difference, adjust the graphical element based on the differences, and display the image while optically combining it with the real-world light field.

Adaptive visibility enhancement in augmented reality

An imaging system includes a controllable light source; an image sensor; metalens for focusing incoming light onto the image sensor; and processor(s). The processor(s) is configured to control a light source using a first illumination intensity and/or first illumination wavelength, while controlling the image sensor to capture first image; control the light source using a second illumination intensity and/or second illumination wavelength, while controlling the image sensor to capture a second image; calculate measured differences between pixel values of pixels in the first image and pixel values of corresponding pixels in the second image; estimate expected pixel value differences based on difference between the first and second illumination intensities and/or differences between the first and second illumination wavelengths; and correct pixel values of pixels in the first image and/or second image based on deviation in measured differences from expected differences.

Correcting images captured with metalenses using different illumination characteristics

Disclosed is data processing system having at least one server communicably couplable to at least one display apparatus, wherein at least one server has at least one processor configured to obtain quality of service information from network traffic regulator of communication network, wherein communication network is between at least one server and at least one display apparatus, obtain media processing latency information from at least one rendering application executing at the at least one server, and obtain client device operational information from at least one display apparatus; process quality of service information, media processing latency information, and client device operational information together to generate streaming configuration parameters; and control at least one rendering application to generate images for displaying at the at least one display apparatus and send images via communication network to at least one display apparatus, according to generated streaming configuration parameters.

Data processing system and method for network performance optimization

A first virtual image and a second virtual image represent virtual object(s) from a perspective of a first eye and a second eye of user(s). A union of first image segment(s) in the first virtual image and second image segment(s) in the second virtual image that represent the virtual object(s) is determined. A given portion of a transparent display whereat said union is to be presented is determined. A light field image is displayed via the transparent display, whilst controlling a controllable parallax barrier arranged on an optical path of the transparent display. The step of controlling the controllable parallax barrier comprises activating a given portion of the controllable parallax barrier that corresponds to the given portion of the transparent display.

Augmenting reality with multiscopic see-through display

A display device includes a backlight unit that is controllable to switch between lights of different colours having specific wavelengths, and an active panel including a liquid crystal (LC) layer. A multi-band reflective coating on an optical combiner is configured to selectively reflect the lights having the specific wavelengths. Different sets of drive signals are generated for different sub-images of an image. LC cells of the LC layer are controlled individually using the different sets of drive signals according to a predefined sequence in which the sub-images are to be displayed, whilst controlling the backlight unit to switch between lights of different colours according to the predefined sequence, thereby producing a synthetic light field corresponding to the image. The optical combiner is employed to selectively reflect the synthetic light field towards eyes of user(s), whilst optically combining a real-world light field with the synthetic light field.

Narrowband reflective optical combiner with narrowband display device having multi-coloured backlight unit

A 3D bounding volume within which a graphical element is to be rasterized for a given eye is determined. A set of light-emitting elements from which light is directed toward the given eye along a direction intersecting the 3D bounding volume is identified. For each light-emitting element in the set, its perceived shape and angular size from a perspective of the given eye is determined. The graphical element is rasterized onto the set of light-emitting elements based at least on relative perceived positions of the light-emitting elements from the perspective of the given eye, and their perceived shape and their perceived angular size. A colour value is computed for each light-emitting element in the set based on the rasterization of the graphical element. A synthetic light field is then produced displaying the graphical element, using computed colour values for the light-emitting elements in the set.

Pixel-accurate graphics rasterization for multiscopic displays

Disclosed is an apparatus and a method for depth sensing that includes a scanning light source configured to sequentially illuminate an environment utilizing a scan pattern. The apparatus also includes a birefringent layer adapted to receive and split reflected scan pattern from the environment into an ordinary ray (O-ray) image and an extraordinary ray (E-ray) image. The apparatus further includes an imaging sensor positioned along an optical path of the birefringent layer to capture the O-ray image and the E-ray image as transmitted therefrom. The apparatus further includes a processor configured to compute differences between positions of the O-ray image and the E-ray image and derive a depth map of the environment based on the computed differences.

Depth sensing for extended reality (XR) apparatus

A display device includes laser light sources of different colours and at least one light guide. The at least one light guide includes a light outlet including a plurality of exit portions, and is controllable to sequentially guide light rays emitted by the laser light sources towards different exit portions of the light outlet. A pixel of an image is displayed by: (i) determining a corresponding exit portion, based on a pixel location of the pixel in the image; (ii) controlling the laser light sources to emit light rays having a colour and an intensity representative of the pixel, based on intensity values of different colour components of the pixel; and (iii) controlling the at least one light guide to guide said light rays towards the corresponding exit portion from which the light rays exit.

Display having controllable laser light sources and controllable light guide

A first future pose (FFP) is predicted using first tracking data. An image is generated based on the FFP, the image with stripes, each stripe having scanlines. A second future pose (SFP) is predicted using second tracking data. The image is reprojected by performing, from a first stripe to a last stripe: determining a start pose for a given stripe; reprojecting starting scanline(s) of the given stripe, from the FFP to the start pose, whilst predicting an end pose for the given stripe; reprojecting intermediate scanline(s) of the given stripe from the FFP to an interpolated pose; and reprojecting ending scanline(s) of the given stripe from the FFP to the end pose, wherein a start pose for the first stripe is the SFP, and wherein the end pose for the given stripe is served as a start pose for its next stripe. Stripes of a reprojected image are sent to a display.

Growing community of inventors

Hangonkylä, Finland

Mikko Strandborg