Varjo Technologies Oy

Distance Technologies Oy

Varjo Technologies 0y

Mikko Strandborg

Mikko Ollila

Urho Konttori

Ville Miettinen

Kimmo Tapio Roimela

Antti Hirvonen

Thomas Carlsson

Petteri Timonen

Joona Petrell

Klaus Melakari

Oiva Arvo Oskari Sahlsten

Tarmo Räntilä

Ari Antti Erik Peuhkurinen

Petri Savolainen

Mikko Juhola

Ari Antti Peuhkurinen

Ville Vehkaperä

Evgeny Zuev

Antti Peuhkurinen

Harri Kapanen

Pekka Väänänen

Timo Toivanen

Juho Saarinen

Jetro Lauha

Dhiraj Neve

A system including a tracker, a display, an optical combiner arranged on an optical path of the display and of a real-world light field of a real-world environment, at least one real-world facing camera, and at least one processor. The processor is configured to determine a relative position of each eye of at least one user with respect to the optical combiner using the tracker, generate or retrieve an image to be displayed based on the relative position of each eye of the at least one user with respect to the optical combiner, and determine a corresponding portion of the optical combiner for a given region of the image. The processor is further configured to capture at least one real-world image, calculate a colour difference and a luminance difference, adjust the graphical element based on the differences, and display the image while optically combining it with the real-world light field.

Adaptive visibility enhancement in augmented reality

An imaging system includes a controllable light source; an image sensor; metalens for focusing incoming light onto the image sensor; and processor(s). The processor(s) is configured to control a light source using a first illumination intensity and/or first illumination wavelength, while controlling the image sensor to capture first image; control the light source using a second illumination intensity and/or second illumination wavelength, while controlling the image sensor to capture a second image; calculate measured differences between pixel values of pixels in the first image and pixel values of corresponding pixels in the second image; estimate expected pixel value differences based on difference between the first and second illumination intensities and/or differences between the first and second illumination wavelengths; and correct pixel values of pixels in the first image and/or second image based on deviation in measured differences from expected differences.

Correcting images captured with metalenses using different illumination characteristics

Disclosed is data processing system having at least one server communicably couplable to at least one display apparatus, wherein at least one server has at least one processor configured to obtain quality of service information from network traffic regulator of communication network, wherein communication network is between at least one server and at least one display apparatus, obtain media processing latency information from at least one rendering application executing at the at least one server, and obtain client device operational information from at least one display apparatus; process quality of service information, media processing latency information, and client device operational information together to generate streaming configuration parameters; and control at least one rendering application to generate images for displaying at the at least one display apparatus and send images via communication network to at least one display apparatus, according to generated streaming configuration parameters.

Data processing system and method for network performance optimization

A first virtual image and a second virtual image represent virtual object(s) from a perspective of a first eye and a second eye of user(s). A union of first image segment(s) in the first virtual image and second image segment(s) in the second virtual image that represent the virtual object(s) is determined. A given portion of a transparent display whereat said union is to be presented is determined. A light field image is displayed via the transparent display, whilst controlling a controllable parallax barrier arranged on an optical path of the transparent display. The step of controlling the controllable parallax barrier comprises activating a given portion of the controllable parallax barrier that corresponds to the given portion of the transparent display.

Augmenting reality with multiscopic see-through display

A display device includes a backlight unit that is controllable to switch between lights of different colours having specific wavelengths, and an active panel including a liquid crystal (LC) layer. A multi-band reflective coating on an optical combiner is configured to selectively reflect the lights having the specific wavelengths. Different sets of drive signals are generated for different sub-images of an image. LC cells of the LC layer are controlled individually using the different sets of drive signals according to a predefined sequence in which the sub-images are to be displayed, whilst controlling the backlight unit to switch between lights of different colours according to the predefined sequence, thereby producing a synthetic light field corresponding to the image. The optical combiner is employed to selectively reflect the synthetic light field towards eyes of user(s), whilst optically combining a real-world light field with the synthetic light field.

Narrowband reflective optical combiner with narrowband display device having multi-coloured backlight unit

A 3D bounding volume within which a graphical element is to be rasterized for a given eye is determined. A set of light-emitting elements from which light is directed toward the given eye along a direction intersecting the 3D bounding volume is identified. For each light-emitting element in the set, its perceived shape and angular size from a perspective of the given eye is determined. The graphical element is rasterized onto the set of light-emitting elements based at least on relative perceived positions of the light-emitting elements from the perspective of the given eye, and their perceived shape and their perceived angular size. A colour value is computed for each light-emitting element in the set based on the rasterization of the graphical element. A synthetic light field is then produced displaying the graphical element, using computed colour values for the light-emitting elements in the set.

Pixel-accurate graphics rasterization for multiscopic displays

Disclosed is an apparatus and a method for depth sensing that includes a scanning light source configured to sequentially illuminate an environment utilizing a scan pattern. The apparatus also includes a birefringent layer adapted to receive and split reflected scan pattern from the environment into an ordinary ray (O-ray) image and an extraordinary ray (E-ray) image. The apparatus further includes an imaging sensor positioned along an optical path of the birefringent layer to capture the O-ray image and the E-ray image as transmitted therefrom. The apparatus further includes a processor configured to compute differences between positions of the O-ray image and the E-ray image and derive a depth map of the environment based on the computed differences.

Depth sensing for extended reality (XR) apparatus

A display device includes laser light sources of different colours and at least one light guide. The at least one light guide includes a light outlet including a plurality of exit portions, and is controllable to sequentially guide light rays emitted by the laser light sources towards different exit portions of the light outlet. A pixel of an image is displayed by: (i) determining a corresponding exit portion, based on a pixel location of the pixel in the image; (ii) controlling the laser light sources to emit light rays having a colour and an intensity representative of the pixel, based on intensity values of different colour components of the pixel; and (iii) controlling the at least one light guide to guide said light rays towards the corresponding exit portion from which the light rays exit.

Display having controllable laser light sources and controllable light guide

A first future pose (FFP) is predicted using first tracking data. An image is generated based on the FFP, the image with stripes, each stripe having scanlines. A second future pose (SFP) is predicted using second tracking data. The image is reprojected by performing, from a first stripe to a last stripe: determining a start pose for a given stripe; reprojecting starting scanline(s) of the given stripe, from the FFP to the start pose, whilst predicting an end pose for the given stripe; reprojecting intermediate scanline(s) of the given stripe from the FFP to an interpolated pose; and reprojecting ending scanline(s) of the given stripe from the FFP to the end pose, wherein a start pose for the first stripe is the SFP, and wherein the end pose for the given stripe is served as a start pose for its next stripe. Stripes of a reprojected image are sent to a display.

Methods and systems for preventing image tearing

A display apparatus has a display area of an output image divided into a plurality of regions. For a given region of the output image, a corresponding first region in a video-see-through (VST) image and a corresponding second region in at least one virtual-reality (VR) image are determined. From a depth map corresponding to the VST image, a minimum optical depth and a maximum optical depth in the first region of the VST image are determined. From a depth map corresponding to the at least one VR image, a minimum optical depth and a maximum optical depth in the second region of the at least one VR image are determined. When the minimum optical depth in the first region of the VST image is greater than the maximum optical depth in the second region of the at least one VR image, pixel data for pixels in the given region of the output image from the second region of the at least one VR image is fetched. Otherwise, when the minimum optical depth in the second region of the at least one VR image is greater than the maximum optical depth in the first region of the VST image, the pixel data for the pixels in the given region of the output image from the first region of the VST image is fetched.

Reducing texture lookups in extended-reality applications

Information indicative of a relative location of a first eye and a second eye of an individual one of user(s) with respect to a multiscopic optical element is obtained. A first image and a second image are generated or retrieved. For a given multiscopic cell and a given horizontal scanline, first photo-emitting cell(s) and second photo-emitting cell(s) are selected from amongst photo-emitting cells lying on the given horizontal scanline and on whose optical path the given multiscopic cell lies. Then, intensity values for the first photo-emitting cell(s) and the second photo-emitting cell(s) are retrieved. Information indicating the intensity values for the first photo-emitting cell(s) and the second photo-emitting cell(s), and metainformation indicating locations of such photo-emitting cells are included in an input signal being sent to a display driver. Drive signals are generated. Display is driven to present the first image and the second image.

Display drivers, systems and methods for multiscopy

Disclosed is a system comprising data repository(ies) and server(s) configured to: access, from data repository(ies), a first three-dimensional (3D) model of a virtual environment and a second 3D model of a real-world environment; combine the first 3D model and the second 3D model to generate a combined 3D model of an extended-reality (XR) environment; perform occlusion culling using the combined 3D model, to identify a set of virtual objects that occlude real object(s) in the XR environment from a perspective of a viewpoint; and send, to display apparatus(es), a virtual-reality (VR) image representing the set of virtual objects and information indicative of portion(s) of a field of view that corresponds to the real object(s) that is being occluded by the set of virtual objects from the perspective of the viewpoint.

Image signal processing based on occlusion culling

A system includes at least one server that is communicably coupled to at least one display apparatus. The at least one server is configured to obtain a real-world depth map corresponding to a target pose, and obtain a plurality of virtual-reality (VR) images and a plurality of VR depth maps for the target pose, wherein the plurality of VR images are generated by respective ones of a plurality of rendering applications that are executing at the at least one server. Further, the at least one server is configured to composite the plurality of VR images to generate a single VR image, based on the real-world depth map and the plurality of VR depth maps; and send the single VR image to the at least one display apparatus.

Server-side extended-reality pre-composition

Disclosed is imaging system with an image sensor having photo-sensitive cells arranged on photo-sensitive surface of image sensor; colour filter array (CFA) arranged on optical path of photo-sensitive surface, CFA with: first, second, third and fourth types of colour filters that allow wavelengths lying in first, second, third wavelength ranges, respectively, to pass through; and light valve device having grid of light valves, wherein light valves of grid are arranged on optical paths of at least fourth type of colour filters; and processor(s) configured to: for given colour filter of fourth type, control corresponding light valve during given time period to allow wavelengths lying in first, second, or third wavelength range, to pass through towards given colour filter; read out image data from photo-sensitive cells; and process image data to generate given image.

Adjustable colour filter array using liquid crystal device

An autostereoscopic display includes a light-emitting panel and a lenticular array in which a focal length of a lenticular lens is different from its thickness. For an intersection of a given row of light-emitting cells and a given lenticular lens, a given viewing direction from a given eye toward said intersection is determined. From light-emitting cells arranged on the given row and on whose optical path the given lenticular lens lies, a set of light-emitting cells whose light travels toward the given eye is determined. Corresponding regions on a curved surface of the given lenticular lens through which light from individual light-emitting cells of the set pass toward the given eye are identified and mapped to respective pixel locations in an image to be presented. Pixel values of pixels located at these pixel locations in the image are retrieved and used to generate an output image for display.

Growing community of inventors

Hangonkylä, Finland

Mikko Strandborg