Varjo Technologies Oy

Distance Technologies Oy

Varjo Technologies 0Y

Mikko Strandborg

Mikko Ollila

Urho Konttori

Ville Miettinen

Kimmo Tapio Roimela

Thomas Carlsson

Petteri Timonen

Antti Hirvonen

Joona Petrell

Klaus Melakari

Oiva Arvo Oskari Sahlsten

Tarmo Räntilä

Ari Antti Erik Peuhkurinen

Petri Savolainen

Kai Inha

Mikko Juhola

Ari Antti Peuhkurinen

Ville Timonen

Ville Vehkaperä

Evgeny Zuev

Antti Peuhkurinen

Harri Kapanen

Pekka Väänänen

Timo Toivanen

Juho Saarinen

Jetro Lauha

Dhiraj Neve

Disclosed is an apparatus including an image sensor to capture an input image with one or more textual features. The one or more textual features are present in an unreadable or distorted form. Further, the apparatus includes a processor configured to detect the one or more textual features of the input image and execute a neural network to concurrently deduce a plurality of glyphs that form one or more relevant words or abbreviations based on the detected one or more textual features of the input image. Further, the processor is configured to generate an output image with enhanced one or more textual features in a legible form based on the deduced plurality of glyphs.

Apparatus and method of image processing to enhance textual features in output image

A first image and a second image to be directed toward a first eye and a second eye, respectively, are generated or retrieved. For a given first segment of the first image presenting at least a part of a virtual object, an amount of crosstalk toward the first eye is determined based on at least the second image. A given second segment of the second image that also presents at least said part of the virtual object is determined. Intensity values of pixels in the given second segment of the second image are adjusted, based on the amount of crosstalk determined for the given first segment of the first image. An autostereoscopic image is then generated using the first image and the second image, and displayed via an autostereoscopic display.

Crosstalk compensation in autostereoscopic displays using binocular summation

A method for depth image enhancement implemented in at least one apparatus includes reading and processing Phase Detection Autofocus (PDAF) pixels of a region-of-interest (ROI) area of a gaze region in an image obtained from a color camera sensor; utilizing one or more depth camera sensors to provide one or more depth maps of the ROI area of the gaze region; and combining the processed PDAF pixels of the ROI area of the gaze region and the one or more depth maps of the ROI area of the gaze region to obtain an updated ROI area with complementary depth information of the ROI area of the gaze region.

Method and apparatus for depth image enhancement

Disclosed is a video transport method including receiving high dynamic range (HDR) video content comprising HDR images; performing HDR mastering for HDR images according to HDR mastering parameters; transforming an input colour space of each HDR image amongst HDR images into a transport colour space, and transporting HDR images having transport colour space. Herein, transforming an input colour space of HDR images into transport colour space is performed by: plotting colour component values (CCVs) of pixels in a first HDR image amongst a given set of HDR images, across a multi-dimensional colour space; identifying a bounding box corresponding to the first HDR image, wherein the bounding box encloses CCVs of two or more colour components represented in multi-dimensional colour space; determining a transformation to be applied to input colour space of the given set of HDR images; applying transformation to each HDR image in given set of HDR images.

Video transport method and system

Disclosed is a system with an image sensor comprising a plurality of photo-sensitive cells; and processor(s) configured to: receive, from the image sensor, a plurality of image signals captured by corresponding photo-sensitive cells of the image sensor; obtain information indicative of a current pupil size of a user of a display apparatus; determine a given luminosity range corresponding to the current pupil size; and selectively perform a sequence of image signal processes on the plurality of image signals and control a plurality of parameters employed for performing the sequence of image signal processes, based on the given luminosity range, to generate an image.

Eye-directed image signal processing

At least one monocular camera is installed in a vehicle in addition to in-cabin camera(s). Images captured by the in-cabin camera(s) at a first frame rate are processed to determine first positions of facial landmark features of a user and first poses of the user's face. Images captured by the at least one monocular camera at a second frame rate, higher than the first frame rate, are processed to identify facial landmark features of the user in the second images. Second positions of the facial landmark features are determined at the second frame rate, by correlating the facial landmark features identified in the second images with the first positions of the facial landmark features determined from the first images. Second poses of the user's face are determined at the second frame rate based on the second positions of the facial landmark features and the first poses of the user's face.

Hybrid face tracking for vehicles

A multiscopic display includes an array of light-emitting cells and a multiscopic optical element including a plurality of multiscopic cells. For a given multiscopic cell, distinct sets of light-emitting cells whose emitted light is directed toward respective eyes of at least one user are identified, and at least one additional set of light-emitting cells that does not emit light directed toward any of the eyes, is separated by a distance smaller than a first predefined threshold from a single distinct set of light-emitting cells, and is separated by a distance greater than a second predefined threshold from other distinct sets of light-emitting cells is determined. Pixel values are retrieved corresponding to the distinct sets and the at least one additional set from images to be presented to the respective eyes, and are used to generate an output image for display via the multiscopic display.

View-extended multiscopic rendering

A graphical element is rasterized onto a set of light-emitting elements based on perceived shapes, perceived angular sizes and relative perceived positions of the light-emitting elements from a perspective of a given eye. Colour values, computed for the light-emitting elements based on the rasterization of the graphical element, are stored along with cadence information indicating a reference cadence of a reference light-emitting element in the set with respect to a multiscopic cell. When a cadence of a corresponding light-emitting element in another set matches the reference cadence within a predefined similarity threshold, the stored colour values are reused for light-emitting elements of the another set to display the graphical element to the given eye.

Reusing pixel-accurate graphics rasterization in multiscopic displays

A light field image is displayed via a light field display unit to produce a synthetic light field. A light-steering optical device is controlled, based on a relative location of a first eye and a second eye of user(s) with respect to an imaginary image plane, to direct light emanating from a first set of photo-emitting cells towards the first eye and light emanating from a second set of photo-emitting cells of the light-emitting surface towards the second eye. When controlling the light-steering optical device, a first viewing direction and a second viewing direction are determined for a given first photo-emitting cell and a given second photo-emitting cell, respectively. Light emanating from the given first photo-emitting cell and from the given second photo-emitting cell is directed along the first viewing direction and the second viewing direction, respectively.

Dynamic light steering based on relative location of viewer

A light field image is displayed via a light field display unit to produce a synthetic light field. A first viewing direction and a second viewing direction are determined for a given first photo-emitting cell and a given second photo-emitting cell of the light field display unit, based on a relative location of a first eye and a second eye with respect to an image plane of the light field display unit, respectively. A given first portion and a given second portion of an active optical element that lie respectively on optical paths of the given first photo-emitting cell and the given second photo-emitting cell are controlled, to direct light corresponding to the given first photo-emitting cell and light corresponding to the given second photo-emitting cell along the first viewing direction and the second viewing direction, respectively.

Parallax barrier with dynamic light steering based on relative location of viewer

A system including a tracker, a display, an optical combiner arranged on an optical path of the display and of a real-world light field of a real-world environment, at least one real-world facing camera, and at least one processor. The processor is configured to determine a relative position of each eye of at least one user with respect to the optical combiner using the tracker, generate or retrieve an image to be displayed based on the relative position of each eye of the at least one user with respect to the optical combiner, and determine a corresponding portion of the optical combiner for a given region of the image. The processor is further configured to capture at least one real-world image, calculate a colour difference and a luminance difference, adjust the graphical element based on the differences, and display the image while optically combining it with the real-world light field.

Adaptive visibility enhancement in augmented reality

An imaging system includes a controllable light source; an image sensor; metalens for focusing incoming light onto the image sensor; and processor(s). The processor(s) is configured to control a light source using a first illumination intensity and/or first illumination wavelength, while controlling the image sensor to capture first image; control the light source using a second illumination intensity and/or second illumination wavelength, while controlling the image sensor to capture a second image; calculate measured differences between pixel values of pixels in the first image and pixel values of corresponding pixels in the second image; estimate expected pixel value differences based on difference between the first and second illumination intensities and/or differences between the first and second illumination wavelengths; and correct pixel values of pixels in the first image and/or second image based on deviation in measured differences from expected differences.

Correcting images captured with metalenses using different illumination characteristics

Disclosed is data processing system having at least one server communicably couplable to at least one display apparatus, wherein at least one server has at least one processor configured to obtain quality of service information from network traffic regulator of communication network, wherein communication network is between at least one server and at least one display apparatus, obtain media processing latency information from at least one rendering application executing at the at least one server, and obtain client device operational information from at least one display apparatus; process quality of service information, media processing latency information, and client device operational information together to generate streaming configuration parameters; and control at least one rendering application to generate images for displaying at the at least one display apparatus and send images via communication network to at least one display apparatus, according to generated streaming configuration parameters.

Data processing system and method for network performance optimization

A first virtual image and a second virtual image represent virtual object(s) from a perspective of a first eye and a second eye of user(s). A union of first image segment(s) in the first virtual image and second image segment(s) in the second virtual image that represent the virtual object(s) is determined. A given portion of a transparent display whereat said union is to be presented is determined. A light field image is displayed via the transparent display, whilst controlling a controllable parallax barrier arranged on an optical path of the transparent display. The step of controlling the controllable parallax barrier comprises activating a given portion of the controllable parallax barrier that corresponds to the given portion of the transparent display.

Augmenting reality with multiscopic see-through display

A display device includes a backlight unit that is controllable to switch between lights of different colours having specific wavelengths, and an active panel including a liquid crystal (LC) layer. A multi-band reflective coating on an optical combiner is configured to selectively reflect the lights having the specific wavelengths. Different sets of drive signals are generated for different sub-images of an image. LC cells of the LC layer are controlled individually using the different sets of drive signals according to a predefined sequence in which the sub-images are to be displayed, whilst controlling the backlight unit to switch between lights of different colours according to the predefined sequence, thereby producing a synthetic light field corresponding to the image. The optical combiner is employed to selectively reflect the synthetic light field towards eyes of user(s), whilst optically combining a real-world light field with the synthetic light field.

Growing community of inventors

Hangonkylä, Finland

Mikko Strandborg