Nokia Technologies Oy

Microsoft Technology Licensing, LLC

Varjo Technologies Oy

Nokia Corporation

Nokia Technology Oy

Roope Rainisto

Klaus Melakari

Shahil Soni

Niko Eiden

Ari Antti Erik Peuhkurinen

Esa Kankaanpää

Bryan Thomas Biniak

Don Yamato Kuramura

Peter Matthew Mauro

Mikko Ollila

Kai Inha

Panu Mangrten Johansson

Ville Timonen

Virpi Roto

Jussi-Pekka Kekki

John Hard

Hannu Pirskanen

Xun Chen

Kalle Saarinen

Katri Laakso

Jan Krebber

Juho Paasonen

Henri Melaanvuo

Petri Tolppanen

Matti Vaisanen

Eero Tamminen

Melanie Wendland

Simo Säde

Tomi Erik Ilvessalmi

Mohammad Anwari

Rosalinde Belzer

Mikko Lönnfors

According to one aspect, there is provided an apparatus comprising at least one processing unit and at least one memory. The at least one memory stores program instructions that, when executed by the at least one processing unit, cause the apparatus to cause display of executed task instances relating to at least one application on a graphical user interface on a display, detect a storing command associated with the executed task instances, and store task information relating to the executed task instances in a task file in the at least one memory for later resumption of execution of the task instances.

Concurrent execution of task instances relating to a plurality of applications

A system for producing extended-reality images for a display apparatus. The system includes camera(s) and processor communicably coupled to camera(s), wherein processor is configured to: control camera(s) to capture image(s) representing test object present in real-world environment, wherein test object is physically covered three-dimensionally with coded pattern; obtain information pertaining to three-dimensional geometry of coded pattern; analyze image(s) to identify first image segment representing part of coded pattern visible in image(s); determine virtual content to be presented for test object, based on said part of coded pattern; process image(s) to generate extended-reality image(s) in which virtual content is virtually superimposed over said part of the coded pattern, based on information pertaining to three-dimensional geometry of coded pattern.

Detection of test object for virtual superimposition

An input device including first sensor that measures first sensor data indicative of at least one of: pressure applied to input device, presence or absence of given object in proximity of input device, distance of given object from input device, position and orientation of input device; and processor coupled to first sensor. Processor processes first sensor data to determine state of input device, said state indicating whether or not input device is lying on given object; obtains, from user device, context information pertaining to visual scene being presented to user; and controls input device to operate in first mode of operation or second mode of operation based on said state and context information. Input device acts as computer mouse during first mode of operation and as six-degrees-of-freedom controller during second mode of operation.

Input device, system, and method

An imaging system for producing mixed-reality images for display apparatus. The imaging system includes a camera and a processor communicably coupled to the camera. The processor is configured to control the camera to capture image of real-world environment; analyze the image to identify surface that displays visual content; compare the visual content displayed in the image with reference image of the visual content to determine size, position and orientation of the surface with respect to the camera; process the reference image of the visual content to generate processed image of the visual content; and replace the visual content displayed in the image with the processed image to generate mixed-reality image, wherein resolution of the processed image is higher than resolution of the visual content displayed in the image.

Imaging system, display apparatus and method of producing mixed-reality images

A device is presented. The device comprises: at least one processor and at least one memory including computer program code, a display element coupled to the processor, and a user input element coupled to the processor. The computer program code and the at least one memory are configured, with the at least one processor, to cause the device to: play an omnidirectional video comprising a series of image frames, display a portion of the image frames of the played omnidirectional video on the display element, receive a user input from the user input element, the user input comprising selection of an object of interest in the displayed portion of at least one image frame of the played omnidirectional video, identify the object of interest in at least one image frame of the played omnidirectional video based on the user input, track the selected object of interest in consequent image frames of the played omnidirectional video, and adjust the displayed portion of the consequent image frames of the played omnidirectional video so that the tracked object of interest remains in the displayed portion. A method and method are also presented.

Tracking object of interest in an omnidirectional video

According to an aspect, there is provided a method and an apparatus for providing a multitasking view. Task information of a task executed on a first device and a preview image of the executed task is received. The preview image comprises at least partly a task view on a display of the first device. A multitasking view is provided on a display of a second device, and the multitasking view comprises tasks currently executed by the second device as well as the preview image of the task executed by the first device. A user of the second device is then able to select the preview image to initiate a further action.

Method and an apparatus for providing a multitasking view

A wearable apparatus comprises at least one processing unit and at least one memory. The at least one memory stores program instructions that, when executed by the at least one processing unit, cause the apparatus to detect a context related view activation input from a user, determine a context in response to detecting the context related view activation input from the user, and cause a view relating to the context to be provided with the wearable apparatus such that the view appears to be at ground level around at least one foot of the user.

Providing a context related view with a wearable apparatus

Mechanisms are provided for determining contact-related information items for presentation to a user, such that the user can refer to the information items to enhance the user's communication with the contact. Contact-related information items that have a high relevance level may be accessed and presented to the user. In a case in which no or limited high relevance level information items exist, contact-related information items associated with incrementally lower levels of relevance may be accessed and presented. Moreover, according to some example embodiments, relevance may be derived based on the relationship of the user with the particular contact and/or the frequency of communications with the contact.

Apparatus and method for providing contact-related information items

An imaging system and a method of producing images for a display apparatus, via the imaging system includes at least one focusable camera for capturing at least one image of a given real-world scene; means for generating a depth map or a voxel map of the given real-world scene; and a processor coupled to the focusable camera and the aforesaid means. The processor is communicably coupled with the display apparatus. The processor is configured to receive information of the gaze direction of the user; map the gaze direction to the depth map or the voxel map to determine an optical depth of a region of interest in the given real-world scene; and control the focusable camera to employ a focus length that is substantially similar to the determined optical depth of the region of interest when capturing the at least one image.

Imaging system and method of producing images for display apparatus

In an embodiment a device to convert conversations from a meeting to text and annotate the text is disclosed. In an embodiment a device is disclosed, comprising: a microphone; a camera; a processor; and a storage comprising a set of instructions; wherein the set of instructions causes a processor to: receive from the microphone, an audio recording containing speech of a participant of a meeting; receive from the camera, a video of the participant; identify the participant; convert the speech of the participant to a digital text; develop a skeletal map of the participant; recognize a gesture of the participant from the skeletal maps; detect and identify a target of the gesture; based on the target and the gesture determine an annotation for the digital text corresponding to a point of time of the gesture.

Gesture based annotations

Mechanisms are described for helping users manage their time and achieve predefined goals. One or more goals for a user may be received (e.g., from the user or some other source), and activities that the user performs over a period of time may be monitored, where the activities are informative regarding how the user is progressing towards the goal. A calendar entry may be determined based on the user's monitored activity, where the calendar entry is designed to help the user move closer to his goal. The calendar entry may be accepted or rejected by the user, and if accepted may be added to the user's calendar. In this way, the user's time may be optimized, and the user may be able to take defined steps towards his goal by taking the actions suggested.

Apparatus, method, and computer program product for determining calendar entries to advance user goals

Methods and apparatuses are provided for facilitating location selection. A method may include causing display of a user interface for selecting a location associated with a calendar entry. The method may further include determining a location selected via the user interface. The method may additionally include associating the determined location with the calendar entry. Corresponding apparatuses are also provided.

Methods and apparatuses for facilitating location selection

A wireless device and a method for secure data transmission is described. Information representing biometric data of a user is obtained. The information is processed to produce a code and the code is sent over a wireless technology. A response is requested of a device that has a matching code, where the matching can be within a predetermined tolerance. A response is received that includes at least one of a public key which includes the code as a part of the key and the identity of the device having the matching code. The data to be transmitted is encrypted with the public key and sent to the device with the matching code.

Growing community of inventors

Helsinki, Finland

Roope Rainisto