Nokia Technologies Oy

Nokia Corporation

Core Wireless Licensing S.a.r.l.

Xerox Corporation

Nokia Technology Oy

Lixin Fan

Antti Johannes Eronen

Emre Baris Aksu

Yu You

Kimmo Tapio Roimela

Tinghuai Wang

Junsheng Fu

Pouria Babahajiani

Timo Pylvanainen

Qiang Wu

Jian Zhang

Christopher R Dance

Jutta Willamowski

Ville-Veikko Mattila

Yihong Wu

Xiaoshui Huang

Furong Peng

Youji Feng

Sounak Bhattacharya

An apparatus configured to, in respect of virtual reality content comprising video imagery configured to provide a virtual reality space wherein a virtual reality view presented to a user provides for viewing of the VR space; based on a comment made by and a virtual location of a commenting-user in the virtual reality space when the comment was made; provide for determination of a point of interest in the virtual reality space, the point of interest identified based on, at least, the virtual location of the commenting-user when the comment was made and semantic analysis of the comment to identify the point of interest surrounding the virtual location to which the comment refers, the point of interest associated with the comment thereby enabling the comment to be overlaid over the virtual reality view of the video imagery.

Apparatus and associated methods

An apparatus configured to, in respect of a video provided to a user and wherein a plurality of comments are displayed such that they scroll across the video, based on the comments and one or more comment filtering rules, provide for comment filtering as each of the plurality of comments scrolls to meet a filter line, wherein the filter line extends across at least part of the video to define a first area overlaying the video and a non-overlapping second area overlaying the video, such that in the first area the plurality of comments are provided for display scrolling therethrough towards the filter line prior to comment filtering and in the second area the plurality of comments are provided for display with any comments of the plurality of comments that satisfy the one or more comment filtering rules removed from display.

Apparatus and method for displaying video and comments

A method comprising: providing a first 3D point cloud and a second 3D point cloud about an object obtained using different sensing techniques; removing a scale difference between the 3D point clouds based on a mean distance of points in corresponding subsets of the first and second 3D point clouds; arranging the 3D point clouds in a two-level structure, wherein a first level is a macro structure describing boundaries of the object and a second level is a micro structure consisting of supervoxels of the 3D point cloud; constructing a first graph from the first 3D point cloud and a second graph from the second 3D point cloud such that the supervoxels represent nodes of the graphs and adjacencies of the supervoxels represents edges of the graphs; matching the first and second graph for obtaining a transformation matrix; and registering the 3D point clouds together by applying the transformation matrix.

Point cloud matching method

An apparatus configured to, in respect of first and second virtual reality content () each configured to provide imagery for a respective first and second virtual reality space for viewing in virtual reality; and based on first-user-viewing-experience information defining an appearance of an object of interest () that appears in the first virtual reality content as viewed, in virtual reality, by a first user (), and defining a time-variant point of view from which the first user () viewed the object of interest (); providing for display to a second user (), the second user provided with a virtual reality view of the second virtual reality content (), of imagery of the object of interest () superimposed into the virtual reality space of the second virtual reality content () such that the second user () is able, while viewing the second virtual reality content, to witness the object of interest () as it was viewed by the first user ().

Apparatus for sharing objects of interest and associated methods

A method comprising: enabling a first user to define a message for display to at least a second user in association with a first three-dimensional scene viewed by the first user and viewed by or viewable by the second user, wherein the message comprises user-defined message content for display and message metadata, not for display, defining first three-dimensional spatial information; and enabling rendering of the user-defined message content in a second three-dimensional scene viewed by the second user, wherein the user-defined message content moves, within the second three-dimensional scene, along a three-dimensional trajectory dependent upon the first three-dimensional spatial information and three-dimensional spatial information of the second user.

Rendering of user-defined message having 3D motion information

A method comprising performing image re-projection on each of a plurality of first images of a scene, thereby to generate a plurality of re-projected second images of the scene, wherein each first image of the scene is captured by a respective camera of a first multi-directional image capture apparatus and each second image of the scene is associated with a respective virtual camera; processing the plurality of second images based on a previously generated virtual three dimensional model of the scene, thereby to generate respective positions of the virtual cameras associated with the second images; and determining a position of the first multi-directional image capture apparatus based on one or more of the generated positions of the virtual cameras.

Methods and apparatuses for determining positions of multi-directional image capture apparatuses

An apparatus comprising a processor and memory including computer program code, the memory and computer program code configured to, with the processor, enable the apparatus at least to:

Apparatus for video output and associated methods

A method comprising: obtaining a three-dimensional (3D) point cloud about an object; obtaining binary feature descriptors for feature points in a 2D image about the object; assigning a plurality of index values for each feature point as multiple bits of the corresponding binary feature descriptor; storing the binary feature descriptor in a table entry of a plurality of hash key tables of a database image; obtaining query binary feature descriptors for feature points in a query image; matching the query binary feature descriptors to the binary feature descriptors of the database image; reselecting one bit of the hash key of the matched database image; and re-indexing the feature points in the table entries of the hash key table of the database image.

Localization and mapping method

An augmented reality method for displaying information comprises: capturing a sequence of image frames by a camera of a portable device, obtaining movement data by using an inertial sensor of the portable device, determining a sampling frame rate according to the movement data, selecting a tracking image from the captured image frames according to the sampling frame rate, determining a position of the portable device by comparing the tracking image with a point cloud, and displaying information on a display of the device based on the determined position.

Method for determining the position of a portable device

The embodiments relate to a method and to technical equipment for implementing the method. The method includes receiving an image with location information from a client; requesting processed region data from a media server based on the location information, said processed region data including one or more images with the corresponding location information; applying a first process for determining a pose of a device for the received image by means of the processed region data; if the first process fails to result the pose of the device, applying a second process for determining a pose of a device for the received image by means of the processed region data; saving the image with the determined pose of the device to the media server; providing the image and the pose of the device to a client for client rendering.

Method and technical equipment for determining a pose of a device

A method comprising: obtaining a plurality of three-dimensional (3D) point clouds about a plurality of objects of interest, each of said 3D point clouds being labelled to a category of objects of interest; rendering facades for the objects of interests categorized as buildings using an ambient occlusion method, where illumination of the point cloud is calculated based on light coming from a theoretical hemisphere or sphere around the object of interest; and rendering shapes of the objects of interests categorized as non-buildings by fitting predefined templates of street view objects to the point clouds labelled as non-buildings.

Method and apparatus for rendering facades of objects of interest from three-dimensional point clouds

The invention relates to a method and a system for image-based retrieval. The method comprises receiving a query image; processing the query image to obtain visual features; determining a feature from the obtained visual features; determining a viewing direction for the query image from a pre-determined set of viewing directions; generating a direction-based hash based on the determined feature in the query image and the viewing direction; identifying sub-volumes of a point cloud database that match the direction-based hash; and matching the identified sub-volumes against all the query image features to find a match.

Method, a system, an apparatus and a computer program product for image-based retrieval

A method comprising: obtaining a three-dimensional (3D) point cloud about at least one object of interest; detecting ground and/or building objects from 3D point cloud data using an unsupervised segmentation method; removing the ground and/or building objects from the 3D point cloud data; and detecting one or more vertical objects from the remaining 3D point cloud data using a supervised segmentation method.

Objection recognition in a 3D scene

An approach is provided for processing and/or facilitating a processing of one or more images to determine camera location information, camera pose information, or a combination thereof associated with at least one camera capturing the one or more images, wherein the camera location information, the camera pose information, or a combination thereof is represented according to a global coordinate system. The approach involves causing, at least in part, an association of the camera location information, the camera pose information, or a combination thereof with the one or more images as meta-data information.

Method and apparatus for determining camera location information and/or camera pose information according to a global coordinate system

Methods and apparatus, including computer program products, are provided for mapping. In one aspect there is provided a method which may include sampling a position and a viewpoint of a three-dimensional map view presented at a browser while traversing the three-dimensional map; sending to a database a query including the sampled position and the sampled viewpoint; and receiving, in response to the sent query, a recommended browsing path including a recommended position and a recommended viewpoint for traversing the three-dimensional map presented at the browser. The recommended browsing path represents an aggregation including crowd-sourced information for position and viewpoint. Related apparatus, systems, methods, and articles are also described.

Growing community of inventors

Tampere, Finland

Lixin Fan