Nokia Technologies Oy

Nokia Corporation

Daniel Vaquero

Timo Juhani Ahonen

Miska Matias Hannuksela

Basavaraja Shanthappa Vandrotti

Arto Juhani Lehtiniemi

Lin Chen

Veldandi Muninder

Muneem Shahriar

Muninder Veldandi

Devon Copley

Maneli Noorkami

Binh Huy Le

Esin Guldogan

Timo Ahonen

A method, apparatus and computer program product are provided for varying panning speeds of images based on saliency such that 360-degree images, panoramic images, video images and/or other wide view area images may be efficiently displayed by varying the panning speed such that the user focuses on salient portions of the image. A panning speed is determined based on the currently displayed area and its saliency relative to the saliency of non-displayed or peripheral portions. As a user pans from one area to another, while the user pans over a salient portion of the image, the actual reflected panning may occur at a relatively slower speed than when the user pans over an area not including a salient portion, or a less salient portion.

Method and apparatus for determining and varying the panning speed of an image based on saliency

A method, apparatus and computer-readable storage medium are provided to define a storyline based on path probabilities for a plurality of paths through the frames of a video. Relative to a method and for a plurality of frames of a video, regions of a first frame and regions of a second, subsequent frame that have been viewed are identified. For each of at least one first-frame region of one or more regions of the first frame, the method determines a transition probability of transitioning from a respective first-frame region of the first frame to each of at least one second-frame region of a plurality of regions of the second frame. Based on the transition probabilities, the method determines a path probability for each of at least one of a plurality of paths through the frames of the video. The method additionally defines a storyline based on the path probabilities.

Method and apparatus for defining a storyline based on path probabilities

A method, apparatus and computer-readable storage medium provide information regarding changes in viewing behavior between first and second frame of a video. In a method, a plurality of objects that are included within a respective frame are identified. The method determines a first number of views of each of at least one of the plurality of objects in the first frame. For the second frame subsequent to the first frame, the method determines a second number of views of each of at least one of the plurality of objects that are in the second frame and identifies a number of instances in which a respective viewer who viewed one object within the first frame changed to view a different object within the second frame. The method additionally causes information to be provided regarding changes in viewing behavior between the first and second frame of the video.

Method and apparatus for applying video viewing behavior

A method, apparatus and computer program product facilitate the viewing of a storyline defined in a video. In regards to a method, viewing by a user of different sequential areas of a video over time is monitored. The different sequential areas of the video over time define a storyline. If the storyline is followed, the video continues to be presented. However, if the storyline is not followed in that a next sequential area of the video is not viewed, a portion of the video prior to the next sequential area is caused to be repeatedly replayed in a loop. Following this repeated replay of the portion of the video, the repeated replay of the portion of the video is ceased and the presentation of the video is resumed if the storyline is followed and the next sequential area of the video in the storyline is viewed.

Method and apparatus for presenting a video loop during a storyline

A method, apparatus and computer program product are provided in order to create and/or decode video content of a scene that includes regions having looping video of different loop lengths with the video content of the scene being configured to be repeatedly looped, such as in the form of a cinemagraph, without any temporal discontinuity. In the context of a method, the video content of a scene is encoded. The video content includes at least two regions having looping videos of different loop lengths. The method also includes constructing metadata in association with the video content. The metadata comprises information identifying a location of each region within the scene. The metadata further comprises a loop length for each of the at least two regions. The method further includes causing provision of the video content as encoded and the metadata.

Method and apparatus for encoding or decoding video content including regions having looping videos of different loop lengths

A method, apparatus and computer program product are provided for improving the efficiency of content delivery based on consumption data. Consumption data may be collected from various users and/or devices describing frequently viewed areas in the content. The consumption data may be represented as a heat map. Variable encoding properties, caching priorities, and/or rendering priorities may be determined based on the consumption data. Content encoding and delivery may therefore be optimized accordingly. Machine learning may be applied to create predicted consumption data for content which lacks actual consumption data, allowing optimizations to be applied in advance of any actual consumption. Some concepts may be applied to unviewed video to optimize live streaming or the like.

Method and apparatus for improving efficiency of content delivery based on consumption data relative to spatial data

A method, apparatus and computer program product are provided to facilitate the review of at least portions of a panoramic image and to increase the likelihood that a viewer consumes at least those portions of the panoramic image that are considered to be both interesting and of aesthetic value. In the context of a method, one or more regions within a panoramic image are identified based upon a saliency of the one or more regions. The method also includes identifying candidate subimages that at least partially overlap with at least one of the regions identified within the panoramic image. The method further includes scoring the candidate subimages based upon predefined criteria and causing information for one or more of the candidate subimages to be provided based upon scores associated therewith.

Method and apparatus for identifying salient subimages within a panoramic image

A method, apparatus and computer program product are provided to cause image content to be adjusted in a manner consistent with the corresponding viewing direction, such as the viewing direction of a user of a head-mounted display device. In regards to a method, one or more first anchor frames are determined within a multi-frame image, a user's viewing direction is determined relative to the multi-frame image and at least one second anchor frame is identified based on the user's viewing direction. The method also includes determining one or more tonal modification parameters of a frame in relation to the viewing direction based upon the one or more first anchor frames and the at least one second anchor frame. Further, the method generates a plurality of modified frames based on the one or more tonal modification parameters. A corresponding apparatus and computer program product are also provided.

Method and apparatus for modifying a multi-frame image based upon anchor frames

In a method, a first image of a subject is taken from a first viewpoint. The first image of the subject is composed of a first plurality of pixels. A second image of the subject is taken from a second viewpoint. The second image of the subject is composed of a second plurality of pixels. Pixels in the first plurality of pixels in the first image correspond to pixels in the second plurality of pixels in the second image. Corresponding pixels lie on first epipolar lines in the first image and on second epipolar lines in the second image. The first and second images are rectified to make the first and second epipolar lines parallel to one another and to place corresponding pixels in the first and second images on one of a plurality of pairs of common scanlines. For at least one pair of common scanlines, a corresponding pixel is found in the second image for each pixel in the first image such that a visual perception matching cost (VPMC) is minimized.

Visual perception matching cost on binocular stereo images

A first image frame is gathered. The first image frame, a first white balance value, and a first exposure value are stored. Information is sensed from an inertial sensor. A second image frame and intermediate image frames are gathered. A distance traversed by a camera is determined. In response to one or more of: the distance exceeding a predetermined threshold, or a new white balance value significantly differing from a previous white balance value, or a new exposure value significantly differing from a previous exposure value, a second white balance value and a second exposure value are determined for the second image frame. A smoothed white balance value and a smoothed exposure value are determined for the intermediate image frames.

Growing community of inventors

Sunnyvale, CA, United States of America

Daniel Vaquero