Tiledmedia B.v.

Xavier Albert Jean-Pierre Corbillon

Ray Van Brandenburg

Arjen Timotheus Veenhuizen

Frederik Harm Klok

Marinus Thomas Van Eck

A computer-implemented method is disclosed for requesting tile streams for rendering a spatial part of an immersive video on a display of a client device. In this method, a server system stores a plurality of tile streams. Each tile stream represents a spatial part of the immersive video and each tile stream comprises a sequence of tile frames that are associated with respective times in the video. Further, the plurality of tile streams comprises a first set of high quality tile streams having a relatively high quality and comprises a second set of one or more low quality tile streams having a relatively low quality and/or a third set of one or more intermediate quality tile streams having a relatively intermediate quality. The method comprises based on a determined value for a parameter indicative of how many requested high quality tile frames are received not in time for properly rending them on the display, refraining, at least for some time period, from requesting high quality tile streams.

Method and system for requesting tile streams

A method is described for rendering a spatial part of an immersive video on a display of a client device comprising a tile frame retrieval device, a decoder device and a renderer device, wherein the immersive video comprises video frames, each video frame being spatially divided in tile frames, and the immersive video comprises tile streams, each tile stream representing a spatial part of the immersive video and each tile stream comprising a plurality of said tile frames, and wherein the client has stored tile stream mapping information, that indicates for each tile stream a respective position on a surface of a two-dimensional or three-dimensional model, such as a sphere or cube, the method comprising based on said tile stream mapping information and a viewport, the tile frame retrieval device determining a plurality of tile streams, and requesting encoded video data from a server, the encoded video data comprising, for each determined tile stream, an encoded tile frame that comprises encoded data representative of a tile frame comprised in the tile stream; the tile frame retrieval device receiving the encoded tile frames and forming an encoded video frame comprising the received encoded tile frames, each encoded tile frame having a position in the encoded video frame, and the tile frame retrieval device generating tile frame arrangement information indicating the position of each encoded tile frame within the encoded video frame; the decoder device decoding the encoded video frame to obtain a decoded video frame comprising the tile frames at respective positions within the decoded video frame; based on the tile frame arrangement information and based on the tile stream mapping information, the renderer device mapping the decoded video frame onto one or more surfaces of the two-dimensional or three-dimensional model so that each tile frame is mapped onto the position of the one or more surfaces of the model as indicated; based on the mapped decoded video frame, the renderer device rendering at least part of the decoded video frame on the display of the client device.

Growing community of inventors

Rotterdam, Netherlands

Xavier Albert Jean-Pierre Corbillon