Koninklijke Kpn N.v.

Nederlandse Organisatie Voor Toegepast-natuurwetenschappelijk Onderzoek Tno

Other

Nederlandse Ogranisatie Voor Toegepast-natuurwetenschappelijk Onderzoek Tno

Alexandre Da Silva Pratas Gabriel

Emmanuel Thomas

Hans Maarten Stokking

Mattijs Oskar Van Deventer

Omar Aziz Niamut

Hendrikus Nathaniël Hindriks

Emmanouil Potetsianakis

Jan-Willem Martin Kleinrouweler

Tessa Esmeé Klunder

A method of processing video data of a picture is described, the method including: allocating memory for a decoded picture in a decoded picture buffer, DPB, the decoded picture comprising pixels representing video data; receiving a bitstream comprising decoding units, DUs, and storing the DUs in a coded picture buffer, CRB, the DUs representing a coded picture that needs to be decoded into the decoded picture, each of the DUs representing a coded block of pixels; determining if, during decoding of the coded picture, at least one partial output can be performed, the at least one partial output including copying the one or more decoded DUs from the DPB to a data sink, while one or more DUs of the coded picture are not yet decoded and removed the CPB, the one or more decoded DUs representing a part of the decoded picture; and, or performing the at least one partial output if the processor determines that the at least one partial output can be performed, the performing including marking the one or more decoded DUs stored in the DPB as being ready for partial output, the marking signaling the decoder apparatus not to remove the one or more decoded DUs from the DPB; and, copying the one or more marked decoded DUs from the DPB to the data sink without removing the one or more decoded DU from the DPB.

Partial output of a decoded picture buffer in video coding

A method of rendering a virtual object by a rendering device includes establishing a communication channel with a mobile device; determining or receiving initial pose information of the mobile device, the pose information defining an initial position and an initial orientation; receiving device information via the communication channel, the device information including orientation, motion, and/or position information for updating the initial pose of the mobile device; using the initial pose information and the device information to determine a current pose of the mobile device, the current pose defining a current position and orientation; receiving first content data from a server system, the first content data representing a virtual object; and, rendering the first content data in the viewport of the rendering device based on the current pose information, the current pose information being used to render the virtual object in spatial alignment with the mobile device.

Rendering a virtual object in spatial alignment with a pose of an electronic device

Some embodiments are directed to a session manager, a cloud service system, and a mobile device. The session manager may be configured for managing an edge computing resource in a mobile network, wherein the mobile network comprises edge nodes which are configurable to provide edge computing resources to mobile devices. The session manager may generate a session identifier for the mobile device and associate the session identifier with the mobile device. Later, the session manager may receive a request from the cloud service system for deployment of an edge computing resource for the mobile device on an edge node.

Systems, devices and methods for edge node computing

A system and method for rendering a video stream for display on a display device, which may comprise receiving the video stream by streaming and generating display data defining a visible display area to be displayed by the display device, wherein generating of display data comprises rendering the video stream in a sub-area of the visible display area. A selection mechanism may be provided by which a version of the video stream may be selected for streaming having a spatial resolution and/or a bitrate which is selected based on a size of the sub-area.

Rendering video stream in sub-area of visible display area

A processor system and computer-implemented method may be provided for generating a composite video stream which may combine a background video and a foreground video stream into one stream. For that purpose, a spatially segmented encoding of the background video may be obtained, for example in the form of a tiled stream. The foreground video stream may be received, for example, from a(nother) client device. The foreground video stream may be a real-time stream, e.g., when being used in real-time communication. The image data of the foreground video stream may be inserted into the background video by decoding select segments of the background video, inserting the foreground image data into the decoded background image data of these segments, and by encoding the resulting composite image data to obtain composite segments which, together with the non-processed segments of the background video, form a spatially segmented encoding of a composite video.

Generating composite video stream for display in VR

A method for adaptive streaming of video is described, wherein the method comprises: transmitting first metadata to a client apparatus, the first metadata defining a first adaptation set, an adaptation set defining one or more sets of segment identifiers, each set of segment identifiers defining a plurality of linearly playable media segments of a predetermined resolution, each media segment in a set of media segments having an identical playback duration, the first metadata enabling a client apparatus to request media segments and sequentially playout the media segments; receiving navigation information from the client apparatus, the navigation information defining at least a first region, in the video frames of the first adaptation set; selecting second metadata defining a second adaptation set on the basis of spatial playback information and a spatial distance or a spatial overlap between the first region and a second region in video frames of the first adaptation set, wherein the spatial playback information signals the server apparatus that the second region is linked to media segments of the second adaptation set; and, transmitting the second metadata or information for retrieving the second metadata to the client apparatus, the second metadata enabling the client apparatus to playback media segments of the second adaptation set after the playback of media segments of the first adaptation set.

Method for adaptive streaming of media

A method of encoding video data into a bitstream comprising: determining from the plurality of video blocks of a video frame of a first resolution a current block and one or more reference blocks including reference samples for predicting original samples of the current block; determining predicted samples of the current block based on a downsampling scheme, the determining comprising computing samples of a first low-resolution block of a second resolution that is lower than the first resolution, and predicting samples of one or more second low-resolution blocks of the second resolution based on the samples of the first low resolution block, the samples of the first low-resolution block and the one or more second low-resolution blocks defining predicted samples of the current Block; and, determining residual samples of a residual block based on original samples of the current block and the predicted samples of the current block; transforming the samples of the residual block into a bitstream; and, embedding metadata associated with the current block in the bitstream for signalling a decoder apparatus that the predicted samples of the current block are based on the downsampling scheme.

Block-level super-resolution based video coding

A method of determining a bitstream is described, the method including: determining a motion vector (MV) of a current block of a current video frame of a sequence of video frames comprising video data captured by a camera, the MV defining an offset of the current block relative to a prediction block, wherein part of the offset is caused by global motion in the video data if the camera is moving relative to a scene; determining motion vector predictor MW candidates for predicting the MV, the MW candidates being determined based on MVs of already encoded blocks; determining a motion compensation vector MCV for MW candidates, determining global motion compensated MW candidates based on a difference between a MW candidate and an associated MCV; selecting a compensated MW; and, determining a motion vector difference MVD based on the compensated MW and the MW; and, using entropy coding to code, the MVD, an indication of the selected compensated MW; and, conversion information for converting a MVP into a compensated MW, into a bitstream.

Video coding based on global motion compensated motion vector predictors

A method of encoding a video frame into a bitstream is described including: applying a downsampling scheme to an original video frame of a first resolution for determining a first low-resolution, LR, original frame and one or more second original LR frames, the first LR original frame and the one or more second LR original frames being of a second resolution that is lower than the first resolution; partitioning the first LR original frame into first original blocks and partitioning the one or more second LR frames into second original blocks; using a prediction method for determining first predicted blocks, the first predicted blocks defining predictions for the first original blocks of the first LR original frame; determining first residual blocks based on the first predicted blocks and the first original blocks and, subsequently, determining first reconstructed blocks based on the first residual blocks and the first predicted blocks; determining second predicted blocks based on the first reconstructed blocks, the second predicted blocks defining predictions for the second original blocks of the one or more second LR original frames; determining second residual blocks based on the second predicted blocks and the second original blocks; and, transforming the first residual blocks and second residual blocks into a bitstream, the bitstream including metadata for signalling a decoder apparatus that during the encoding a downsampling scheme was used for downsampling the video frame.

Frame-level super-resolution-based video coding

A method for adaptive streaming of nonlinear video is described wherein the method comprises receiving a manifest file comprising metadata defining a playback period defining video data of a predetermined playback duration, a playback period including at least one adaptation set defining a plurality of representations, each representation defining a set of segment identifiers, each segment identifier identifying a segment comprising a sequence of video frames; the metadata further comprising spatial playback information including at least a first region descriptor associated with a first adaptation set of a first playback period, the first region descriptor defining a destination identifier and a first region in video frames of the first adaptation set, the destination identifier signaling the client apparatus that the first region is linked to a second adaptation set; the client apparatus using the metadata to playback video data of the first adaptation set by requesting one or more network nodes to transmit segments of the first adaptation set; and, receiving or determining, during playback of requested segments, information associated with at least a second region in the video frames of the first adaptation set, the second region defining a region of interest (ROI) of a user of the client apparatus; the client apparatus selecting the second adaptation set for playback after the end of the playback of the first adaptation set on the basis of the first and second region, the selecting being based on a distance or an overlap between the first and second region.

Growing community of inventors

The Hague, Netherlands

Alexandre Da Silva Pratas Gabriel