Charter Communications Operating, LLC

Matthew Ringenberg

Dhananjay Lal

Dell Wolfensparger

Andrew Ip

Mun G Choi

Omar Alami

Virtual reality content (VR content) streaming based on quality of experience level is disclosed. In response to a request from a head-mounted display device (HMDD) to serve a VR content, a computing device determines a head motion quantifier (HMQ) associated with the VR content. The computing device is configured to dynamically provide to the HMDD imagery from the VR content based on head movements of a user of the HMDD. The computing device determines a latency value associated with a round-trip time of data between the computing device and the HMDD. The computing device determines a quality of experience level of a plurality of different quality of experience levels based on the HMQ and the latency value, and performs an action based on the quality of experience level.

Virtual reality content streaming based on quality of experience level

Delivering pre-rendered holographic content over a network is disclosed. A first camera view segment of a plurality of camera view segments that compose a holographic video is selected. Each camera view segment corresponds to a different camera view perspective of a scene and includes rendered holographic content that depicts a plurality of concurrent different viewer perspectives of the scene. The first camera view segment is streamed toward a holographic display for presentation of the first camera view segment on the holographic display.

Delivering pre-rendered holographic content over a network

Compensating for latency in a streaming virtual reality environment is disclosed. A computing device receives from a head-mounted display device (HMDD) having a field of view (FOV), first pose data that identifies an orientation of the HMDD worn by a participant viewing a virtual world via the HMDD. The computing device renders, based at least in part on the first pose data and a first oversized FOV that is greater than the FOV, oversized imagery that depicts a portion of the virtual world within the FOV of the HMDD and a portion of the virtual world outside of the FOV of the HMDD. The computing device communicates the oversized imagery to the HMDD.

Compensating for latency in a streaming virtual reality environment

Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content

Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device

Providing selectable virtual reality (VR) viewpoints within a VR environment is disclosed. In one embodiment, a network computing device provides downloadable VR content that defines a VR environment comprising a plurality of viewpoints. The plurality of viewpoints may include, as non-limiting examples, one or more viewpoints corresponding to one or more VR participants within the VR environment, and/or one or more predefined non-participant viewpoints. The network computing device receives a viewpoint selection indication from a client computing device of a spectator of the VR environment, wherein the viewpoint selection indication corresponds to a selected viewpoint of the plurality of viewpoints. The network computing device then transmits, to the client computing device, a pose data stream comprising pose data corresponding to the selected viewpoint. The client computing device may then display the VR environment based on the VR content and the pose data corresponding to the selected viewpoint.

Growing community of inventors

Denver, CO, United States of America

Matthew Ringenberg