Methods and systems to synergize context of end-user with quality-of-experience of live video feed

Abstract

The disclosure relates generally to methods and systems to synergize context of end-user with quality-of-experience (QoE) of live video feed. Conventional techniques mostly lack synergy between encoder/decoder and underlying protocol, and they mostly employ motion vector-based encoding, thereby making them not so suitable for latency critical application. In most of the telepresence/teleoperation based live video streaming applications, at a time user's attention is focused on certain region of streamed video and not the entire frame. But most of existing techniques under challenges network conditions, undermine quality evenly throughout frame without giving importance to end-user's instantaneous region of interest. Existing mechanisms that try to alleviate this problem using foveated rendering are computationally expensive hence cannot be deployed easily on real life robotics platforms. The present disclosure attempts to alleviate all above challenges through end-user foveation centric spatio-temporal bitrate adaptation scheme tightly entangled with underlying protocol to achieve dynamic foveated rendering.