Intel Corporation

Atthar H Mohammed

Stanley J Baran

Abhishek R Appu

Jong Dae Oh

Hiu-Fai R Chan

Sang-Hee Lee

Joydeep Ray

Richmond Hicks

Jill MacDonald Boyce

Narayan Biswal

Robert J Johnston

Sumit Mohan

Changliang Wang

James M Holland

Satyanarayana Avadhanam

Yi-Jen Chiu

Satya N Yedidi

Jason Daniel Tanner

Barnan Das

Archie Sharma

Fangwen Fu

Altug Koker

Ximin Zhang

Sang-hee Lee

Keith W Rowe

Srinivasan Embar Raghukrishnan

Hong Jiang

Nausheen Ansari

Srikanth Kambhatla

Kunjal ShyamKumar Parikh

Arthur Jeremy Runyan

Ning Lu

Gary Smith

Susanta Bhattacharjee

Wenhao Zhang

Lidong Xu

Dmitry E Ryzhov

Heon-Mo Koo

Venkata Prasad

Dmitry Ryzhov

Thuan H Pham

Muhammad Hamdan

This disclosure describes systems, methods, and devices related to generating visual quality metrics for encoded video frames. A method may include generating respective first visual quality metrics for pixels of an encoded video frame; generating respective second visual quality metrics for the pixels, the respective first visual quality metrics and the respective second visual quality metrics indicative of estimated human perceptions of the encoded video frame; generating a pixel block-based weight for the respective first visual quality metrics; generating a frame-based weight for the respective second visual quality metrics; and generating, based on the respective first visual quality metrics, the pixel block-based weight, the respective second visual quality metrics, and the frame-based weight, a human visual score indicative of a visual quality of the encoded video frame.

Enhanced real-time visual quality metric generation for video coding

Systems, apparatuses and methods may include a source device that generates a scene change notification in response to a movement of a camera, modifies an encoding scheme associated with the video content captured by the camera in response to the scene change notification, identifies a full-frame difference threshold, wherein scene analysis information includes frame difference data, and compares the frame difference data to an intermediate threshold that is less than the full-frame difference threshold, wherein the scene change notification is generated when the frame difference data exceeds the intermediate threshold. A sink device may obtain transport quality data associated with video content, modify an output parameter of a display based on the transport quality data, determine a view perspective of a still image containing a plurality of image slices, retrieve only a subset of the plurality of image slices based on the view perspective and decode the retrieved subset.

Technology to accelerate scene change detection and achieve adaptive content display

An embodiment may include a display processor, memory to store a 2D frame corresponding to a projection from a 360 video, and a quality selector to select a quality factor for a block of the 2D frame based on quality information from neighboring blocks of the 2D frame, including blocks which are neighboring only in the 360 video space. The system may also include a range adjuster to adjust a search range for the 2D frame based on a search area of the 2D frame, a viewport manager to determine if a request for a viewport of the 2D frame extends beyond a first edge of the 2D frame and to fill the requested viewport with wrap-around image information, and/or a motion estimator to estimate motion information based on both color information and depth information. Other embodiments are disclosed and claimed.

360 neighbor-based quality selector, range adjuster, viewport manager, and motion estimator for graphics

An embodiment of a semiconductor package apparatus may include technology to determine a residual error based on coding unit information, and determine a candidate coding unit and an associated rate distortion cost based on the residual error. An embodiment may additionally or alternatively include technology to partition a first coding unit into two or more smaller coding units based on a partition message, accelerate processing of at least one of the two or more smaller coding units, and estimate motion fora frame based at least partially on results of the accelerated processing. Other embodiments are disclosed and claimed.

Modular motion estimation engine for tree-based video

Systems, apparatuses and methods may a performance-enhanced computing system comprising a sensor for measuring luminance values corresponding to light focused onto the sensor at a plurality of pixel locations, a memory including a set of instructions, and a processor. The processor executes a set of instructions causing the system to generate a multi-segment tone mapping curve, generate a set of tone mapping values corresponding to the multi-segment tone mapping curve for equally spaced input values between zero and one for storage into a look up table, and process the luminance values using the look up table to apply the tone mapping curve to the luminance values of the pixels.

HDR enhancement with temporal multiplex

Systems, apparatuses and methods may provide for technology to improve user experience when viewing simulated 3D objects on a display. Head and upper-body movements may be tracked and recognized as gestures to alter the displayed viewing angle. The technology provides for a very natural way to look around, under, or over objects.

Viewing angles influenced by head and body movements

An embodiment of an electronic processing system may include an application processor, persistent storage media communicatively coupled to the application processor, a graphics subsystem communicatively coupled to the application processor, a power budget analyzer to identify a power budget for one or more of the application processor, the persistent storage media, and the graphics subsystem, a target analyzer communicatively coupled to the graphics subsystem to identify a target for the graphics subsystem, and a parameter adjuster to adjust one or more parameters of the graphics subsystem based on one or more of the identified power budget and the identified target.

Power-based and target-based graphics quality adjustment

Systems and methods may provide for occlusion detection in frame rate conversion. Detecting the occlusion allows frame rate conversion to be more accurately performed. In some embodiments, one or more stereoscopic depth cameras may be used to determine the depth of a moving object to more accurately determine the occlusion. In some embodiments, the compression ratio may be adjusted to balance the frame rate and power to help ensure compliance with a power budget. In at least some embodiments, the motion of a camera may be passed from a 3D render pipe to an encoder to avoid motion calculation and thereby saving power.

Video motion processing including static scene determination, occlusion detection, frame rate conversion, and adjusting compression ratio

Systems, apparatuses and methods may determine, on a per camera basis, an interest level with respect to panoramic video content, identify a subset of cameras in a plurality of cameras for which the interest level is below a threshold, and reduce power consumption in the subset of cameras. Additionally, technology may determine a projection format associated with panoramic video content, identify one or more discontinuous boundaries in the projection format, and modify an encoding scheme associated with the panoramic video content based on the discontinuous boundaries. Moreover, an encoded frame may be assigned to a temporal scalability layer that has a higher priority than a layer to which an asynchronous space warp frame is assigned. Additionally, technology may reduce the encoding complexity of a boundary between an active region and an inactive region in fisheye content.

Technology to assign asynchronous space warp frames and encoded frames to temporal scalability layers having different priorities

Image information is often transmitted from one electronic device to another. Such information is typically encoded and/or compressed to reduce the bandwidth required for transmission and/or to decrease the time necessary for transmission. Embodiments are directed to tagging objects or primitives with attribute tags to facilitate the encoding process. Other embodiments are directed to codecs running on hardware and/or software.

Encoding 3D rendered images by tagging objects

Systems and methods may provide for capturing 360 degree video, and multi-resolution encoding, processing and displaying of the video based on a field of view (FOV) and region of interest (ROI) for a viewer. The ROI may be determined based on eye tracking information (ETI) and the video may be encoded for viewports within the FOV at a high resolution and for other viewports outside the FOV at a lower resolution. ROI in the video may be encoded at a high resolution and areas outside of the ROI may be encoded at a lower resolution. The ETI enables the selective display of one or more warnings based on the gaze of a user to improve the efficiency of the warning. 3D glasses having variable lens may be used to adjust the focal distance of a virtual display to match a virtual distance of an object based on stereo distance cues.

Systems and methods for 360 video capture and display based on eye tracking including gaze based warnings and eye accommodation matching

An apparatus may include a memory to receive an image frame to encode; and a modular motion estimation engine to process the image frame. The modular motion estimation engine includes modular motion estimation circuitry comprising a multiplicity of motion estimation circuits, and a motion estimation kernel for execution on the modular motion estimation circuitry to send the image frame through one or more configurable execution pipelines that each execute motion estimation over one or more of the motion estimation circuits.

Modular motion estimation and mode decision engine

Growing community of inventors

Folsom, CA, United States of America

Atthar H Mohammed