Arm Limited

New York University

University of Rochester

Yuhao Zhu

Paul Nicholas Whatmough

Qi Sun

Jiayi He

Abhishek Tyagi

Budmonde Duinkharjav

Kenneth Chen

Saving power in an extended-reality device can include rendering a video stream on a display, tracking an eye of a user observing the display, ascertaining a gaze direction of the eye based on tracking the eye, calculating a foveal region of the display based on ascertaining the gaze direction in relation to the display, and modulating color hues of the video stream for pixels of the display outside the foveal region, to reduce a power consumption of the display. Modulating color hues is based on human color discrimination and display power consumption correlated to pixel color.

Color-perception-guided display power reduction for extended reality

A data processing apparatus detects motion between frames in a sequence of frames. The data processing apparatus then selects and/or tracks a region of interest in the sequence of frames based on the detected motion. An artificial neural network is then implemented to process image data for the selected region of interest in an attempt to classify an object within the region of interest. The data processing apparatus can provide an efficient way of performing computer vision processing.

Computer vision processing

A method of processing a video is provided. The method includes detecting a region of interest in a detection frame of the video. The method includes estimating a motion of the region of interest between the detection frame and an estimation frame of the video subsequent to the detection frame. The estimating is based on tracking of a characteristic of the detected region of interest into at least one portion of the estimation frame. The method includes, based on the estimated motion, estimating a location of the region of interest in the estimation frame. An apparatus for processing a video is also provided. A related non-transitory computer-readable storage medium comprising a set of computer-readable instructions is also provided.

Region of interest determination in video

Growing community of inventors

Rochester, NY, United States of America

Yuhao Zhu