Mediatek Corporation

Ming-En Shih

Chih-Wei Chen

Pei-Kuei Tsung

Yao-Sheng Wang

Chih-Wen Goo

Yu-Cheng Tseng

Cheng Lung Jen

Kuo-Chiang Lo

Yu-Sheng Lin

Tung-Chien Chen

Kuo-Chen Huang

Ping-Yuan Tsai

Chun Hsien Wu

Hsin-Min Peng

Tsu Jui Hsu

An image processing circuit performs super-resolution (SR) operations. The image processing circuit includes memory to store multiple parameter sets of multiple artificial intelligence (AI) models. The image processing circuit further includes an image guidance module, a parameter decision module, and an SR engine. The image guidance module operates to detect a representative feature in an image sequence including a current frame and past frames within a time window. The parameter decision module operates to adjust parameters of one or more AI models based on a measurement of the representative feature. The SR engine operates to process the current frame using the one or more AI models with the adjusted parameters to thereby generate a high-resolution image for display.

Image-guided adjustment to super-resolution operations

A video processing circuit includes an input buffer, an online adaptation circuit, and an artificial intelligence (AI) super-resolution (SR) circuit. The input buffer receives input low-resolution (LR) frames and high-resolution (HR) frames from a video source over a network. The online adaptation circuit forms training pairs, and calculates an update to representative features that characterize the input LR frames using the training pairs. Each training pair formed by one of the input LR frames and one of the HR frames. The AI SR circuit receives the input LR frames from the input buffer and the representative features from the online adaptation circuit. Concurrently with calculating the update to the representative features, the AI SR circuit generates SR frames for display from the input LR frames based on the representative features. Each SR frame has a higher resolution than a corresponding one of the input LR frames.

Online AI super resolution engine and operations

Growing community of inventors

Hsinchu, Taiwan

Ming-En Shih