Google Inc.

Zhengzhong Tu

Peyman Milanfar

Feng Yang

Han Zhang

Yinxiao Li

Hossein Talebi

Jessie Lin

Provided is an efficient and scalable attention model that can be referred to as multi-axis attention. Example implementations can include two aspects: blocked local and dilated global attention. These design choices allow global-local spatial interactions on arbitrary input resolutions with only linear complexity. The present disclosure also presents a new architectural element by effectively blending the proposed multi-axis attention model with convolutions. In addition, the present disclosure proposes a simple hierarchical vision backbone, example implementations of which can be referred to as MaxViT, by simply repeating the basic building block over multiple stages. Notably, MaxViT is able to 'see' globally throughout the entire network, even in earlier, high-resolution stages.

Multi-axis vision transformer

A method of measuring a banding artefact in an image includes generating a gradient profile from the image, where the gradient profile includes respective gradient magnitudes of pixels of the image; generating, using the gradient profile, a candidate banding pixel (CBP) map, where each location of the CBP map is such that a gradient magnitude of the gradient profile of a corresponding pixel of the image being greater than a first threshold and smaller than a second threshold; generating, using the CBP map, a banding edge map (BEM), where the BEM includes connected banding edges of the image; generating, using the BEM, a banding visibility map (BVM), where the BVM includes a respective banding metric for at least some pixels of the image; and generating a banding index of the image using the BVM.

No-reference banding artefact predictor

Growing community of inventors

Austin, TX, United States of America

Zhengzhong Tu