Suzhou Metabrain Intelligent Technology Co., Ltd.

Xiaochuan Li

Yaqian Zhao

Rengang Li

Baoyu Fan

Zhenhua Guo

The present application relates to the technical field of artificial intelligence, and discloses a visual positioning method and apparatus, a device, and a medium. The method includes: performing feature splicing on an image encoding feature and a text encoding feature; performing feature fusion on spliced encoding features to obtain a first fused encoding feature; performing noise correction on the first fused encoding feature and the text encoding feature on the basis of a preset cross-attention mechanism to obtain a corrected fused feature and a corrected text encoding feature, and performing feature fusion on the spliced encoding feature and the corrected text encoding feature to obtain a second fused encoding feature; and correcting a preset frame feature using a target encoding feature on the basis of the corrected fused feature and the second fused encoding feature to predict a regional position coordinate of a target visual object.

Visual positioning method and apparatus, device, and medium

A difference description statement generation method includes: performing feature concatenation on an image encoding feature and a text encoding feature; inputting a concatenated encoding feature to a preset image-text alignment unit constructed based on a preset self-attention mechanism to obtain a concatenated alignment feature; processing, by using a preset noise monitoring unit constructed based on the preset self-attention mechanism and a preset cross-attention mechanism, the text encoding feature, and an image alignment feature and a text alignment feature that are obtained by splitting the concatenated alignment feature respectively, to extract a difference signal; and generating a difference description statement based on the difference signal by using a preset difference description generation algorithm.

Growing community of inventors

Suzhou, China

Xiaochuan Li