Beijing Jingdong Shangke Information Technology Co., Ltd.

Beijing Jingdong Century Trading Co., Ltd.

Yingwei Pan

Tao Mei

Ting Yao

Yehao Li

An image paragraph description generating method and apparatus, a medium and an electronic device. The method comprises: obtaining image features of an image (S); determining the topic of the image according to the image features by using a convolutional automatic coding method (S); and determining image description information of the image according to the topic by using a long short-term memory (LSTM)-based paragraph coding method (S), wherein the LSTM comprises a sentence-level LSTM and a paragraph-level LSTM.

Image paragraph description generating method and apparatus, medium and electronic device

The present disclosure relates to the technical field of image processing, and in particular to an image description generation method, apparatus and system, and a medium and an electronic device. The method comprises: acquiring one or more image region features in a target image, and obtaining a current input vector by performing a mean pooling on the image region features; obtaining respective outer product vectors of the image region features by respectively linearly fusing the current input vector and each of the image region features; calculating, based on the respective outer product vectors of the image region features, an attention distribution of the image region features in a spatial dimension and an attention distribution of the image region features in a channel dimension; and generating an image description of the target image based on the attention distribution of the image region features in the spatial dimension and the attention distribution of the image region features in the channel dimension.

Growing community of inventors

Beijing, China

Yingwei Pan