Hon Hai Precision Industry Co., Ltd.

Foxconn Technology Group Co., Ltd.

Jia Wang

Yung-Hui Li

Hong-Han Shuai

Wen-Huang Cheng

Jing-Cheng Ke

A recognition method includes the following steps. A text is analyzed by a language recognition network to generate an entity feature, a relation feature and an overall feature. An input image is analyzed by an object detection network to generate candidate regions. Node features, aggregated edge features and compound features are generated by an enhanced cross-modal graph attention network according to the entity feature, the relation feature, the candidate regions and the overall feature. The entity feature and the relation feature are matched to the node features and the aggregated edge features to generate the first scores. The overall feature is matched to the compound features to generate second scores. Final scores corresponding to the candidate regions are generated according to the first scores and the second scores.

Growing community of inventors

Taipei, Taiwan

Jia Wang