Encoding apparatuses, and data processing methods and apparatuses

Abstract

A computer-implemented system for encoding includes an encoding layer and at least one joint encoding unit. The encoding layer encodes a received first modal initial feature vector and a received second modal initial feature vector, to generate, respectively, a first modal feature vector and a second modal feature vector, joint encoded by the at least one joint encoding unit, where the at least one joint encoding unit includes an encoding module and a modal input switching module. The modal input switching module processes the first modal feature vector and the second modal feature vector, to obtain, respectively a first modal switching encoding vector and a second modal switching encoding vector. The encoding module processes the first modal switching encoding vector and the second modal switching encoding vector, to generate, respectively a first target modal fusion vector and a second target modal fusion vector.