Three-dimensional modeling system and modeling method based on multimodal fusion

Abstract

Disclosed are a three-dimensional modeling system and modeling method based on multimodal fusion. The method includes: separately collecting feedback data of an electroencephalogram sensor, an electromyography sensor, an eye movement sensor, a gesture sensor, and a voice sensor, conducting multimodal fusion on the feedback data, obtaining multimodal-fused model data, matching the model data with a database instruction, obtaining and analyzing an instruction set, obtaining and identifying a relevant modeling parameter, obtaining a modeling method, automatically conducting modeling according to the modeling method, and obtaining a visual entity model. Through the method of the present disclosure, multi-sense man-machine interaction is combined with traditional geometric modeling, and a complicated modeling command input operation does not require manipulation of interactive devices such as a keyboard and a mouse, such that modeling efficiency is improved, waste of manipulation energy of an operator is reduced, and further modeling experience of the operator is improved.