Mofa (shanghai) Information Technology Co., Ltd.

Shanghai Movu Technology Co., Ltd.

Congyi Wang

Jinxiang Chai

Xingtang Xiong

Hongbing Tan

Yu Chen

Bin Wang

Shihao Jin

Tonghui Zhu

Bo Tong Liu

Zhiyong Wang

Bo Liu

Zhiqiang Liang

Wenping Zhao

A virtual role-based multimodal interaction method, apparatus and system, a storage medium, and a terminal, where the method includes: acquiring input information, where the input information includes one or more data types; inputting the input information into a perception layer to enable the perception layer to recognize and process the input information according to a data type of the input information to obtain a recognition result; inputting the recognition result into a logic decision-making layer to enable the logic decision-making layer to process the recognition result and generate a drive instruction corresponding to the recognition result; acquiring multimodal virtual content according to the drive instruction, wherein the multimodal virtual content includes at least a virtual role; and outputting the acquired multimodal virtual content.

Virtual role-based multimodal interaction method, apparatus and system, storage medium, and terminal

A text-based virtual object animation generation includes acquiring text information, where the text information includes an original text of a virtual object animation to be generated; analyzing an emotional feature of the text information; performing speech synthesis according to the emotional feature, a rhyme boundary, and the text information to obtain audio information, where the audio information includes emotional speech obtained by conversion based on the original text; and generating a corresponding virtual object animation based on the text information and the audio information, where the virtual object animation is synchronized in time with the audio information.

Text-based virtual object animation generation method, apparatus, storage medium, and terminal

Provided are an animation generation method, apparatus, and system and a storage medium, relating to the field of animation technology. The method includes acquiring the real feature data of a real object, where the real feature data includes the action data and the face data of the real object during a performance process; determining the target feature data of a virtual character according to the real feature data, where the virtual character is a preset animation model, and the target feature data includes the action data and the face data of the virtual character; and generating the animation of the virtual character according to the target feature data. The performance of the real object is used for generating the animation of the virtual character.

Animation generation method, apparatus and system, and storage medium

An end-to-end virtual object animation generation method includes receiving input information, where the input information includes text information or audio information of a virtual object animation to be generated; converting the input information into a pronunciation unit sequence; performing a feature analysis of the pronunciation unit sequence to obtain a corresponding linguistic feature sequence; and inputting the linguistic feature sequence into a preset timing mapping model to generate the virtual object animation based on the linguistic feature sequence.

End-to-end virtual object animation generation method and apparatus, storage medium, and terminal

Provided are a virtual livestreaming method, apparatus, and system, and a storage medium, relating to the technical field of livestreaming. The method is acquiring real feature data of a real subject, where the real feature data include motion data and face data of the real subject during a performance; determining target feature data of a virtual character according to the real feature data, where the virtual character is a preset animation model, and the target feature data include motion data and face data of the virtual character; determining video stream pushing data corresponding to the virtual character according to the target feature data; and sending the video stream pushing data corresponding to the virtual character to a target livestreaming platform, where the video stream pushing data is used for instructing the target livestreaming platform to display virtual livestreaming of the virtual character.

Virtual livestreaming method, apparatus, system, and storage medium

Growing community of inventors

Shanghai, China

Congyi Wang