Nanjing Silicon Intelligence Technology Co., Ltd.

Yiping Tang

Huapeng Sima

Cheng Wang

Ao Yao

Da Jiang

Manhong Wang

Bingtao Hua

Haie Wu

Zhengkun Mei

A speech interaction method, a speech interaction system and a storage medium. The method includes: receiving interactive speech input by a user; determining an emotional tag corresponding to the interactive speech based on the interactive speech and interactive text corresponding to the interactive speech; determining, based on the emotional tag, a response text corresponding to the interactive text, and a first prosodic feature and a second prosodic feature corresponding to the response text. The first prosodic feature is used for characterizing the whole sentence prosodic feature of the response text, and the second prosodic feature is used for characterizing a local prosodic feature of each character in the response text; and generating and outputting a response speech corresponding to the interactive speech based on the response text, the first prosodic feature and the second prosodic feature.

Speech interaction method, speech interaction system and storage medium

Embodiments of the present application provide a speech conversion method and apparatus, a storage medium, and an electronic device. The method includes: acquiring a source speech to be converted and a target speech sample of a target speaker; recognizing a style category of the target speech sample, and extracting a target audio feature from the target speech sample according to the style category; extracting a source audio feature from the source speech; acquiring a first style feature of the target speech sample and determining a second style feature of the target speech sample according to the first style feature; fusing and mapping the source audio feature, the target audio feature, and the second style feature to obtain a joint encoding feature; and decoding the joint encoding feature, to obtain a target speech feature, and converting the source speech based on the target speech feature to obtain a target speech.

Speech conversion method and apparatus, storage medium, and electronic device

This application provide a synthetic audio output method and apparatus, a storage medium, and an electronic device. The method includes: inputting input text and a specified target identity identifier into an audio output model; extracting an identity feature sequence of a target identity by an identity recognition model; extracting a phoneme feature sequence corresponding to the input text by an encoding layer of a speech synthesis model; superimposing and inputting the identity feature sequence of the target identity and the phoneme feature sequence into a variable adapter of the speech synthesis model; and after duration prediction and alignment, energy prediction, and pitch prediction are performed on the phoneme feature sequence by the variable adapter, outputting a target Mel-frequency spectrum feature corresponding to the input text through a decoding layer of the speech synthesis model; and inputting the target Mel-frequency spectrum feature into a vocoder to output synthetic audio.

Synthetic audio output method and apparatus, storage medium, and electronic device

Embodiments of the present disclosure provide a method and apparatus for determining a psychological counseling training scheme. The method includes: obtaining training feeling data of a user after each session of psychological counseling training through an interactive inquiry with the user; inputting the training feeling data into a first classification model, identifying a training result of the user after each session of psychological counseling training by using the first classification model, and collecting statistics about a training result of the user in a current training period; and determining a training scheme of the user for a next training period based on the training result in the current training period of the user. The invention resolves the problem that a counseling result is not ideal because individual demands of different users cannot be satisfied if a psychological robot performs psychological counseling on the user according to a preset counseling procedure.

Method and apparatus for determining psychological counseling training scheme

Embodiments of the present application provide a text output method and system, a storage medium, and an electronic device. The system includes at least an automatic speech recognition ASR model group, a text alignment model, and a re-scoring model that are sequentially connected, where the ASR model group includes a plurality of ASR models each configured to convert input audio data into respective first texts; the text alignment model is configured to perform alignment for a plurality of first texts, to obtain a plurality of target texts, where lengths of the plurality of target texts are all equal; and the re-scoring model is configured to score words/terms at each alignment position of the plurality of target texts, to obtain a word/term with the highest score at each alignment position, as a target word/term, and determine the target word/terms, as an output text, by the respective alignment positions.

Growing community of inventors

Jiangsu, China

Yiping Tang