National Institute of Information and Communications Technology, Incorporated

Honda Motor Co., Ltd.

Noriyuki Kimura

Eiichiro Sumita

Chiori Hori

Satoshi Nakamura

Yutaka Ashikari

Kotaro Funakoshi

Mikio Nakano

Naoto Iwahashi

Komei Sugiura

Yoshinori Shiga

Hideo Okuma

Teruaki Hayashi

Etsuo Mizukami

[Object] An object is to provide an easy-to-use speech processing system attaining higher accuracy of speech recognition. [Solution] Receiving a speech utterance, the speech processing system performs speech recognition and displays a text of the recognition result. Further, the speech processing system translates the recognition result in accordance with settings to a text of another language and displays and synthesizes speech of the translated result. Further, the speech processing system selects utterance candidates having high possibility to be uttered as the next utterance and having high translation and speech recognitions scores, using outputs of various sensors at the time of utterance, a pre-trained utterance sequence model and translation and speech recognition scores of utterance candidates, and recommends utterance candidates in the form of an utterance candidate recommendation list. A user can think of what to say next using the utterances in utterance candidate recommendation list as hints.

System and terminal for presenting recommended utterance candidates

A conventional speech recognition dictionary, translation dictionary and speech synthesis dictionary used in speech translation have inconsistencies. Inconsistency among dictionaries can be solved with a dictionary server including an all-language group dictionary storage unit capable of having stored therein, for two or more languages, two or more all-language term information pieces for speech recognition, translation and speech synthesis, an information-for-speech-recognition sending unit that acquires information for speech recognition including speech recognition information of a term for all languages, and sends the information to one or more speech recognition servers, an information-for-translation sending unit that acquires information for translation including the written form of the term for all languages, and sends the information to one or more translation servers, and an information-for-speech-synthesis sending unit that acquires information for speech synthesis including speech synthesis information of a term for all languages, and sends the information to one or more speech synthesis servers.

Speech translation system, dictionary server, and program

Appropriate processing results or appropriate apparatuses can be selected with a control device that selects the most probable speech recognition result by using speech recognition scores received with speech recognition results from two or more speech recognition apparatuses; sends the selected speech recognition result to two or more translation apparatuses respectively; selects the most probable translation result by using translation scores received with translation results from the two or more translation apparatuses; sends the selected translation result to two or more speech synthesis apparatuses respectively; receives a speech synthesis processing result including a speech synthesis result and a speech synthesis score from each of the two or more speech synthesis apparatuses; selects the most probable speech synthesis result by using the scores; and sends the selected speech synthesis result to a second terminal apparatus.

Speech translation system, control device, and control method

The invention provides a dialogue-based learning apparatus through dialogue with users comprising: a speech input unit () for inputting speeches; a speech recognition unit () for recognizing the input speech; and a behavior and dialogue controller () for controlling behaviors and dialogues according to speech recognition results, wherein the behavior and dialogue controller () has a topic recognition expert () to memorise contents of utterances and to retrieve the topic that best matches the speech recognition results, and a mode switching expert () to control mode switching in accordance with a user utterance, wherein the mode switching expert switches modes in accordance with a user utterance, wherein the topic recognition expert registers a plurality words in the utterance as topics in first mode, performs searches from among the registered topics, and selects the maximum likelihood topic in second mode. Finally for every uttered word which is not found in a predetermined dictionary, it substitutes the said word with a word-graph comprising of either a known or a combination of known words in the said dictionary.

Non-dialogue-based and dialogue-based learning apparatus by substituting for uttered words undefined in a dictionary with word-graphs comprising of words defined in the dictionary

In conventional network-type speech translation systems, devices or models for recognizing or synthesizing speech cannot be changed in accordance with speakers' attributes, and therefore, accuracy is reduced or inappropriate output occurs in each process of speech recognition, translation, and speech synthesis. Accuracy of each processing of speech translation, translation, or speech synthesis is improved and appropriate output is performed in a network-type speech translation system by, based on speaker attributes, appropriately changing the server to perform speech recognition or the speech recognition model, appropriately changing the translation server to perform translation or the translation model, or appropriately changing the speech synthesis server or speech synthesis model.

Speech translation system, first terminal apparatus, speech recognition server, translation server, and speech synthesis server

Growing community of inventors

Koganei, Japan

Noriyuki Kimura