Yamaha Corporation

Merlijn Blaauw

Jordi Bonada

Ryunosuke Daido

Keijiro Saino

Yuji Hisaminato

Makoto Tachibana

Michael Wilson

An information processing system includes at least one memory storing a program and at least one processor. The at least one processor implements the program to input a piece of sound source data obtained by encoding a first identification data representative of a sound source, a piece of style data obtained by encoding a second identification data representative of a performance style, and synthesis data representative of sounding conditions into a synthesis model generated by machine learning, and to generate, using the synthesis model, feature data representative of acoustic features of a target sound of the sound source to be generated in the performance style and according to the sounding conditions, and to generate an audio signal corresponding to the target sound using the generated feature data.

Information processing method and information processing system for sound synthesis utilizing identification data associated with sound source and performance styles

A sound processing method obtains note data representative of a note; obtains an audio signal to be processed; specifies, in accordance with the note, an expression sample representative of a sound expression to be imparted to the note and an expression period, of the audio signal, to which the sound expression is to be imparted to the note; and specifies, in accordance with the expression sample and the expression period, a processing parameter relating to an expression imparting processing for imparting the sound expression to a portion corresponding to the expression period in the audio signal. The method then generates a processed audio signal by performing the expression imparting processing in accordance with the expression sample, the expression period, and the processing parameter to the audio signal.

Sound processing method, sound processing apparatus, and recording medium

A computer-implemented sound signal generation method includes: obtaining a first sound source spectrum of a sound signal to be generated; obtaining a first spectral envelope of the sound signal; and estimating fragment data representative of samples of the sound signal based on the obtained first sound source spectrum and the obtained first spectral envelope.

Sound signal generation method, generative model training method, sound signal generation system, and recording medium

A voice synthesis method according to an embodiment includes altering a series of synthesis spectra in a partial period of a synthesis voice based on a series of amplitude spectrum envelope contours of a voice expression to obtain a series of altered spectra to which the voice expression has been imparted, and synthesizing a series of voice samples to which the voice expression has been imparted, based on the series of altered spectra.

Voice synthesis method, voice synthesis device, and storage medium

A voice synthesis method includes: sequentially acquiring voice units comprising at least one of diphone or a triphone in accordance with synthesis information for synthesizing voices; generating statistical spectral envelopes using a statistical model built by machine learning in accordance with the synthesis information for synthesizing the voices; and concatenating the sequentially acquired voice units and modifying a frequency spectral envelope of each voice unit in accordance with the generated statistical spectral envelope, thereby synthesizing a voice signal based on the concatenated voice units having the modified frequency spectra.

Voice synthesis apparatus and voice synthesis method utilizing diphones or triphones and machine learning

A voice synthesis method for generating a voice signal through connection of a phonetic piece extracted from a reference voice, includes selecting, by a piece selection unit, the phonetic piece sequentially; setting, by a pitch setting unit, a pitch transition in which a fluctuation of an observed pitch of the phonetic piece is reflected based on a degree corresponding to a difference value between a reference pitch being a reference of sound generation of the reference voice and the observed pitch of the phonetic piece selected by the piece selection unit; and generating, by a voice synthesis unit, the voice signal by adjusting a pitch of the phonetic piece selected by the piece selection unit based on the pitch transition generated by the pitch setting unit.

Voice synthesis method, voice synthesis device, medium for storing voice synthesis program

A processing unit of a voice processing apparatus first generates a target voice signal in a time domain by adjusting a fundamental frequency of a target voice signal to a fundamental frequency of an initial voice signal, so as to generate a spectrum of the target voice signal after pitch is adjusted. Second, the processing unit reallocates, along a frequency axis, the spectrum of the target voice characteristics by having the spectrum correspond to each of the fundamental frequencies of the initial voice signal. The processing unit then generates a converted spectrum by adjusting component values of the spectrum of the target voice characteristics, which spectrum has been reallocated, so as to correspond to the component values of the spectrum of the initial voice signal, and by adapting the component values of the spectrum of the initial voice signal to specific frequency bands of the spectrum of the target voice characteristics, with each specific frequency band including one of the harmonic frequencies corresponding to the fundamental frequency of the initial voice signal.

Voice processing method and apparatus, and recording medium therefor

In a voice processing apparatus, a processor is configured to adjust, a fundamental frequency of a first voice signal corresponding to a voice having target voice characteristics to a fundamental frequency of a second voice signal corresponding to a voice having initial voice characteristics different from the target voice characteristics. The processor is further configured to sequentially generate a processed spectrum based on a spectrum of the first voice signal and a spectrum of the second voice signal by: dividing the spectrum of the first voice signal into a plurality of harmonic band components after the fundamental frequency of the first voice signal has been adjusted; allocating each harmonic band component of the first voice signal to each harmonic frequency associated with the fundamental frequency of the second voice signal; and adjusting an envelope and phase of each harmonic band component according to the spectrum of the second voice signal.

Voice processing apparatus

In a voice synthesis apparatus, a phoneme piece interpolator acquires first phoneme piece data corresponding to a first value of sound characteristic, and second phoneme piece data corresponding to a second value of the sound characteristic. The first and second phoneme piece data indicate a spectrum of each frame of a phoneme piece. The phoneme piece interpolator interpolates between each frame of the first phoneme piece data and each frame of the second phoneme piece data so as to create phoneme piece data of the phoneme piece corresponding to a target value of the sound characteristic which is different from either of the first and second values of the sound characteristic. A voice synthesizer generates a voice signal having the target value of the sound characteristic based on the created phoneme piece data.

Growing community of inventors

Barcelona, Spain

Merlijn Blaauw