Nippon Telegraph and Telephone Corporation

Hironobu Chiba

Noboru Harada

Kenta Niwa

Sound source enhancement technology is provided that is capable of improving sound source enhancement capabilities in accordance with settings of usage and applications. A PSD optimization device includes a PSD updating unit that takes a target sound PSD input value {circumflex over ( )}φS(ω, τ), an interference noise PSD input value {circumflex over ( )}φIN(ω, τ), and a background noise PSD input value {circumflex over ( )}φBN(ω, τ) as input, and generates a target sound PSD output value φS(ω, τ), an interference noise PSD output value {circumflex over ( )}φIN(ω, τ), and a background noise PSD output value {circumflex over ( )}φBN(ω, τ), by solving an optimization problem for a cost function relating to a variable uS representing a target sound PSD, a variable uIN representing an interference noise PSD, and a variable uBN representing a background noise PSD. The optimization problem for the cost function is defined using at least one of a constraint relating to a frequency structure of a sound source or a convex cost term relating to the frequency structure of the sound source, a constraint relating to a temporal structure of the sound source or a convex cost term relating to the temporal structure of the sound source, and a constraint relating to a spatial structure of the sound source or a convex cost term relating to the spatial structure of the sound source.

PSD optimization apparatus, PSD optimization method, and program

Provided is sound source enhancement technology that is capable of improving sound source enhancement capabilities in a configuration using a beamformer to suppress interference noise. A PSD optimization device includes a PSD updating unit that takes a target sound PSD input value, an interference noise PSD input value, and a background noise PSD input value as input, and generates a target sound PSD output value, an interference noise PSD output value, and a background noise PSD output value, by solving an optimization problem for a cost function relating to a variable representing a target sound PSD, a variable representing an interference noise PSD, and a variable representing a background noise PSD. The optimization problem is defined using at least one of a constraint or a convex cost term based on difference in sound source enhancement characteristics of a beamformer in accordance with a degree of inclusion of a target sound, with regard to a PSD of signals beamformed in a target sound direction-of-arrival, and a constraint or a convex cost term based on the difference in sound source enhancement characteristics of the beamformer in a frequency direction, with regard to the PSD of signals beamformed in the target sound direction-of-arrival.

Growing community of inventors

Tokyo, Japan

Hironobu Chiba