Panasonic Intellectual Property Management Co., Ltd.

Panasonic Intellectual Property Corporation of America

Shintaro Yoshikuni

Hiroyuki Matsumoto

Toshimichi Tokuda

Shuichi Watanabe

Hisashi Tsuji

Hirotaka Sawa

Shinichi Shigenaga

Tadashi Maki

Shojiro Matsuo

Teppei Fukuda

Takeo Kanamori

Naoya Tanaka

Kazunori Hayashi

Akitoshi Izumi

Kosuke Shinozaki

Masanari Miyamoto

Kohhei Hayashida

Takashi Hirabara

Keisuke Fujimoto

Hirokazu Tasaka

Ryoichi Yuge

Ryouichi Yuge

Susumu Ono

In a sound source display system, an omnidirectional camera captures an image of a monitoring area. A microphone array collects a voice in the monitoring area. A monitoring monitor displays the image of an imaging area captured by the omnidirectional camera. A sound pressure calculator in a directivity control device calculates a sound pressure indicating a source of a sound in the image of the imaging area using voice data of the voice collected by the microphone array. An output controller in the directivity control device compares the sound pressure and threshold values (first threshold value, second threshold value), and causes sound image information in which the sound pressure is converted into visual information according to the result of comparison, to be displayed on the monitoring monitor so as to be superimposed on the image of the imaging area.

Monitoring system and monitoring method

In an object, for example, a pilotless flying object detection system, an omnidirectional camera as a first camera images a monitoring area. A microphone array acquires audio of the monitoring area. A monitoring apparatus uses the audio data acquired by the microphone array to detect a pilotless flying object which appears in the monitoring area. A signal processor in the monitoring apparatus superimposes a discrimination mark, obtained by converting the pilotless flying object into visual information, on image data of the monitoring area when displaying the image data of the monitoring area captured by the omnidirectional camera on a monitor.

Pilotless flying object detection system and pilotless flying object detection method

In a directionality control system, a camera device captures a video of image capture area. A microphone array device collects a sound in image capture area. A signal processing section detects a sound source of the sound in image capture area, which is collected by the microphone array device. In a case where the detected sound source is within a range of privacy area, an output control section controls the sound in image capture area, which is collected by the microphone array device and is output from speaker device.

Directionality control system and sound output control method

In a pilotless flying object detection system, a masking area setter sets a masking area to be excluded from detection of a pilotless flying object which appears in a captured image of a monitoring area, based on audio collected by a microphone array. An object detector detects the pilotless flying object based on the audio collected by the microphone array and the masking area set by the masking area setter. An output controller superimpose sound source visual information, which indicates the volume of a sound at a sound source position, at the sound source position of the pilotless flying object in the captured image and displays the result on a first monitor in a case where the pilotless flying object is detected in an area other than the masking area.

A sound source probing apparatus, including storage and processing circuitry, is provided that probes a direction of a sound source. The processing circuitry performs operations including determining a first correlation matrix that is a correlation matrix of acoustic signals acquired as observation signals by a microphone array including two or more microphones disposed apart from each other. The operations also include determining, by learning, weights such that a linear sum of a plurality of second correlation matrices multiplied by the respective weights is equal to the first correlation matrix where the plurality of second correlation matrices are correlation matrices, which are determined for respective directions determined based on an array arrangement of the microphone array and which are stored in advance in the storage. The operations further include determining, using the determined weights, a spatial spectrum of the observation signal indicating sound pressure intensities in the respective directions.

Sound source probing apparatus, sound source probing method, and storage medium storing program therefor

A directionality control system includes: a camera; a microphone provided as a separate body from the camera; a display that displays video data captured by the camera; and a processor that computes a sound collection direction, which is directed from the microphone toward a sound position corresponding to a designated position in the video data. The processor computes the sound collection direction by using parameters including: a first height of the camera from a reference surface, a second height of the microphone from the reference surface, a third height of a computation reference point from the reference surface, the computation reference point being positioned in the sound collection direction at a position different from the sound position, a direction which is directed from the camera toward the sound position, and a fourth height of the sound position from the reference surface.

Directionality control system, calibration method, horizontal deviation angle computation method, and directionality control method

Sound collection directionality is formed toward a location corresponding to a position designated in a video of a predetermined region which is imaged by a camera apparatus with a microphone array apparatus as a reference, and audio data is collected with high accuracy. In a directionality control system (), a signal processing unit () derives a sound collection direction (&#x3b8;,&#x3b8;) which is directed from an installation position of a microphone array apparatus () toward a sound position corresponding to a position designated in video data on a screen of the display device () in response to a user's designation of any position in the video data displayed on the screen. The signal processing unit () forms sound collection directionality of audio data in the derived sound collection direction (&#x3b8;,&#x3b8;).

A recorder receives designation of a video which is desired to be reproduced from a user. If designation of one or more designated locations where sound is emphasized on a screen of a display which displays the video is received by the recorder from the user via an operation unit during reproduction or temporary stopping of the video, a signal processing unit performs an emphasis process on audio data, that is, the signal processing unit emphasizes audio data in directions directed toward positions corresponding to the designated locations from a microphone array by using audio data recorded in the recorder. A reproducing device reproduces the emphasis-processed audio data and video data in synchronization with each other.

Sound processing system and processing method that emphasize sound from position designated in displayed video image

A first correlation matrix, which corresponds to observed signals, is calculated, a non-scan range is specified, a second correlation matrix, which corresponds to an acoustic signal from a sound source within the non-scan range, is estimated, a third correlation matrix, which corresponds to a target sound source within a scan range, is calculated by removing the second correlation matrix from the first correlation matrix, and a first spatial spectrum, which is a localization result, is calculated from the third correlation matrix. In the estimation, the second correlation matrix is estimated from direction vectors calculated from a direction range of the non-scan range and a second spatial spectrum, which is a localization result calculated immediately before the first spatial spectrum is calculated.

Sound source detection apparatus, method for detecting sound source, and program

A system includes an imaging part that captures an image, a sound collection part that collects sounds, a display part that displays image data captured by the imaging part, a directive direction calculation part that calculates a directive direction which directs toward a sound position corresponding to a designated position of the image data from the sound collection part when any position of the displayed image data is designated, and a control part that forms a directivity in the sounds in the calculated directive direction. The control part controls output of the sounds collected by the sound collection part or output of the sounds which are collected by the sound collection part and of which the directivity is formed, or suspends collection of sounds in the sound collection part, when it is determined that the sound position is included in a preset protection region.

Directivity control system and sound output control method

A failure detection system includes an omnidirectional microphone array device having a plurality of microphone elements and a directivity control device that calculates a delay time of a voice propagated from a sound source to each microphone element and forms a directivity of the voice using the delay time and the voice collected by the omnidirectional microphone array device, and detects a failure of the microphone element. A smoothing unit calculates an average power of one microphone element. An average calculator calculates a total average power of a plurality of usable microphone elements included in the omnidirectional microphone array device. A comparison unit compares whether or not a difference between the average power and the total average power exceeds a range of &#xb1;6 dB, and determines whether the microphone element is in failure based on the comparison result.

Failure detection system and failure detection method

An audio processing system, includes: an audio collector that collects audio in a non-directivity state using audio collection elements; an operator receives an input of one or more designation directions for audio emphasis for switching from the non-directivity state to a directivity state; an emphasis processor that generates audio data in the directivity state obtained by performing an emphasis process on the audio data in the designation direction from the audio collector using audio data collected by the audio collector according to the input of the designation direction; a volume adjustor that adjusts volume of the audio data in a directivity state; and an audio output that outputs the audio in a non-directivity state collected by the audio collector or the audio in a directivity state after the volume has been adjusted by the volume adjustor.

Growing community of inventors

Fukuoka, Japan

Shintaro Yoshikuni