Gopro, Inc.

Timothy Dick

Erich Tisch

Eric Penrod

Mark Hardin

Hakim Mesiwala

William Edward MacDonald

Akshay Shinde

Ramesh Avudurthi

An image capture device performs audio processing based on a detection of whether a wind sock is attached to the image capture device. When a wind sock is detected, the image capture device performs stereo processing. When a wind sock is not detected, the image capture device performs wind processing.

Blocked microphone detector and wind sock detector

Microphones are disposed on different surfaces of an image capture device to generate different microphone capture patterns. A microphone with three microphone elements is disposed on the top surface of the image capture device. The three microphone elements are arranged in an equilateral triangular configuration. A second microphone with at least two microphone elements is disposed on the front surface of the image capture device. The at least two microphone elements are disposed on the front surface of the image capture device in a vertical configuration. A third microphone with at least one microphone element is disposed on a back surface of the image capture device.

Dual-lens image capture device microphone positioning

Devices and methods for determining a direction of audio arrival from Ambisonics channels using azimuth and elevation segments is described herein. A method includes generating multiple blocks of samples from Ambisonics signals for a time interval, determining an azimuth angle estimate and an elevation angle estimate for the time interval when a defined number of blocks in the multiple blocks of samples are valid, generating the azimuth angle estimate based on maximum number of azimuth angle estimates present in an azimuth segment amongst a defined number of azimuth segments, and generating the elevation angle estimates based on maximum number of elevation angle estimates present in an elevation segment amongst a defined number of elevation segments, where the direction of arrival of the Ambisonics signals is based on the azimuth angle estimate and the elevation angle estimate.

Direction of audio arrival from Ambisonics channels using azimuth and elevation segments

An image capture device may capture multiple audio content during capture of visual content. A viewing window for the visual content and rotational position of the image capture device during capture of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of a punchout of the visual content using the viewing window.

Systems and methods for matching audio to video punchout

An image capture device reduces noise floor using multiple microphones. The image capture device includes a processor that obtains a front microphone signal from a front microphone, the front microphone signal having a noisy noise floor portion, obtains a rear microphone signal from a rear microphone, sets a splice point based on mitigation of the noisy noise floor portion relative to a speech frequency range, and combines a substantially clean noise floor portion of the rear microphone signal at or below the splice point with a remaining portion of the front microphone signal above the splice point to generate a microphone signal.

Multi-microphone noise floor mitigation

Wind processing performance is improved by the placement of one or more microphones on a device. The device includes one or more microphones on the front surface, one or more microphones on the top surface, and one or more microphones on the rear surface. The rear surface is a heatsink, and the one or more microphones on the rear surface are located in recesses created by two or more fins of the heatsink. The device includes a processor that performs wind processing based on signals from the one or more microphones on the front surface, signals from the one or more microphones on the top surface, signals from the one or more microphones on the rear surface, or any combination thereof.

Microphone placement for wind processing

An image capture device may capture multiple audio content during capture of visual content. The field of view of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of the visual content with the field of view.

Systems and methods for dynamically modifying audio content using variable field of view

An integrated circuit includes a processor that upsamples a vibration signal. The processor determines a correlation value. The correlation value may be based on a microphone signal, the upsampled vibration signal, or both. The processor filters the vibration signal to remove a noise portion and obtain a processed microphone signal. The processor outputs the processed microphone signal.

Method and apparatus for active reduction of mechanically coupled vibration in microphone signals

An image capture device, having: a housing, a lens snout, a front microphone, a top microphone, and an audio processor. The housing has a top and front housing surface. The lens snout protrudes from the front housing surface. The front microphone mounted within or on the front housing surface and below the lens snout. The top microphone mounted within or on a top housing surface in a position biased toward the front housing surface. The audio processor comprises a memory that is configured to store instructions that when executed cause the audio processor to generate an output audio signal. The top microphone is located at a position to receive direct freestream air flow when the housing is positioned in a pitched forward orientation at a pitched forward angle relative to a vertical axis. The front microphone receives turbulent air flow from the lens snout when the housing is positioned in the pitched forward orientation.

Wind noise reduction by microphone placement

An integrated circuit includes a processor that upsamples a vibration signal. The processor determines a correlation value. The correlation value may be based on a microphone signal, the upsampled vibration signal, or both. The processor determines filter coefficients. The filter coefficients may be determined based on the correlation value being above a threshold. The filter coefficient may be based on the upsampled vibration signal. The processor filters the vibration signal based on the filter coefficients to remove a noise portion and obtain a processed microphone signal. The processor outputs the processed microphone signal.

An image capture device includes a sensor, a microphone array, and a processor. The microphone array may include a first microphone, a second microphone, a third microphone, or any combination thereof. The first microphone may be configured to face a first direction. The second microphone may be configured to face a second direction. The second direction may be diametrically opposed to the first direction. The third microphone may be configured to face a third direction. The third direction may be substantially perpendicular to the first direction, the second direction, or both. The processor may be configured to determine a microphone capture pattern and detect wind noise. The microphone capture pattern may be determined based on data obtained from the sensor. The sensor data may include image data, audio data, image capture device orientation data, location data, accelerometer data, or any combination thereof.

Method and apparatus for wind noise detection and beam pattern processing

An image capture device includes a housing having a lens snout protruding from a front housing surface. A front microphone is mounted below the lens snout. A top microphone is mounted under a top housing surface. The top microphone is positioned to receive direct freestream air flow at a first pitched forward angle. The front microphone is positioned to receive turbulent air flow at a second pitched forward angle. The second pitched forward angle is greater than or equal to the first pitched forward angle. An audio processor receives a first audio signal and a second audio signal from the top microphone and front microphone, respectively. The audio processor generates frequency sub-bands from the first and second audio signals. The audio processor selects the frequency sub-bands with the lowest noise metric and combines them to generate an output audio signal.

An image capture device may include a microphone, a vibration sensor, and a processor. The microphone may obtain a microphone signal that includes an acoustic signal portion and a mechanical noise portion. The vibration sensor may obtain a vibration signal. The processor may upsample the vibration signal. The processor may determine a correlation value. The correlation value may be based on the microphone signal, the upsampled vibration signal, or both. The processor may determine filter coefficients. The filter coefficients may be determined on a condition that the correlation value is above a threshold. The filter coefficient may be based on the upsampled vibration signal. The processor may filter the vibration signal based on the filter coefficients to remove the mechanical noise portion and obtain a processed microphone signal. The processor may output the processed microphone signal.

Growing community of inventors

San Francisco, CA, United States of America

Timothy Dick