Gopro, Inc.

Erich Tisch

Eric Penrod

Timothy Dick

Magnus Hansson

Ke Li

Joyce Rosenbaum

Fabrice Barbier

Mark Hardin

Zhinian Jing

Joyce Gorny

Scott Patrick Campbell

Kielan C Crow

Per Magnus Fredrik Hansson

David Wurtz

Paul Eric Beckmann

Himay Rashmikant Shukla

Hakim Mesiwala

Adrian Santos

Paul Finkel

Evan L Coons

William Edward MacDonald

Alexander Wroblewski

Akshay Shinde

Eric Jing

Ramesh Avudurthi

An image capture device performs audio processing based on a detection of whether a wind sock is attached to the image capture device. When a wind sock is detected, the image capture device performs stereo processing. When a wind sock is not detected, the image capture device performs wind processing.

Blocked microphone detector and wind sock detector

Microphones are disposed on different surfaces of an image capture device to generate different microphone capture patterns. A microphone with three microphone elements is disposed on the top surface of the image capture device. The three microphone elements are arranged in an equilateral triangular configuration. A second microphone with at least two microphone elements is disposed on the front surface of the image capture device. The at least two microphone elements are disposed on the front surface of the image capture device in a vertical configuration. A third microphone with at least one microphone element is disposed on a back surface of the image capture device.

Dual-lens image capture device microphone positioning

Devices and methods for determining a direction of audio arrival from Ambisonics channels using azimuth and elevation segments is described herein. A method includes generating multiple blocks of samples from Ambisonics signals for a time interval, determining an azimuth angle estimate and an elevation angle estimate for the time interval when a defined number of blocks in the multiple blocks of samples are valid, generating the azimuth angle estimate based on maximum number of azimuth angle estimates present in an azimuth segment amongst a defined number of azimuth segments, and generating the elevation angle estimates based on maximum number of elevation angle estimates present in an elevation segment amongst a defined number of elevation segments, where the direction of arrival of the Ambisonics signals is based on the azimuth angle estimate and the elevation angle estimate.

Direction of audio arrival from Ambisonics channels using azimuth and elevation segments

An image capture device with dynamic wind noise compression tuning techniques is described. A technique includes detecting of the presence of wind noise by measuring coherence between at least two microphones. For a compressor, adjusting a default compression threshold and default compression parameters based on the coherence measurements. For each microphone, applying by the compressor the adjusted compression parameters when an audio signal is above the adjusted compression threshold and applying the default compression parameters when the audio signal is below the adjusted compression threshold.

Dynamic wind noise compression tuning

An apparatus including a microphone, a speaker, and a processor. The speaker is configured to produce a sound that audibly communicates information to a user. The microphone is configured to receive the sound. The processor is configured to produce the sound through the speaker to audibly communicate information to the user; capture a video that includes audio; initiate a sound removal process to remove the sound from the audio; and after the sound is produced, stop the sound removal process.

Apparatus and method of removing selective sounds from a video

An image capture device detects a wind whistle using two or more microphones. The image capture device includes a processor that obtains microphone signals from the two or more microphones and determines coherence values between the microphone signals across a frequency band. The processor determines a coherence value for each frequency bin of the frequency band. Based on a detection of an elevated coherence value in a frequency bin, the processor determines the presence of a whistle. The processor attenuates the frequency bin based on a determination that the elevated coherence value is above a threshold.

Detection and mitigation of a wind whistle

An image capture device may capture multiple audio content during capture of visual content. A viewing window for the visual content and rotational position of the image capture device during capture of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of a punchout of the visual content using the viewing window.

Systems and methods for matching audio to video punchout

An image capture device with a housing, a drainage microphone, processor, and drainage channel. The housing defining an audio depression. The drainage microphone coupled to the housing at a location of the audio depression and configured to capture audio. The processor coupled with a memory storing instructions that when executed cause the processor to apply a set of tuned beamforming parameters to the captured audio. The drainage channel within the housing to drain moisture from the drainage microphone. The drainage channel defining a channel entrance having a channel entrance width and a channel entrance height.

Camera microphone drainage system designed for beamforming

An image capture device reduces noise floor using multiple microphones. The image capture device includes a processor that obtains a front microphone signal from a front microphone, the front microphone signal having a noisy noise floor portion, obtains a rear microphone signal from a rear microphone, sets a splice point based on mitigation of the noisy noise floor portion relative to a speech frequency range, and combines a substantially clean noise floor portion of the rear microphone signal at or below the splice point with a remaining portion of the front microphone signal above the splice point to generate a microphone signal.

Multi-microphone noise floor mitigation

Wind processing performance is improved by the placement of one or more microphones on a device. The device includes one or more microphones on the front surface, one or more microphones on the top surface, and one or more microphones on the rear surface. The rear surface is a heatsink, and the one or more microphones on the rear surface are located in recesses created by two or more fins of the heatsink. The device includes a processor that performs wind processing based on signals from the one or more microphones on the front surface, signals from the one or more microphones on the top surface, signals from the one or more microphones on the rear surface, or any combination thereof.

Microphone placement for wind processing

An image capture device may capture multiple audio content during capture of visual content. The field of view of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of the visual content with the field of view.

Systems and methods for dynamically modifying audio content using variable field of view

An image capture device includes a processor for wind noise processing. The processor receives signals from microphones. The processor may segment the signals into low frequency bins and high frequency bins. The processor may select a minimum level signal bin for the low frequency bins. The processor may select a minimum level signal bin for the high frequency bins. The processor may generate a composite signal by combining the selected minimum level signal bins for the low frequency bins and the selected minimum level signal bins for the high frequency bins.

Method and apparatus for dynamic reduction of camera body acoustic shadowing in wind noise processing

A camera includes a first microphone, a second microphone, one or more drains, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The one or more drains drain water away from the first microphone, the second microphone, or both. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.

Drainage channels for use in a camera

An image capture device with beamforming for wind noise optimized microphone placements is described. The image capture device includes a front facing microphone configured to capture an audio signal. The front facing microphone co-located with at least one optical component. The image capture device further includes at least one non-front facing microphone configured to capture an audio signal. The image capture device further includes a processor configured to generate a forward facing beam using the audio signal captured by the front facing microphone and the audio signal captured by the at least one non-front facing microphone, generate an omni beam using the audio signal captured by the at least one non-front facing microphone, and output an audio signal based on the forward facing beam and the omni beam.

Growing community of inventors

San Francisco, CA, United States of America

Erich Tisch