Gopro, Inc.

Eric Penrod

Erich Tisch

Timothy Dick

Mark Hardin

Kielan C Crow

Himay Rashmikant Shukla

Joyce Gorny

Hakim Mesiwala

Nicholas R Vitale

William Edward MacDonald

Adrian Santos

Devices and methods for determining a direction of audio arrival from Ambisonics channels using azimuth and elevation segments is described herein. A method includes generating multiple blocks of samples from Ambisonics signals for a time interval, determining an azimuth angle estimate and an elevation angle estimate for the time interval when a defined number of blocks in the multiple blocks of samples are valid, generating the azimuth angle estimate based on maximum number of azimuth angle estimates present in an azimuth segment amongst a defined number of azimuth segments, and generating the elevation angle estimates based on maximum number of elevation angle estimates present in an elevation segment amongst a defined number of elevation segments, where the direction of arrival of the Ambisonics signals is based on the azimuth angle estimate and the elevation angle estimate.

Direction of audio arrival from Ambisonics channels using azimuth and elevation segments

An image capture device may capture multiple audio content during capture of visual content. A viewing window for the visual content and rotational position of the image capture device during capture of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of a punchout of the visual content using the viewing window.

Systems and methods for matching audio to video punchout

An image capture device reduces noise floor using multiple microphones. The image capture device includes a processor that obtains a front microphone signal from a front microphone, the front microphone signal having a noisy noise floor portion, obtains a rear microphone signal from a rear microphone, sets a splice point based on mitigation of the noisy noise floor portion relative to a speech frequency range, and combines a substantially clean noise floor portion of the rear microphone signal at or below the splice point with a remaining portion of the front microphone signal above the splice point to generate a microphone signal.

Multi-microphone noise floor mitigation

Wind processing performance is improved by the placement of one or more microphones on a device. The device includes one or more microphones on the front surface, one or more microphones on the top surface, and one or more microphones on the rear surface. The rear surface is a heatsink, and the one or more microphones on the rear surface are located in recesses created by two or more fins of the heatsink. The device includes a processor that performs wind processing based on signals from the one or more microphones on the front surface, signals from the one or more microphones on the top surface, signals from the one or more microphones on the rear surface, or any combination thereof.

Microphone placement for wind processing

An image capture device may capture multiple audio content during capture of visual content. The field of view of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of the visual content with the field of view.

Systems and methods for dynamically modifying audio content using variable field of view

An integrated circuit includes a processor that upsamples a vibration signal. The processor determines a correlation value. The correlation value may be based on a microphone signal, the upsampled vibration signal, or both. The processor filters the vibration signal to remove a noise portion and obtain a processed microphone signal. The processor outputs the processed microphone signal.

Method and apparatus for active reduction of mechanically coupled vibration in microphone signals

A handheld image stabilization device or an image capture device includes a housing, a motor, a microphone, and a dampener. The housing includes a first port. The motor is attached to the housing. The microphone detects audio waves via the first port and vibration noise of the motor via the housing. The audio waves may include acoustic noise from the motor. The dampener is coupled to the housing. The dampener reduces the acoustic noise from the motor and the vibration noise from the motor.

Audio enhancements in motor-driven devices

An image capture device, having: a housing, a lens snout, a front microphone, a top microphone, and an audio processor. The housing has a top and front housing surface. The lens snout protrudes from the front housing surface. The front microphone mounted within or on the front housing surface and below the lens snout. The top microphone mounted within or on a top housing surface in a position biased toward the front housing surface. The audio processor comprises a memory that is configured to store instructions that when executed cause the audio processor to generate an output audio signal. The top microphone is located at a position to receive direct freestream air flow when the housing is positioned in a pitched forward orientation at a pitched forward angle relative to a vertical axis. The front microphone receives turbulent air flow from the lens snout when the housing is positioned in the pitched forward orientation.

Wind noise reduction by microphone placement

A device includes an audio assembly and a housing defining an aperture that interfaces with the audio assembly at an interior surface of the housing. The device includes stanchions coupled to an exterior surface of the housing at a location of the aperture and a cover coupled to the stanchions and free of contact with the housing. The device includes a drainage channel extending between the cover, the exterior surface of the housing, and the stanchions. The drainage channel includes a first portion defining an inlet of the drainage channel, and the first portion has a first width defined by the stanchions. The drainage channel includes a second portion defining an outlet of the drainage channel, and the second portion has a second width defined by the stanchions. The stanchions are tapered in shape so that the first width is wider than the second width.

Audio component drainage system for image capture device

An image capture device may include a sensor, a microphone array, and a processor. The microphone array may include a first microphone, a second microphone, a third microphone, or any combination thereof. The first microphone may be configured to face a first direction. The second microphone may be configured to face a second direction. The second direction may be diametrically opposed to the first direction. The third microphone may be configured to face a third direction. The third direction may be substantially perpendicular to the first direction, the second direction, or both. The processor may be configured to determine a microphone capture pattern. The microphone capture pattern may be determined based on data obtained from the sensor. The sensor data may include image data, audio data, image capture device orientation data, location data, accelerometer data, or any combination thereof.

Microphone pattern based on selected image of dual lens image capture device

An integrated circuit includes a processor that upsamples a vibration signal. The processor determines a correlation value. The correlation value may be based on a microphone signal, the upsampled vibration signal, or both. The processor determines filter coefficients. The filter coefficients may be determined based on the correlation value being above a threshold. The filter coefficient may be based on the upsampled vibration signal. The processor filters the vibration signal based on the filter coefficients to remove a noise portion and obtain a processed microphone signal. The processor outputs the processed microphone signal.

An image capture device and a handheld image stabilization device may each include a housing, a motor assembly, a microphone, a dampener, or any combination thereof. The housing may include a first port. The motor assembly may be attached to the housing. The motor assembly may include a plurality of motors. The microphone may be configured to detect audio waves via the first port, vibration noise of the plurality of motors via the housing, or both. The audio waves may include acoustic noise from the plurality of motors. The dampener may be coupled to the housing. The dampener may be configured to reduce the acoustic noise from the plurality of motors, the vibration noise from the plurality of motors, or both.

An image capture device includes a sensor, a microphone array, and a processor. The microphone array may include a first microphone, a second microphone, a third microphone, or any combination thereof. The first microphone may be configured to face a first direction. The second microphone may be configured to face a second direction. The second direction may be diametrically opposed to the first direction. The third microphone may be configured to face a third direction. The third direction may be substantially perpendicular to the first direction, the second direction, or both. The processor may be configured to determine a microphone capture pattern and detect wind noise. The microphone capture pattern may be determined based on data obtained from the sensor. The sensor data may include image data, audio data, image capture device orientation data, location data, accelerometer data, or any combination thereof.

Growing community of inventors

Brentwood, CA, United States of America

Eric Penrod