Chromatic Inc.

Fortell Research Inc.

Jonathan Macoskey

Igor Lovchinsky

Nicholas Morris

Andrew J Casper

Matthew De Jonge

Philip Meyers, Iv

Israel Malkin

An ear-worn device may include two or more microphones configured to generate time-domain audio signals, each of the two or more microphones configured to generate one of the time-domain audio signals; processing circuitry comprising analog processing circuitry, digital processing circuitry, beamforming circuitry, and short-time Fourier transformation (STFT) circuitry, the processing circuitry configured to generate, from the time-domain audio signals, one or more frequency-domain non-beamformed audio signals and one or more frequency-domain beamformed signals; and enhancement circuitry comprising neural network circuitry configured to receive multiple frequency-domain input audio signals originating from the one or more frequency-domain non-beamformed audio signals and the one or more frequency-domain beamformed signals, and implement a single neural network trained to generate, based on the multiple frequency-domain input audio signals, a noise-reduced and spatially-focused output audio signal or an output for generating a noise-reduced and spatially-focused output audio signal.

Ear-worn device with neural network for noise reduction and/or spatial focusing using multiple input audio signals

A hearing aid may include a neural network chip having tiles arranged in an array, each tile including memory, 16-128 multiplier-accumulator circuits (MACs), and routing circuitry. The memory of each tile may be configured to store a portion of elements of a matrix A comprising weights of a recurrent neural network. Each tile may be configured to receive and store elements of an activation vector X, and all tiles in a column of the array may be configured to receive the same elements of X. The plurality of tiles may be configured to perform a matrix-vector multiplication A*X by performing multiply-and-accumulate sub-operations in parallel among the plurality of tiles. The routing circuitry from the tiles in each respective row of tiles may be configured to combine results of the multiply-and-accumulate sub-operations.

Neural network chip for ear-worn device

An ear-worn device is provided that operates to isolate and individually treat the received speech of a target speaker or multiple target speakers from an audio input signal detected in a multi-speaker environment. The ear-worn device uses a machine learning model that receives a voice signature of each of one or more target speakers as input signals, to identify and isolate the component of the audio input signal attributable to the target speaker(s). Once isolated, the target speaker's speech may be enhanced, de-emphasized, or otherwise processed in a manner desired by the wearer of the ear-worn device. The wearer may use an external electronic device, e.g., a phone, to select one or more target speakers in a conversation and/or configure various settings associated with processing the speech on the ear-worn device.

System and method for enhancing speech of target speaker from audio signal in an ear-worn device using voice signatures

An apparatus (e.g., an ear-worn device such as a hearing aid) includes neural network circuitry and control circuitry. The neural network circuitry is configured to implement a neural network system comprising at least a first neural network and a second neural network operating in parallel. The control circuitry is configured to control the neural network system to receive a first input signal, process the first input signal using the first neural network to produce a first output and using the second neural network to produce a second output, combine the first output and the second output, reset one or more states of the first neural network, and reset one or more states of the second neural network at a different time than when the one or more states of the first neural network are reset.

Hearing aids with parallel neural networks

The disclosure generally relates to a method, system and apparatus to improve a user's understanding of speech in real-time conversations by processing the audio through a neural network contained in a hearing device. The hearing device may be a headphone or hearing aid. In one embodiment, the disclosure relates to an apparatus to enhance incoming audio signal. The apparatus includes a controller to receive an incoming signal and provide a controller output signal; a neural network engine (NNE) circuitry in communication with the controller, the NNE circuitry activatable by the controller, the NNE circuitry configured to generate an NNE output signal from the controller output signal; and a digital signal processing (DSP) circuitry to receive one or more of controller output signal or the NNE circuitry output signal to thereby generate a processed signal; wherein the controller determines a processing path of the controller output signal through one of the DSP or the NNE circuitries as a function of one or more of predefined parameters, incoming signal characteristics and NNE circuitry feedback.

Method, apparatus and system for neural network hearing aid

Method, apparatus and system for neural network enabled hearing aid

According to some embodiments, an ear-worn device, e.g., a hearing aid, is provided that operates to enhance audio signals detected by the ear-worn device. In some embodiments, the ear-worn device includes a microphone, a processing circuit coupled to the microphone, and an output signal generator coupled to the processing circuit. In some embodiments, a method for enhancing audio signals includes: detecting an audio signal with the microphone; as the audio signal is being detected, dividing the audio signal into a plurality of segments; enhancing the detected audio signal with the processing circuit of the hearing aid; and outputting the enhanced audio signal with the output signal generator. In some embodiments, enhancing the detected audio signal includes processing one or more of the segments of the detected audio signal with a neural network engine (NNE) of the processing circuit to obtain an output for enhancing the detected audio signal.

Growing community of inventors

Pittsburgh, PA, United States of America

Jonathan Macoskey