Sound-based event control using timbral analysis

Abstract

Arbitrary input sounds are analyzed and the coefficients of a low-dimensional representation, such as LPC or MFCC, are determined as a measure of the timbre of the sounds. The coefficients can be employed in different ways to control output events, such as the generation of synthesized sounds. In one approach, the individual coefficients are mapped to the control parameters of a sound synthesizer, to enable highly complex output sounds to be generated in response to simple input sounds. In another approach, pattern recognition techniques are employed with respect to the coefficients, to classify the input sounds. Each classification is mapped to a control parameter, to cause different events to occur in response to the respective input sounds. In one example, the sounds of different musical instruments are generated in dependence upon the classification of the input sounds. These analysis techniques have low latency, and thereby allow events to be controlled without perceptible delay.