Heterogeneous tactile sensing via multiple sensor types using spatial information processing acting on initial image processed data from each sensor

Abstract

Sensor arrangements and signal processing for touch-based user interfaces comprising multiple sensor types and other arrangements so as to create user interface output signals responsive to touch. Various types of sensors and other measurement arrangements can include capacitive tactile sensor arrays, optical tactile sensor arrays, proximity sensor arrays, pressure sensor arrays, and video cameras. In one approach, spatial information processing acts on initial image processing data acting separately on the data or measurements provided by each sensor. At least one software algorithm comprises at least one of a functional partition (wherein some user interface output signals are derived only from a pre-specified sensor), decision-based selection (wherein some user interface output signals are selectively derived from a selected sensor), or spatial information processing (wherein user interface output signals are obtained from threshold testing, conditional testing, vector quantization, algorithms employing parameterized calculations, algorithms employing compensation calculations and operations, artificial neural networks, etc.).