Other

Nri R&d Patent Licensing, LLC

Vadim Zaliva

Lester Frank Ludwig

Systems and methods for implementing a touch user interface using at least one at least one edge detection algorithm to produce edge data that is in turn provided to at least one curve-fitting algorithm to produce curve parameter data. The curve parameter data in turn provided to at least one calculation algorithm to produce interpreted data, wherein the interpreted data comprises user interface information responsive to the human touch made by the user to the touch surface. In various implementations the touch sensor can include a capacitive matrix, pressure sensor array, LED array, arrays of on-off contact sensors, or a video camera. The resulting arrangement can be configured to detect touch gestures comprising changes in finger pitch angles and roll angles.

Curve-fitting approach to touch gesture finger pitch parameter extraction

This invention relates to signal space architectures for generalized gesture capture. Embodiments of the invention includes a gesture-primitive approach involving families of 'gesteme' from which gestures can be constructed, recognized, and modulated via prosody operations. Gestemes can be associated with signals in a signal space. Prosody operations can include temporal execution modulation, shape modulation, and modulations of other aspects of gestures and gestemes. The approaches can be used for advanced touch user interfaces such as High-Dimensional Touch Pad (HDTP) in touchpad and touchscreen forms, video camera hand-gesture user interfaces, eye-tracking user interfaces, etc.

Gesteme (gesture primitive) recognition for advanced touch user interfaces

Sensor arrangements and signal processing for touch-based user interfaces comprising multiple sensor types and other arrangements so as to create user interface output signals responsive to touch. Various types of sensors and other measurement arrangements can include capacitive tactile sensor arrays, optical tactile sensor arrays, proximity sensor arrays, pressure sensor arrays, and video cameras. In one approach, spatial information processing acts on initial image processing data acting separately on the data or measurements provided by each sensor. At least one software algorithm comprises at least one of a functional partition (wherein some user interface output signals are derived only from a pre-specified sensor), decision-based selection (wherein some user interface output signals are selectively derived from a selected sensor), or spatial information processing (wherein user interface output signals are obtained from threshold testing, conditional testing, vector quantization, algorithms employing parameterized calculations, algorithms employing compensation calculations and operations, artificial neural networks, etc.).

Heterogeneous tactile sensing via multiple sensor types using spatial information processing acting on initial image processed data from each sensor

This invention relates to sensor arrangements and signal processing architectures for touch-based user interfaces comprising multiple sensor types and other arrangements so as to create user interface output signals responsive to the touch of at least one human finger. Sensor types and other arrangements can include capacitive tactile sensor arrays, optical tactile sensor arrays, proximity sensor arrays, pressure sensor arrays, and video cameras. At least one software algorithm comprises at least one of a functional partition (wherein some user interface output signals are derived only from a pre-specified sensor), decision-based selection (wherein some user interface output signals are selectively derived from a selected sensor), or spatial information processing (wherein user interface output signals are obtained from threshold testing, conditional testing, vector quantization, algorithms employing parameterized calculations, algorithms employing compensation calculations and operations, artificial neural networks, etc.).

Heterogeneous tactile sensing via multiple sensor types using spatial information processing

This invention relates to sensor arrangements and signal processing architectures for touch-based user interfaces comprising multiple sensor types and other arrangements so as to create user interface output signals responsive to the touch of at least one human finger. Sensor types and other arrangements can include capacitive tactile sensor arrays, optical tactile sensor arrays, proximity sensor arrays, pressure sensor arrays, and video cameras. At least one software algorithm comprises at least one of a functional partition (wherein some user interface output signals are derived only from a pre-specified sensor), decision-based selection (wherein some user interface output signals are selectively derived from a selected sensor), or sensor-fusing (wherein user interface output signals are obtained from threshold testing, conditional testing, vector quantization, algorithms employing parameterized calculations, algorithms employing compensation calculations and operations, artificial neural networks, etc.)

Heterogeneous tactile sensing via multiple sensor types

A method is provided for a user interface recognizing the interruption of the execution of a first gesture with the execution of a second gesture. Measured information responsive to user interaction actions made by a user is received from a user interface sensor. At least one operation is applied to the measured information to produce a sequence of symbols or gestemes. The sequence of symbols is first used to determine that the user's execution of a first gesture has been interrupted. The sequence of symbols is used to determine that the user's execution of a second gesture has been started and completed resuming the first gesture. The sequence of symbols is used to determine that the user's execution a first gesture has been completed. Both the first and second gestures are recognized. Semantic content can be assigned to the existence of and various details regarding the interruption and gestures involved.

Human user interfaces utilizing interruption of the execution of a first recognized gesture with the execution of a recognized second gesture

A method for classification recognition of gestures and gesture primitives in a touch-based user interface. In an implementation the method comprises receiving tactile image data responsive to data generated from user touch of a user touch interface comprising a sensor array. The tactile image data is processed to create a plurality of numerical values responsive to data generated from the user touch interface. These numerical values are applied to a principle component analysis operation to produce a reduced-dimensionality data vector which is applied to a classifier having a plurality of classifier outputs interpretable as probabilities. The classifier outputs provide likelihoods that an execution gesture is from a collection of pre-defined gestures, and a decision test is used to produce a decision output indicating a gesture outcome useful in user interface applications. The arrangement can recognize single finger '6D' actions of roll, pitch, yaw, left-right, forward-back, and variations in applied pressure.

Sequential classification recognition of gesture primitives and window-based parameter smoothing for high dimensional touchpad (HDTP) user interfaces

A system (and method) for selecting an entry from a list of entries on an electronic device is disclosed. The system is configured to display a plurality of banks to a user and to receive a bank selection event from the user for selecting a bank containing a set of characters. The user creates a bank selection event through an input device such as a navigation device or touch screen. The set of characters is appended to a prefix that is used to determine a current result list containing entries that match the prefix. The list of entries is reduced to the current result list and displayed to the user with the portions of the entries matching the prefix highlighted. After the list of entries is reduced to a desired size, the user enters a scrolling mode where the user scrolls through the list of entries and selects an entry.

Growing community of inventors

Saratoga, CA, United States of America

Vadim Zaliva