Tactual Labs Co.

Microsoft Technology Licensing, LLC

Autodesk, Inc.

Meta Platforms Technologies, LLC

Facebook Technologies, LLC

Iota Wireless, LLC

Daniel John Wigdor

Clifton L Forlines

Steven Leonard Sanders

Darren L Leigh

Ricardo Jorge Jota Costa

Tovi Samuel Grossman

Hrvoje Benko

Bruno Rodrigues De Araujo

George William Fitzmaurice

Paul Armistead Hoover

Stephanie Santosa

Sean Edwin Trowbridge

Megan Lesley Tedesco

Karan Singh

Tanya Renee Jonker

Haijun Xia

Marcello Giordano

Jonathan Deber

Rorik Henrikson

Robert J Levy

Sarah Graham Williams

John Clavin

Michael Glueck

Aakar Gupta

Xing-Dong Yang

Carolina Brum Medeiros

Daniel Clarke

Benjamin McCanny

Michelle Annett

Sarat Chandra Subramaniam

Sundaram Ramani

Benjamin LaFreniere

Maxim Mazeev

Bryan Beatty

Carlos Pessoa

Joyce Wu

Xiang Anthony Chen

Vanessa Larco

Maxim Oustiogov

Michael D Cronin

Jarrod Lombardo

Dustin Freeman

Kay Hofmeester

Luis Eduardo Cabrera Cordon

Ian Middleton

Mark Parent

Sunggeun Ahn

George Fitzmaurice

Clifton Forlines

A finger device initiates actions on a computer system when placed in contact with a surface. The finger device includes instrumentation that captures images and gestures. When in contact with a surface, the finger device captures images of the surface and gestures made on the surface. The finger device also transmits the images and gesture data to the computer system. An application on the computer system matches the images received from the finger device to a representation of the surface, identifies an action associated with the surface representation and gesture, and executes the action. Instrumenting the finger instead of the surface, allows a user to configure virtually any surface to accept touch input.

Always-available input through finger instrumentation

In one embodiment of the present invention, a method for multiple device interaction includes detecting an orientation of a first device relative to a second device. The method also includes detecting a first gesture performed with either the first device or the second device, wherein the first gesture causes a first action that is based at least in part on the orientation of the first device relative to the second device.

Techniques for interacting with handheld devices

An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Multimodal kinematic template matching and regression modeling for ray pointing prediction in virtual reality

The disclosed computer-implemented method may include detecting, by a computing system, a gesture that appears to be intended to trigger a response by the computing system, identifying, by the computing system, a context in which the gesture was performed, and adjusting, based at least on the context in which the gesture was performed, a threshold for determining whether to trigger the response to the gesture in a manner that causes the computing system to perform an action that is based on the detected gesture.

Systems and methods for adaptive input thresholding

A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of column conductors is detected. A set of orthogonal column signals are simultaneously transmitted on a respective one of at least some of the column conductors. An amount of each of the orthogonal column signals present on each of the plurality of row conductors is detected. The detected amount of each of the plurality of orthogonal row signals and the detected amount of each of the plurality of orthogonal column signals is used to determine the location of a touch event on the device.

Fast multi-touch noise reduction

A method of saccade-based positioning of a radial user interface includes performing operations while a first radial user interface is displayed on a display. The operations include (a) detecting a saccade movement based on eye-tracking data received from an eye-tracking system; (b) determining whether the saccade movement crosses a first region border corresponding to a first region of the first radial user interface; (c) determining a velocity of the saccade movement based on the eye-tracking data; and (d) dynamically determining a location for a subsequent radial user interface in response to the velocity and in response to determining that the saccade movement crosses the first region border. The method also includes displaying, on the display, the subsequent radial user interface at the location.

Saccade-based positioning for radial user interface

An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, using a regression model, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest, using a pointer facilitation technique. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Disclosed are touch sensitive devices and methods of responding to hits in touch sensitive devices that include a graphical user interface having interface elements, each associated with a program element. A hit test map updater is used to process graphical user interface information into a hit test map in connection with the rendering of the graphical user interface, such that the hit test map associates properties with interface elements appearing on the graphical user interface. An input processor is used to receive a location corresponding to an input in connection with an input event, search the hit test map in which values are associated with interface elements appearing in the graphical user interface, and identify a property of the interface element from the values. In an embodiment, the identified property is proved to a central processing system and a user interface event is generated. In an embodiment, the properties received from the hit test map updater and the input processor are used to determine a program element associated with the property, and the program element is signaled. In an embodiment, the identified property is processed to determine a change to the graphical user interface, and the change is displayed.

System and method for performing hit testing in a graphical user interface

A low-latency touch sensor is disclosed for use in connection with a touch surface having first and second conductors sensitive to changes in coupling therebetween as a result of touch (and/or near-touch). A signal generator generates unique orthogonal signals, a transmitter transmits the orthogonal signals on each of the first conductors. Receivers connected to the second conductors receive signals during a measurement period. The signals measured during the measurement period are processed to determine, for each measurement period, and for each of the second conductors, a signal strength corresponding to each of the unique orthogonal signals. The signal strengths can be used as a basis to determine touch events.

Fast multi-touch sensor with user-identification techniques

On a display configured to provide a photorepresentative view from a user's vantage point of a physical environment in which the user is located, a method is provided comprising receiving, from the user, an input selecting a theme for use in augmenting the photorepresentative view. The method further includes obtaining, optically and in real time, environment information of the physical environment and generating a spatial model of the physical environment based on the environment information. The method further includes identifying, via analysis of the spatial model, one or more features within the spatial model that each corresponds to one or more physical features in the physical environment. The method further includes based on such analysis, displaying, on the display, an augmentation of an identified feature, the augmentation being associated with the theme.

Theme-based augmentation of photorepresentative view

An electronic device with a display selects a subset of templates from a library of templates. Each of the templates comprises logged movements of one or more predefined input device types in a 3D space and each template includes one or more movement parameters. The electronic device tracks, for a user, movement parameters of at least one input device of the user. The at least one input device corresponds to one of the predefined input device types. The electronic device compares the tracked movement parameters of the at least one input device of the user to the movement parameters for the subset of the templates selected from the library of templates. The electronic device predicts, based on the comparison, a goal target ray, within the 3D space. In some embodiments, the goal target ray is highlighted or visually emphasized according to the prediction.

Head-coupled kinematic template matching for predicting 3D ray cursors

Methods are disclosed for dynamic assignment of possible channels in a touch sensitive device having rows and columns. In an embodiment, a method determines a first signal space in which to generate signals for use in the touch sensor. Signals are then generated in the first signal space on separate ones of the rows and a column signal is sensed on a column. The first signal space is replaced with a second signal space, and a second plurality of signals is generated for use in the touch sensor in the second frequency space. The second plurality of signals is sensed to identify a touch event in the touch sensitive device.

Dynamic assignment of possible channels in a touch sensor

A system and method for distinguishing between sources of simultaneous touch events on a touch sensitive device are disclosed. The touch sensitive device includes row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Orthogonal row signals are generated on the row conductors and orthogonal column signals are generated on the column conductors. In an embodiment, an amount of each of the plurality of orthogonal row signals present on each of the plurality of row conductors is detected, an amount of each of the plurality of orthogonal column signals present on each of the plurality of column conductors is detected, and at least one of such amounts is used to associate each of the plurality of simultaneous touch events with a discrete source. The strength of such detected 'crosstalk' between row conductors can be used to distinguish two or more touch events, such as by distinguishing a two-handed gesture from a one-handed gesture, distinguishing two touch events as having been initiated by different users, distinguishing a passive object from a hand, identifying a passive object, improving palm rejection and improving accidental-touch rejection.

Orthogonal signaling touch user, hand and object discrimination systems and methods

In an embodiment, a touch sensitive device includes a touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events, selectively identifies one or more of the touch events in the stream and assembles information concerning one or more touch events in the stream, and outputs both the selectively identified touch events and the assembled information for use by the touch sensitive device.

Decimation supplementation strategies for input event processing

A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user input to create data reflecting a prediction of a future user input event. In an embodiment, prior to occurrence of the predicted user input event, a predicted location and a predicted time at which the predicted future user input event will occur are provided to a touch response system.

Systems and methods for using hover information to predict touch locations and reduce or eliminate touchdown latency

Growing community of inventors

Toronto, Canada

Daniel John Wigdor