Ultrahaptics IP Two Limited

Leap Motion, Inc.

Reification Inc.

Other

Gabriel Archacki Hare

David S Holz

Raffi A Bedikian

Maxwell Andrew Sills

Matias Perez

Hua Yang

Kevin A Horowitz

Keith Mertens

Adrian Gasinski

Jonathan Marsden

Ryan Julian

Barrett Fox

Kyle A Hay

Dave Edelhart

Jody Medich

Daniel Plemmons

Wilbur Yung Sheng Yu

Neeloy Roy

Paul Durdik

Robert Samuel Gordon

Daniel Rothman

The technology disclosed relates to relates to providing command input to a machine under control. It further relates to gesturally interacting with the machine. The technology disclosed also relates to providing monitoring information about a process under control. The technology disclosed further relates to providing biometric information about an individual. The technology disclosed yet further relates to providing abstract features information (pose, grab strength, pinch strength, confidence, and so forth) about an individual.

Systems and methods of tracking moving hands and recognizing gestural interactions

Embodiments of display control based on dynamic user interactions generally include capturing a plurality of temporally sequential images of the user, or a body part or other control object manipulated by the user, and computationally analyzing the images to recognize a gesture performed by the user. In some embodiments, the gesture is identified as an engagement gesture, and compared with reference gestures from a library of reference gestures. In some embodiments, a degree of completion of the recognized engagement gesture is determined, and the display contents are modified in accordance therewith. In some embodiments, a dominant gesture is computationally determined from among a plurality of user gestures, and an action displayed on the device is based on the dominant gesture.

Dynamic, free-space user interactions for machine control

The technology disclosed relates to manipulating a virtual object. In particular, it relates to detecting a hand in a three-dimensional (3D) sensory space and generating a predictive model of the hand, and using the predictive model to track motion of the hand. The predictive model includes positions of calculation points of fingers, thumb and palm of the hand. The technology disclosed relates to dynamically selecting at least one manipulation point proximate to a virtual object based on the motion tracked by the predictive model and positions of one or more of the calculation points, and manipulating the virtual object by interaction between at least some of the calculation points of the predictive model and the dynamically selected manipulation point.

Interactions with virtual objects for machine control

The technology disclosed relates to providing simplified manipulation of virtual objects by detected hand motions. In particular, it relates to a detecting hand motion and positions of the calculation points relative to a virtual object to be manipulated, dynamically selecting at least one manipulation point proximate to the virtual object based on the detected hand motion and positions of one or more of the calculation points, and manipulating the virtual object by interaction between the detected hand motion and positions of one or more of the calculation points and the dynamically selected manipulation point.

Virtual interactions for machine control

The technology disclosed relates to user interfaces for controlling augmented reality environments. Real and virtual objects can be seamlessly integrated to form an augmented reality by tracking motion of one or more real objects within view of a wearable sensor system using a combination a RGB (red, green, and blue) and IR (infrared) pixels of one or more cameras. It also relates to enabling multi-user collaboration and interaction in an immersive virtual environment. In particular, it relates to capturing different sceneries of a shared real world space from the perspective of multiple users. The technology disclosed further relates to sharing content between wearable sensor systems. In particular, it relates to capturing images and video streams from the perspective of a first user of a wearable sensor system and sending an augmented version of the captured images and video stream to a second user of the wearable sensor system.

Multi-user content sharing in immersive virtual reality environments

A method and system are provided for controlling a machine using gestures. The method includes sensing a variation of position of a control object using an imaging system, determining, from the variation, one or more primitives describing a characteristic of a control object moving in space, comparing the one or more primitives to one or more gesture templates in a library of gesture templates, selecting, based on a result of the comparing, one or more gesture templates corresponding to the one or more primitives, and providing at least one gesture template of the selected one or more gesture templates as an indication of a command to issue to a machine under control responsive to the variation.

Method and system for controlling a machine according to a characteristic of a control object

User interface for integrated gestural interaction and multi-user collaboration in immersive virtual reality environments

Disclosed herein are systems and methods for correcting distortion in a camera lens. The methods can include receiving at least one image of a calibration object, in which the image is captured via the camera lens and the lens has lens distortion. The methods can further include fitting a plurality of geodesics in the image; determining at least one connection equation for the plurality of geodesics; and determining a metric based on the connection equation, the metric comprising a first distorted radial coordinate. The methods can further include determining an undistorted radial coordinate based on the first distorted radial coordinate; determining a second distorted radial coordinate as a function of the undistorted radial coordinate; inverting the undistorted radial coordinate; and generating an undistorted image based on the inverted undistorted radial coordinate.

Calibration of individual and arrayed cameras using images and video

The technology disclosed relates to determining positional information about an object of interest is provided. In particular, it includes, conducting scanning of a field of interest with an emission from a transmission area according to an ordered scan pattern. The emission can be received to form a signal based upon at least one salient property (e.g., intensity, amplitude, frequency, polarization, phase, or other detectable feature) of the emission varying with time at the object of interest. Synchronization information about the ordered scan pattern can be derived from a source, a second signal broadcast separately, social media share, others, or and/or combinations thereof). A correspondence between at least one characteristic of the signal and the synchronization information can be established. Positional information can be determined based at least in part upon the correspondence.

Determining positional information for an object in space

Embodiments of display control based on dynamic user interactions generally include capturing a plurality of temporally sequential images of the user, or a body part or other control object manipulated by the user, and computationally analyzing the images to recognize a gesture performed by the user. In some embodiments, a scale indicative of an actual gesture distance traversed in performance of the gesture is identified, and a movement or action is displayed on the device based, at least in part, on a ratio between the identified scale and the scale of the displayed movement. In some embodiments, a degree of completion of the recognized gesture is determined, and the display contents are modified in accordance therewith. In some embodiments, a dominant gesture is computationally determined from among a plurality of user gestures, and an action displayed on the device is based on the dominant gesture.

Some embodiments of location estimation methods may (1) facilitate the task of efficiently finding the location of a mobile platform in scenarios in which the uncertainties associated with the coordinates of the map features are anisotropic and/or non-proportional, and/or (2) facilitate decoupling of location estimation from feature estimation. Some embodiments of feature estimation methods may (1) facilitate the combining of environmental descriptions provided by two or more mobile platforms, and/or (2) facilitate decoupling of a data aggregation from feature re-estimation.

Growing community of inventors

Daly City, CA, United States of America

Gabriel Archacki Hare