Google Inc.

Humane, Inc.

Nathan Lord

Imran A Chaudhri

Ralph T Brunner

Nelson George Publicover

Patrick G Gates

Lewis James Marggraff

Bethany Bongiorno

Ivan Maleev

Peter Milford

Spencer James Connaughton

Monique Relova

Lilynaz Hashemi

Yanir Nulman

Britt Nelson

Wangju Tsai

Peter N Milford

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for gesture recognition for a wearable multimedia device using real-time data streams. In an embodiment, a method comprises: detecting a trigger event from one or more real-time data streams running on a wearable multimedia device; taking one or more data snapshots of the one or more real-time data streams; inferring user intent from the one or more data snapshots; and selecting a service or preparing content for the user based on the inferred user intent. In an embodiment, a hand and finger pointing direction is determined from a depth image, a 2D bounding box for the hand/finger is projected into a 2D image space and compared to bounding boxes for identified/labeled objects in the 2D image space to identify an object that the hand is holding or the finger is pointing toward.

Gesture recognition for wearable multimedia device using real-time data streams

Systems and methods are provided for discerning the intent of a device wearer primarily based on movements of the eyes. The system may be included within unobtrusive headwear that performs eye tracking and controls screen display. The system may also utilize remote eye tracking camera(s), remote displays and/or other ancillary inputs. Screen layout is optimized to facilitate the formation and reliable detection of rapid eye signals. The detection of eye signals is based on tracking physiological movements of the eye that are under voluntary control by the device wearer. The detection of eye signals results in actions that are compatible with wearable computing and a wide range of display devices.

Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects

Growing community of inventors

San Jose, CA, United States of America

Nathan Lord