Qualcomm Incorporated

Gesturetek, Inc.

Promp, Inc.

Francis B MacDougall

Evan Robert Hildreth

Atid Shamaie

Riten Jaiswal

Darrell L Krulce

Erik Visser

Lae-Hoon Kim

Khosro Rabii

Virginia Walker Keating

Andrew J Everitt

Jeremy Patrick Toman

Phuong Lam Ton

Shaun William Van Dyken

Fitzgerald John Archibald

A method for interactive collaboration between a streamer user and a remote collaborator. The method includes receiving, by a collaborator computing device, streaming images taken by a streamer computing device. A collaborator user interface is generated and provided for output by the collaborator device. The collaborator user interface includes the received images. Hand tracking data is received by the collaborator device. The collaborator user interface is updated to include a representation of the hand tracking data and the received images. The hand tracking data is transmitted by the collaborator device to the streamer device for inclusion on a streamer user interface that is generated and provided for output by the streamer device.

Collaborative system between a streamer and a remote collaborator

A method for use with a head-mounted display in a physical environment includes obtaining depth information of the physical environment and capturing a visual image of the physical environment. The method also includes determining a spatial relationship between a user of the head-mounted display and one or more physical objects included in the physical environment based on the depth information. The visual image is then segmented based on the spatial relationship to generate a segmented image that includes the one or more physical objects. The segmented image is then overlaid on a virtual image to display both the virtual image and the one or more physical objects on the head-mounted display.

Spatial relationships for integration of visual images of physical environment into virtual reality

Systems and methods are provided that allow a user to interact with a device using gaze detection. In the provided systems and methods, the gaze detection is initiated by detecting a triggering event. Once gaze detection has been initiated, detecting a gaze of a user may allow the user to activate a display component of the device, pass a security challenge on the device, and view content and alerts on the device. The gaze detection may continue looking for the user's gaze and keep the display component of the device activated as long as a gaze is detected, but may deactivate the display component of the device once a gaze is no longer detected. To conserve power the gaze detection may also be deactivated until another triggering event is detected.

Systems and methods for device interaction based on a detected gaze

A representation of a user can move with respect to a graphical user interface based on input of a user. The graphical user interface comprises a central region and interaction elements disposed outside of the central region. The interaction elements are not shown until the representation of the user is aligned with the central region. A gesture of the user is recognized, and, based on the recognized gesture, the display of the graphical user interface is altered and an application control is outputted.

Enhanced input using recognized gestures

Methods and apparatuses are presented for determining whether a gesture is being performed in a sequence of source images. In some embodiments, a method includes detecting a gesture in each of one or more reference images using one or more gesture models of a plurality of gesture models. The method may also include selecting a first gesture model from the one or more gesture models that most closely matches the detected gesture, prioritizing the first gesture model over other gesture models in the plurality of gesture models for searching for the gesture in the sequence of source images, and scanning the sequence of source images to determine whether the gesture is being performed, using the prioritized first gesture model. If the gesture is being performed, the method may end scanning prior to using another gesture model of the plurality of gesture models to determine whether the gesture is being performed.

Fast pose detector

Embodiments of the present invention provide an adaptive data path for computer-vision applications. Utilizing techniques provided herein, the data path can adapt to the needs of a computer-vision application to provide the needed data. The data path can be adapted by applying one or more filters to image data from one or more sensors. Some embodiments may utilize a computer-vision processing unit comprising a specialized instruction-based, in-line processor capable of interpreting commands from a computer-vision application.

Adaptive data path for computer-vision applications

One example device includes a camera; a display device; a memory; and a processor in communication with the memory to receive audio signals from two or more microphones or a far-end device; receive first location information and second location information, the first location information for a visual identification of an audio source of the received audio signals and the second location information identifying a direction of arrival from the audio source; receive a first adjustment to a first portion of a UI to change either a visual identification or a coordinate direction of a direction focus; in response to the first adjustment, automatically perform a second adjustment to a second portion of the UI to change the other of the visual identification or the coordinate direction of the direction focus; and process the audio signals to filter sounds outside the direction focus, or emphasize sounds within the direction focus.

Listen to people you recognize

Systems, methods, apparatuses, and computer-readable media are provided for use with a system configured to detect gestures. In one embodiment, a method includes detecting a first user gesture meeting a first condition to enter a mode of operation. The method may further include exiting the mode of operation. The method may further include detecting a second user gesture meeting a second condition to reenter the mode of operation based on the detecting the first user gesture, wherein the second condition is less stringent than the first condition.

Rapid gesture re-engagement

Systems, apparatus and methods for determining a gesture are presented. According to some aspects, disclosed are systems, apparatus and methods for determining a gesture that compares different images and deduces a direction and/or distance based on a relative size change of a palm in the different images. After a reference palm size is registered, subsequent palm sizes are compared to the reference to determine if and/or how much the hand is moving. The hand gesture is determined based on these relative changes in hand movement.

Z-axis determination in a 2D gesture system

Methods and systems according to one or more embodiments are provided for combining touch inputs and offset non-touch gestures. In an embodiment, a method includes concurrently capturing touch input data on a screen of a user device and non-touch gesture input data, the non-touch gesture input data being indicative of a gesture performed in an area offset from the screen of the user device to inhibit obstruction of a user's view of the screen. The method also includes determining an input command based at least in part on a combination of the concurrently captured touch input data and the non-touch gesture input data. In addition, the method further includes affecting an operation of the user device based on the determined input command.

Combined touch input and offset non-touch gesture

Systems, devices, and methods are described for recognizing and focusing on at least one source of an audio communication as part of a communication including a video image and an audio communication derived from two or more microphones when a relative position between the microphones is known. In certain embodiments, linked audio and video focus areas providing location information for one or more sound sources may each be associated with different user inputs, and an input to adjust a focus in either the audio or video domain may automatically adjust the focus in the another domain.

Motion of a device is sensed using image data, and a gesture corresponding to the sensed motion of the device is recognized. Functionality of the device corresponding to the recognized gesture is determined and invoked.

Gesture-based mobile interaction

Methods and systems according to one or more embodiments are provided for enhancing interactive inputs. In an embodiment, a method includes concurrently capturing touch input data on a screen of a user device and non-touch gesture input data off the screen of the user device. The method also includes determining an input command based at least in part on a combination of the concurrently captured touch input data and the non-touch gesture input data. And the method further includes affecting an operation of the user device based on the determined input command.

Growing community of inventors

Toronto, Canada

Francis B MacDougall