Microsoft Technology Licensing, LLC

Adam Jethro Langridge

Stephen G Latta

Kevin Geisner

Johnny Hsienchow Lee

Relja Markovic

Gregory Nelson Snook

Peter Douglas Molyneux

Christopher Matthews

Guy Simmons

David Addis

Gary Carr

Systems, methods and computer readable media are disclosed for controlling perspective of a camera-controlled computer. A capture device captures user gestures and sends corresponding data to a recognizer engine. The recognizer engine analyzes the data with a plurality of filters, each filter corresponding to a gesture. Based on the output of those filters, a perspective control is determined, and a display device displays a new perspective corresponding to the perspective control.

Method to control perspective for a camera-controlled computer

A computing system is configured to receive one or more depth images, from the depth camera, of a world space scene including a human target. The computing system translates a world space position of a hand of the human target to a screen space cursor position of the user interface using a virtual desktop transformation. The computing system also dynamically adjusts the virtual desktop transformation based on a history of button press actions executed by the human target.

Push personalization of interface controls

A computing system includes a depth image analysis module to track a world-space pose of a human in a fixed, world-space coordinate system. The computing system further includes an interaction module to establish a virtual interaction zone with an interface-space coordinate system that tracks the human. The computing system also includes a transformation module to transform a position defined in the fixed, world-space coordinate system to a position defined in the interface-space coordinate system.

Virtual desktop coordinate transformation

Gestures of a computer user are observed with a depth camera. A trace gesture of the computer user is identified and an action performable within an interactive interface is selected based on the shape of the trace gesture.

Shape trace gesturing

Targeting control may be facilitated in a simulated environment. In an example embodiment, a method includes acts of monitoring, generating, moving, and firing. A button input and a directional input are monitored. If a press and hold of the button input is detected, a fine aiming mode is generated. If movement of the directional input is detected during the fine aiming mode, a location of a target indicator is moved responsive to the detected movement. When a release of the button input is detected, a ranged weapon is fired based on the location of the target indicator.

Targeting control in a simulated environment

Gestures of a computer user are observed with a depth camera. A throwing gesture of the computer user is identified and an aiming vector is calculated from a path of a left and/or right hand during the throwing gesture. An interface action is directed along the aiming vector within an interactive interface.

Action trigger gesturing

Gestures of a computer user are observed with a depth camera. A first gesture of the computer user is identified as one of a plurality of different action selection gestures, each action selection gesture associated with a different action performable within an interactive interface controlled by gestures of the computer user. A second gesture is identified as a triggering gesture that causes performance of the action associated with the action selection gesture.

Action selection gesturing

A computing system translates a world space position of a hand of a human target to a screen space cursor position of a user interface. When the cursor overlaps a button in the user interface, the computing system actuates the button in response to a movement of the hand in world space that changes the cursor position by a depth threshold along a z-axis regardless of an initial z-axis position of the cursor. When the button includes an activation lock, the computing system unlocks the activation lock, prior to button actuation, if the cursor path satisfies unlocking criteria.

Push actuation of interface controls

A computing system includes a depth image analysis module to track a world-space pose of a human in a fixed, world-space coordinate system. The computing system further includes an interaction module to establish a virtual interaction zone with a moveable, interface-space coordinate system that tracks the human and moves relative to the fixed, world-space coordinate system. The computing system also includes a transformation module to transform a position defined in the fixed, world-space coordinate system to a position defined in the moveable, interface-space coordinate system.

A game environment is disclosed where actions are automatically selected based on a situational awareness for a player in the game environments. The situational awareness can be determined based on conditions of the player, objects and other characters in the game environment.

Combat action selection using situational awareness

An approach is described for instructing a player character to automatically take cover in a region of a simulated environment without receiving express commands from a user. The approach determines whether the player character should take cover based on one or more factors. Such factors may include: the presence of an enemy-type character in the region; the presence of a nearby object in the region that can be used to seek cover; and a determination whether the player character's behavior is consistent with a decision to seek cover.

Growing community of inventors

Guildford, United Kingdom

Adam Jethro Langridge