Microsoft Technology Licensing, LLC

Microsoft Corporation

Mark D Schwesinger

Oscar E Murillo

Emily Yang

Christian Klein

Joseph Lloyd McClanahan

Jay P Kapur

Sergio Paolantonio

Cory J Cirrincione

Richard S Bailey

David Bastien

John E Elsbree

Evan J Lerer

Spencer I A N Hurd

David R Fulmer

Jessica Ellen Zahn

Todd San Jule

Stephane Joseph Comeau

Mark G Young

Jeffrey C Fong

Joseph Wheeler

Xiaoji Chen

Adam M Smith

Joseph Alton Schrader

Rita Yu

Eric Sanderson

Robert Mitchell Smith

Jordan Dale Andersen

Tim Franklin

Calvin Kent Carter

Josh Gustafson

Shipeng Li

Fei Wang

Xian-Sheng Hua

Julia Schwarz

Tommer Leyvand

Niels Van Dongen

Szymon Piotr Stachniak

Ashish Gupta

Charles Claudius Marais

Michal Hlavac

Thaddeus C Pritchett

Sean E Kollenkark

Suzan Marashi

Waiman Lam

Michael C Miller

Guillaume Simonnet

Federico Schliemann

David A Braun

Scott D Sanders

Aaron DeYonker

Zhike Kong

Shawn E Pickett

Oscar Pawel Kozlowski

Zach Johnson

Glenn Alexander Curtis

William H Linzbach

Mark H Masterson

Kevin J Endres

Peter D Rosser

Luke Wabaunsee McCullough

Alan E Shield

Chad Wesley Wahlin

Jeffrey Christopher Abraham

Christopher F Pezzee

Emily M Yang

Mark A DeFalco

Xavier John Vetticappallil

Eduardo Escardo Raffo

Tianjun Shi

Matthew H Ahn

Mauro Giusti

Joshua Gustafson

Eric J Silverberg

Spencer Ian Hurd

John Elsbree

Elyssa M Cox

Embodiments related to dynamically adjusting a user interface based upon depth information are disclosed. For example, one disclosed embodiment provides a method including receiving depth information of a physical space from a depth camera, locating a user within the physical space from the depth information, determining a distance between the user and a display device from the depth information, and adjusting one or more features of a user interface displayed on the display device based on the distance.

Dynamic adjustment of user interface

A computing device initiates a linked capture session to enable automatic image sharing by multiple users and devices. The linked capture session is a group of devices that automatically share captured images during the linked capture session. The linked capture session may be initiated based on a location, a group of people, and/or a time duration. The images captured by devices that are connected in the linked capture session are automatically communicated to a remote storage system that allows all users to access the images through devices connected to the linked capture session.

Linked capture session for automatic image sharing

Aspects of the subject disclosure are directed towards providing feedback to users of multi-user system that has biometric recognition capabilities, so that a user knows whether the system has correctly associated the user with his or her identity. The feedback may include a display of a current camera view, along with visible identity information that is associated with each user in the view. The feedback may include per-user icons (e.g., tiles, thumbnail images and so on) by which a user visually confirms that he or she is correctly recognized. Any misrecognition may be detected via the feedback and corrected. Feedback may convey other information, such as the current interaction state/capabilities of a user.

Correlated display of biometric identity, feedback and user interaction state

A first video preview corresponding to a first video program is played back. When it is time to transition from playing back the first video preview to playing back a second video preview corresponding to a second video program, the transition is made from playing back the first video preview to playing back the second video preview. The transition can be made by sliding the first video preview off a display while sliding the second video preview onto the display. Additionally, metadata associated with the first video program can be displayed for an amount of time before playback of the first video preview ceases, and metadata associated with the second video program can be displayed for an amount of time after playback of the second video preview begins.

Video preview based browsing user interface

A method to decode natural user input from a human subject. The method includes detection of a gesture and concurrent grip state of the subject. If the grip state is closed during the gesture, then a user-interface (UI) canvas of the computer system is transformed based on the gesture. If the grip state is open during the gesture, then a UI object arranged on the UI canvas is activated based on the gesture.

Gesture library for natural user input

User input in the form of image data is received from a user via a natural user interface. A vector difference between an adjustment start position and a current position of the user input is calculated. The vector difference includes a vector position and a vector length. The vector position is compared to stored rail data, and the vector length is compared to a stored threshold length. The rail data describes a plurality of virtual rails associated with an application. Based on the comparisons, the user input is matched to one of the plurality of virtual rails and a notification describing the matching is provided to the application. The application, thereupon, transitions from a first command to a second command corresponding to the matching virtual rail without receiving any explicit termination gesture for the first command from the user.

Switching input rails without a release command in a natural user interface

A method to identify a targeted object based on eye tracking and gesture recognition. The method is enacted in a compute system controlled by a user and operatively coupled to a machine vision system. In this method, the compute system receives, from the machine vision system, video imaging a head and pointer of the user. Based on the video, the compute system computes a geometric line of sight of the user, which is partly occluded by the pointer. Then, with reference to position data for one or more objects, the compute system identifies the targeted object, situated along the geometric line of sight.

Pointer projection for natural user input

An NUI system to provide user input to a computer system. The NUI system includes a logic machine and an instruction-storage machine. The instruction-storage machine holds instructions that, when executed by the logic machine, cause the logic machine to detect an engagement gesture from a human subject or to compute an engagement metric reflecting the degree of the subject's engagement. The instructions also cause the logic machine to direct gesture-based user input from the subject to the computer system as soon as the engagement gesture is detected or the engagement metric exceeds a threshold.

Detecting natural user-input engagement

Embodiments are disclosed that relate to providing feedback for a level of completion of a user gesture via a cursor displayed on a user interface. One disclosed embodiment provides a method comprising displaying a cursor having a visual property and moving a screen-space position of the cursor responsive to the user gesture. The method further comprises changing the visual property of the cursor in proportion to a level of completion of the user gesture. In this way, the level of completion of the user gesture may be presented to the user in a location to which the attention of the user is directed during performance of the gesture.

Visual feedback for level of gesture completion

Users move their hands in a three dimensional ('3D') physical interaction zone ('PHIZ') to control a cursor in a user interface (&#x201c;UI&#x201d;) shown on a computer-coupled 2D display such as a television or monitor. The PHIZ is shaped, sized, and positioned relative to the user to ergonomically match the user's natural range of motions so that cursor control is intuitive and comfortable over the entire region on the UI that supports cursor interaction. A motion capture system tracks the user's hand so that the user's 3D motions within the PHIZ can be mapped to the 2D UI. Accordingly, when the user moves his or her hands in the PHIZ, the cursor correspondingly moves on the display. Movement in the z direction (i.e., back and forth) in the PHIZ allows for additional interactions to be performed such as pressing, zooming, 3D manipulations, or other forms of input to the UI.

Ergonomic physical interaction zone cursor mapping

A user interface is output to a display device. If an element of a human subject is in a first conformation, the user interface scrolls responsive to movement of the element. If the element is in a second conformation, different than the first conformation, objects of the user interface are targeted responsive to movement of the element without scrolling the user interface.

Natural user interface scrolling and targeting

Growing community of inventors

Seattle, WA, United States of America

Mark D Schwesinger