Microsoft Technology Licensing, LLC

Ian Sands

John Snavely

V Kevin Russ

Edwin Russ Burtner

Kenneth Paul Hinckley

Stephen Edward Hodges

Hrvoje Benko

Shahram Izadi

David Alexander Butler

William Ben Kunz

Russ Burtner

Kevin Russ

Eric J Horvitz

Andrew David Wilson

Meredith June Morris

F David Jones

Shawn R LeProwse

Victor Kevin Russ

Ali M Vassigh

Eric I-Chao Chang

Peter B Thompson

A computing system causes a plurality of display devices to display user interfaces containing portions of a canvas shared by a plurality of users. The canvas is a graphical space containing discrete graphical elements located at arbitrary locations within the canvas. Each of the discrete graphical elements graphically represents a discrete resource. When a user interacts with a resource in the set of resources, the computing system modifies the canvas to include an interaction element indicating that the user is interacting with the resource. The computer system then causes the display devices to update the user interfaces such that the user interfaces reflect a substantially current state of the canvas. In this way, the users may be able to understand which ones of the users are interacting with which ones of the resources.

Shared collaboration canvas

Aspects relate to detecting gestures that relate to a desired action, wherein the detected gestures are common across users and/or devices within a surface computing environment. Inferred intentions and goals based on context, history, affordances, and objects are employed to interpret gestures. Where there is uncertainty in intention of the gestures for a single device or across multiple devices, independent or coordinated communication of uncertainty or engagement of users through signaling and/or information gathering can occur.

Gestures, interactions, and common ground in a surface computing environment

A virtual mouse input device is created in response to a placement of a card on a touch surface. When the card is placed on the touch surface, the boundaries of the card are captured and a virtual mouse appears around the card. The virtual mouse may be linked with a user through an identifier that is contained on the card. Other controls and actions may be presented in menus that appear with the virtual mouse. For instance, the user may select the type of input (e.g. mouse, keyboard, ink or trackball) driven by the business card. Once created, the virtual mouse is configured to receive user input until the card is removed from the touch surface. The virtual mouse is configured to move a cursor on a display in response to movement of the card on the touch surface.

Creating a virtual mouse input device

An input device is created on a touch screen in response to a user's placement of their hand. When a user places their hand on the touch screen, an input device sized for their hand is dynamically created. Alternatively, some other input device may be created. For example, when the user places two hands on the device a split keyboard input device may be dynamically created on the touch screen that is split between the user's hand locations. Once the input device is determined, the user may enter input through the created device on the input screen. The input devices may be configured for each individual user such that the display of the input device changes based on physical characteristics that are associated with the user.

Virtual input devices created by touch input

A user of a mobile device is able to display information about objects in the surrounding environment and to optionally interact with those objects. The information may be displayed as a graphical overlay on top of a real-time display of imagery from a camera in the mobile device with the overlay indexed to the real-time display. The graphical overlay may include positional information about an external object and may include navigational information intended to assist the user in moving to the object's location. There may also be a graphical user interface which allows the user to utilize the mobile device to interact with an external object.

Location based object tracking

Navigation information may be provided. First, a destination location may be received at a portable device. Next, a current location of the portable device maybe detected. Then, at least one way-point may be calculated based on the current location and the destination location. An orientation and a level of the portable device may be determined and the at least one way-point may then be projected from the portable device.

Projected way-finding

A dual module portable device may be provided. A motion of a first module of the dual module portable device may be detected. Based at least in part on the detected motion, a position of the first module may be determined relative to the second module of the portable device. Once the relative position of the first module has been determined, a portion of a user interface associated with the relative position may be displayed at the first module.

Dual module portable devices

In some implementations, a touch point on a surface of a touchscreen device may be determined. An image of a region of space above the surface and surrounding the touch point may be determined. The image may include a brightness gradient that captures a brightness of objects above the surface. A binary image that includes one or more binary blobs may be created based on a brightness of portions of the image. A determination may be made as to which of the one more binary blobs are connected to each other to form portions of a particular user. A determination may be made that the particular user generated the touch point.

Touch discrimination

Within a surface computing environment users are provided a seamless and intuitive manner of modifying security levels associated with information. If a modification is to be made the user can perceive the modifications and the result of such modifications, such as on a display. When information is rendered within the surface computing environment and a condition changes, the user can quickly have that information concealed in order to mitigate unauthorized access to the information.

Authentication&#x2014;circles of trust

The claimed subject matter provides a system and/or a method that facilitates distinguishing input among one or more users in a surface computing environment. A variety of information can be obtained and analyzed to infer an association between a particular input and a particular user. Touch point information can be acquired from a surface wherein the touch point information relates to a touch point. In addition, one or more environmental sensors can monitor the surface computing environment and provide environmental information. The touch point information and the environmental information can be analyzed to determine direction of inputs, location of users, and movement of users and so on. Individual analysis results can be correlated and/or aggregated to generate a inference of association between a touch point and user.

A virtual inking device is created in response to a touch input device detecting a user's inking gesture. For example, when a user places one of their hands in a pen gesture (i.e. by connecting the index finger with the thumb while holding the other fingers near the palm), the user may perform inking operations. When the user changes the pen gesture to an erase gesture (i.e. making a fist) then the virtual pen may become a virtual eraser. Other inking gestures may also be utilized.

Virtual inking using gesture recognition

Rule-based location sharing may be provided. A location determining device, such as a Global Positioning System (GPS) enabled device, may receive a request to share the location. A rule may be used to determine whether to share the location with the requestor. If the rule allows the location to be shared, the location may be sent to the requestor. The location may be relayed through a third party server, which may be operative to evaluate the rule before sharing the location with the requestor.

Growing community of inventors

Seattle, WA, United States of America

Ian Sands