Microsoft Technology Licensing, LLC

Joel P Dehlin

Susan Elizabeth Pappalardo

Andrew David Wilson

Steven Mark Drucker

Peter G Chin

Jason William Fuller

David J Kurlander

Christina Summer Chen

Marc W Todd

Greg A Keyser

Debbie Miu Yan Yau

Steven Nabil Bathiche

Curtis Glenn Wong

Asta Jane Roseway

Felix Gti Andrew

Chee Heng Chew

Daniel Chaim Robbins

Andy Padawer

Andy Seres

Debbie M Y Yau

Eric J Horvitz

Kenneth Paul Hinckley

Dawson Yee

Zeke Koch

Ray Sun

Donald Marcus Gillett

Kristen Nilsen Nye

Debbie M Yau

James D Drage

Jacob O Wobbrock

An interactive table has a display surface on which a physical object is disposed. A camera within the interactive table responds to infrared (IR) light reflected from the physical object enabling a location of the physical object on the display surface to be determined, so that the physical object appear part of a virtual environment displayed thereon. The physical object can be passive or active. An active object performs an active function, e.g., it can be self-propelled to move about on the display surface, or emit light or sound, or vibrate. The active object can be controlled by a user or the processor. The interactive table can project an image through a physical object on the display surface so the image appears part of the object. A virtual entity is preferably displayed at a position (and a size) to avoid visually interference with any physical object on the display surface.

Interaction between objects and a virtual environment display

A first electronic device engages in a voice communication with another electronic device. The voice communication is associated with data stored by the first electronic device. In some instances, the data is generated the first electronic device or received by the first electronic device from the second electronic device in response to, or as a consequence of the voice of the voice communication. During the voice communication, or sometime after the voice communication is terminated, the first electronic device determines that the data is associated with the voice communication. The data is then made available to an application program, so that the data can be associated with other data. Thus, a human user of the first electronic device is relieved of identifying data within a context, and relieved of the task associating the data with other data.

Systems, methods and apparatus for tracking on-call activity

Input is provided to an application using a plurality of physical objects disposed adjacent to an interactive display surface. A primary location is determined where a primary physical object, e.g., a finger or thumb of the user, is positioned adjacent to the interactive display surface. An additional location is determined where an additional physical object is positioned adjacent to the interactive display surface. The attribute might be a size of an image or selected portion of the image that will be retained after cropping. A change in position of at least one of the objects is detected, and the attribute is adjusted based on the change in position of one or both objects. A range of selectable options of the application can also be display by touching the interactive display surface with one's fingers or other objects, and one of the options can be selected with another object.

Using physical objects to adjust attributes of an interactive display application

An object placed on an interactive display surface is detected and its position and orientation are determined in response to IR light that is reflected from an encoded marking on the object. Upon detecting the object on an interactive display surface, a software program produces a virtual entity or image visible through the object to perform a predefined function. For example, the object may appear to magnify text visible through the object, or to translate a word or phrase from one language to another, so that the translated word or phrase is visible through the object. When the object is moved, the virtual entity or image that is visible through the object may move with it, or can control the function being performed. A plurality of such objects can each display a portion of an image, and when correctly positioned, together will display the entire image, like a jigsaw puzzle.

Using clear-coded, see-through objects to manipulate virtual objects

Information is oriented when presented to a user on a display surface, so that the information can be readily read and/or used by the user. The information is displayed on a generally horizontal display surface to users who may be located at different positions around the display surface. A different totem is associated with each user. The identity and position of each totem on the display surface is determined in response to a detected characteristic of the totem, such as a pattern of infrared light reflected from the totem. Either the location of a user's totem relative to a center of the display surface, or a quadrant of the display surface near where the user is located, or an orientation of the user's totem on the display surface can determine the orientation and location of the information presented to the user on the display surface.

Orienting information presented to users located at different sides of a display surface

An interactive display table has a display surface for displaying images and upon or adjacent to which various objects, including a user's hand(s) and finger(s) can be detected. A video camera within the interactive display table responds to infrared (IR) light reflected from the objects to detect any connected components. Connected component correspond to portions of the object(s) that are either in contact, or proximate the display surface. Using these connected components, the interactive display table senses and infers natural hand or finger positions, or movement of an object, to detect gestures. Specific gestures are used to execute applications, carryout functions in an application, create a virtual object, or do other interactions, each of which is associated with a different gesture. A gesture can be a static pose, or a more complex configuration, and/or movement made with one or both hands or other objects.

Recognizing gestures and using gestures for interacting with software applications

Output of a computer system is manipulated using a physical object disposed adjacent to an interactive display surface. A painting application produces an image in response to an object disposed adjacent to the interactive display surface. During each of a plurality of capture intervals, a set of points corresponding to the object is detected when the object is disposed adjacent to the interactive display surface. An image is projected onto the interactive display surface representing the set of points and is filled with a color or pattern. As successive sets of points are accumulated during each of a plurality of capture intervals, a composite image is displayed. An object can thus be used, for example, to 'draw,' 'paint,' or &#x201c;stamp&#x201d; images on the display surface. These images manifest characteristics of the object and its interaction and movement relative to the interactive display surface in a realistic manner.

Using size and shape of a physical object to manipulate output in an interactive display application

Data elements stored in a computing system and associated with a physical object are reassociated with the same or another physical object. An identifying characteristic presented by the physical object, such as a reflective pattern applied to the object, is detected when the object is positioned adjacent to the interactive display surface. Images or other files associated with the identifying characteristic are accessed and displayed on the interactive display surface. A gesture by a user adjacent to the interactive display surface is detected to reassociate a selected representation. For example, the user can change where the selected element fits in a sequence of data elements, or reassociate the selected element with a second object placed on the interactive display surface. In a networked environment, the reassociated element can be stored on a server and subsequently accessed from a different interactive surface via the network using the second physical object.

Manipulating association of data with a physical object

Input for controlling an application is provided to a computer system having an interactive display surface with an optical vision system for sensing objects. An optical code selected to be detectable by the interactive display surface when positioned adjacent to the interactive display surface is associated with a control function. The optical code is provided on an article configured to be removably affixed to at least a portion of a user's hand. When the portion of the user's hand is moved to a position adjacent to the interactive display surface, the optical vision system detects the optical code and invokes the control function associated with the optical code. Thus, a user can provide input to the interactive display surface with movements of the user's hand. A different optical code may be affixed to each digit of the user's hand, enabling the user to selectively invoke a plurality of control functions.

Disposing identifying codes on a user's hand to provide input to an interactive display application

One or more objects placed on a display surface of an interactive display system are identified by a camera that receives infrared light reflected back by the object(s) through the display surface. The interactive display system displays images on the display surface that are produced by software applications, as well as sensing objects placed proximate to the display surface. If object(s) that were placed on the display surface are identified and determined to be associated with a predefined software application, the application is automatically executed. Objects can be identified based upon shape, a pattern applied to the objects, a size of the object, or a location on the display surface where the object is placed. The object may be used in the software application after it is executed or may simply be bear a functional relationship to the software application.

Invoking applications with virtual objects on an interactive display

A system and method that facilitates control of the power states of a mobile device's wireless radios. Radios can be collectively turned off in a straightforward, intuitive operation, and can be restored to a powered-on state in a similar manner. In addition to collective powering down and restoring, the power states of individual radios can be controlled in a selective manner. When any radio is on, a connectivity dialog provides a link for collectively turning wireless devices off. When no radios are on, the connectivity dialog provides a corresponding link to turn wireless radios on, which may be only those that were on prior to the collective shutdown. A settings user interface, such as accessible via a link on the connectivity dialog, provides on/off radio buttons and checkboxes that enable the selective control of radio power state.

Method and system to shut down and control computer radios

A system and method for a transport independent gaming API for mobile devices. The gaming API allows for a multi-player gaming session between mobile devices where the transport protocol between the mobile devices may be switched transparently to both the user and the game application. The gaming API is switched according to which transport protocol is determined as the optimal protocol for transmitting game data according to specified parameters.

System and method for a transport independent gaming API for mobile devices

An input to a computer system is made by manipulating a physical object disposed adjacent to an interactive display surface. An application having at least one changeable attribute is executed on the computer system. When the physical object is disposed adjacent to the interactive display surface, it is identified and its location is determined based upon a shape, a size, an infrared reflectance, or some other optical quality. The initial location and orientation of the physical object on the interactive display surface relative to the interactive display surface is identified. The attribute of the application is correlated with the physical object and is changed in response to movement of the physical object. The physical object can thus be used, for example, to select menu options and parameters within the application being executed.

Growing community of inventors

Redmond, WA, United States of America

Joel P Dehlin