Microsoft Technology Licensing, LLC

Masahiko Kaneko

Scott Robert Honji

Paul Millsap

Jan-Kristian Markiewicz

Sarah Graham Williams

Vincent L Ball

Eric W Hebenstreit

Marc Descamp

Amish Patel

Thomas W Olsen

Pravin Kumar Santiago

Nikola Letié

Ruoyang Li

Paul R Millsap

A computer configured to selectively use prediction to compensate for a latency of an input device. The input device may be a touch screen. Processing of touch inputs may lead to a latency between the user performing a touch input and the touch screen display responding to the touch input. A touch screen component predicts a subsequent position of a touch contact point based on the sensed positions of the touch contact point. The component may be a software component that provides a predictive output that can be selectively used based on a characteristic of a touch input. The component may be generic such that it may be applied on multiple types of computers equipped with different types of touch sensing hardware configured with any suitable settings. The component's output may be used to control the touch screen display.

Predictive compensation for a latency of an input device

To allow a computer platform to provide a consistent interface for applications to use information from multi-point indirect touch input devices, an application programming interface is provided to a software interface layer that manages interaction of the system with a variety of instantiations of multi-pointer indirect touch input devices. A runtime module provides information from the indirect touch input devices to an input stack accessible by applications on the computer system. The runtime module provides mapping of contacts on the indirect touch input devices to a display.

Application programming interface for a multi-pointer indirect touch input device

To allow a computer platform to provide a consistent interface for applications to use information from multi-point indirect touch input devices, an application programming interface is provided to a software interface layer that manages interaction of the system with a variety of instantiations of multi-pointer indirect touch input devices.

One or more techniques and/or systems are provided for utilizing input data received from an indirect interaction device (e.g., mouse, touchpad, etc.) as if the data was received from a direct interaction device (e.g., touchscreen). Interaction models are described for handling input data received from an indirect interaction device. For example, the interaction models may provide for the presentation of two or more targets (e.g., cursors) on a display when two or more contacts (e.g., fingers) are detected by indirect interaction device. Moreover, based upon a number of contacts detected and/or a pressured applied by respective contacts, the presented target(s) may be respectively transitioned between a hover visualization and an engage visualization. Targets in an engage visualization may manipulate a size of an object presented in a user interface, pan the object, drag the object, rotate the object, and/or otherwise engage the object, for example.

Interaction models for indirect interaction devices

In an indirect interaction input device, z-information can be considered in defining a user interaction model for the device. Any measurement of displacement in a z-direction can be used, if such information is available from the input device. The pressure data can be used to define states of interaction, with transitions between these states determined by various thresholds. The device can provide raw or normalized data, and can provide state information or data defining its thresholds that specify state transitions. This information can be provided as an attribute of a contact point provided by the device. Data can be normalized across various similar devices. Applications can use the raw pressure data from the device for their own purposes, or rely on the device itself or host operating system software to interpret the pressure data according to thresholds and states.

Pressure-based interaction for indirect touch input devices

A system for outputting a media stream and supplemental media streams is provided. A media stream manager outputs the media stream and associated supplemental media streams on a media stream output device. A timing module generates triggering events in conjunction with the output of the media streams according to event data. The media stream manager monitors for and detects the triggering events during the output of the media streams. Upon detecting a triggering event, the media stream manager determines which supplemental media streams are associated with the triggering event and iteratively outputs each associated supplemental media stream to the media stream output device. Supplemental media streams are output either synchronously or asynchronously according to previously determined information. A supplemental media stream that is output asynchronously to the media stream suspends the media stream and the timing of the media stream while the supplemental media stream is output.

Synchronization mechanism and the implementation for multimedia captioning and audio descriptions

A method for outputting supplemental media streams with a main media stream is presented. The method monitors for triggering events and, upon detecting a triggering event, causes one or more supplemental media streams associated with the triggering event to output. The associated supplemental media streams may be output either synchronously or asynchronously with the main media stream. Synchronous supplemental media streams are output concurrently with the main media stream. Asynchronously output supplemental media streams suspend the main media stream while they are output and terminate any currently outputting supplemental media streams. A supplemental media stream may cause a conditional triggering event to trigger a second supplemental media stream to output synchronously with the first. A second main media stream with associated supplemental media streams may be output asynchronously as a compiled supplemental media stream in connection with a first main media stream.

Growing community of inventors

Fall City, WA, United States of America

Masahiko Kaneko