Microsoft Technology Licensing, LLC

Carlos Pessoa

Paul Armistead Hoover

Harikrishna Menon Ajith Kumar

Pankaj Kachrulal Sarda

David William Shoots

Chris Whytock

Steven Brix Kirbach

Daniel John Wigdor

Robert J Levy

Sarat Chandra Subramaniam

Sundaram Ramani

Joyce Wu

Luis Eduardo Cabrera Cordon

Ian Middleton

Developers receive automatically designated property change events which caused invalidation of a rendered frame. Some embodiments control display invalidation in part by identifying higher-level frame bounding events in an execution trace, and applying at least one display invalidation constituency filter to lower-level thread events within a frame creation period, thereby obtaining a display invalidation constituency sequence of one or more display invalidation events. The sequence may include a layout property change event and/or a render property change event which invalidated the frame. An initial part of the sequence is designated as a display frame creation cause. Displayed frame invalidation is controlled by altering the display invalidation constituency, e.g., by manual or automated layout/render property change event elimination or event sequence location change, by a reduction in computational resource usage (e.g., memory usage, graphics processor chip usage), and/or by a reduction in thread execution time which provides a faster frame rate.

Frame invalidation control with causality attribution

A performance state machine is controlled in part by identifying notifications from an execution trace of an application program, through rapid automatic comparison of trace events to notification events for notification categories. Some notification categories include application startup, page outline load, page data load start, page data load finish, page to page transition, application input, window size change, media query, binding update, page background task start, page background task finish, developer-defined scenario start, and developer-defined scenario finish. Notifications may reflect heuristics such as the time from startup to first frame submission. A state is placed in the performance state machine for each identified notification, with aggregate application performance data for each transition between identified notifications. Some performance data categories include network activity, disk activity, memory usage, parse time, frame time, dropped frames, component or overall frame rates, and thread utilization. Timelines and other visual representations aid application performance optimization.

Performance state machine control with aggregation insertion

Various embodiments related to the location and adjustment of a virtual object on a display in response to a detected physical object are disclosed. One disclosed embodiment provides a computing device comprising a multi-touch display, a processor and memory comprising instructions executable by the processor to display on the display a virtual object, to detect a change in relative location between the virtual object and a physical object that constrains a viewable area of the display, and to adjust a location of the virtual object on the display in response to detecting the change in relative location between the virtual object and the physical object.

Virtual object adjustment via physical object detection

An interactive display system with a contact geometry interface is disclosed. The interactive display system may include a multi-touch display, a touch detection system configured to detect a touch input on the multi-touch display and to generate contact geometry for a contact region of the touch input, and an application programming interface executed on a processor of the interactive display system. The application programming interface may be configured to receive the contact geometry and to send the contact geometry to a requesting application program for application-level processing. Further, the application programming interface may be configured to receive from the application program a display command based on the application level-processing. The application programming interface may be configured to send the display command to the multi-touch display to adjust a display of a graphical element on the multi-touch display.

Interactive display system with contact geometry interface

Growing community of inventors

Redmond, WA, United States of America

Carlos Pessoa