Microsoft Technology Licensing, LLC

Oreste Dorin Ungureanu

Paul C David

Leonardo Esteban Blanco

Matthew W Calkins

Nadim Y Abdo

Gregory David Swedberg

Ashraf A Michail

Joseph S Beda, Iii

Robert Wilhelm Schmieder

Gerhard A Schneider

Kevin T Gallo

Andrey E Arsov

Steve Pronovost

Ivan J Leichtling

Donald B Curtis

Joy Chik

Sriram Subramanian

Marcus J Andrews

Ivan Brugiolo

Gilles Khouzam

Andrei Baioura

Sandeep Prabhakar

Zhigang Xu

Mohamed Sadek

Harneet Singh Sidhana

Pawel Wiktor Olszta

Lucas Brodzinski

Chenyin Zhong

Amos Eshel

Shalini Akella

TongLu Wynn

Sriya Sampath

Paul David

Embodiments of the present disclosure relate to a remote desktop system which allows an application that executes on a remote computing device to be presented to a remote terminal as if the application is executing on the remote terminal. This system determines which of the remote computing device's application windows are top-level windows, and creates a rendering target for each top-level window. The rendering target is a graphics surface that is marshaled to the remote terminal. A PDU (Protocol Data Channel) is produced over this first graphics surface that includes a mapping of the location of the top-level window. A second graphics surface containing transparency information is created for a top-level window that contains a transparency characteristic. This second graphics surface is encoded and marshaled to the remote terminal separately from the first graphics surface. The client computing device receives and merges the two graphics surfaces, and renders a window with the expected transparency.

Rendering windows having transparent properties from a remote desktop environment

Transitions between monitor configurations may be streamlined by minimizing the tearing down and recreating of render targets and primary frame buffers associated with the monitors. In at least one example, the techniques described herein include identifying at least one render target in a first monitor configuration that is also in a second monitor configuration. In response to identifying the at least one render target in the first monitor configuration that is also in the second monitor configuration, the techniques herein describe maintaining the at least one render target during a transition between the first monitor configuration to second monitor configuration.

Streamlined handling of monitor topology changes

Embodiments described herein relate to improving throughput of a CPU and a GPU working in conjunction to render graphics. Time frames for executing CPU and GPU work units are synchronized with a refresh rate of a display. Pending CPU work is performed when a time frame starts (a vsync occurs). When a prior GPU work unit is still executing on the GPU, then a parallel mode is entered. In the parallel mode, some GPU work and some CPU work is performed concurrently. When the parallel mode is exited, for example when there is no CPU work to perform, the parallel mode may be exited.

CPU-GPU parallelization

A framework for and hosting rendering plug-ins in remote access services is disclosed. The framework provides an interface between the core components of the remote access system and the rendering plug-ins. The framework utilizes public APIs to provide the interface between the core components and the rendering plug-ins. Using the APIs, the framework can allow various existing and new rendering plug-ins to interact with the core components of the remote access system, thereby making an extensible system that can support a variety of rendering plug-ins.

Framework for rendering plug-ins in remote access services

A server computer hosts one or more application programs that are accessed by a client computer. Higher-level graphics commands describing graphics images are received from the application programs. The server computer determines whether the client computer is able to generate graphics using the higher-level graphics commands or generates graphics using relatively lower-level graphics commands. The server computer sends higher-level or relatively lower-level graphics commands depending on whether the client computer generates graphics using higher-level or relatively lower-level graphics commands.

Remote client graphics rendering

A method and protocol to create and control compositions on a remote device is disclosed. The protocol allows servers and other devices to take advantage of processing capabilities of remote devices to render compositions on the remote devices, thereby increasing server scalability and leveraging the remote device processing capabilities. The protocol provides high-level command packets to communicate resource command packets and control packets to the remote device with the payload having the information needed to process the commands.

Protocol for remote visual composition

A multiple-level graphics processing system and method (e.g., of an operating system) for providing improved graphics output including, for example, smooth animation. One such multiple-level graphics processing system comprises two components, including a tick-on-demand or slow-tick high-level component, and a fast-tick (e.g., at the graphics hardware frame refresh rate) low-level component. In general, the high-level, less frequent component performs computationally intensive aspects of updating animation parameters and traversing scene data structures, in order to pass simplified data structures to the low-level component. The low-level component operates at a higher frequency, such as the frame refresh rate of the graphics subsystem, to process the data structures into constant output data for the graphics subsystem. The low-level processing includes interpolating any parameter intervals as necessary to obtain instantaneous values to render the scene for each frame of animation.

Multiple-level graphics processing system and method

A system that provides graphics commands that represent graphics or an image, to a consuming process. The graphics commands are represented by a visual tree which includes objects and resources describing the objects. The objects and resources are communicated to a composition engine that creates an analogous composition tree that is analogous to the visual tree. The composition tree is used to render the graphics or image.

High level graphics stream

A visual tree structure as specified by a program is constructed and maintained by a visual system's user interface thread. As needed, the tree structure is traversed on the UI thread, with changes compiled into change queues. A secondary rendering thread that handles animation and graphical composition takes the content from the change queues, to construct and maintain a condensed visual tree. Static visual subtrees are collapsed, leaving a condensed tree with only animated attributes such as transforms as parent nodes, such that animation data is managed on the secondary thread, with references into the visual tree. When run, the rendering thread processes the change queues, applies changes to the condensed trees, and updates the structure of the animation list as necessary by resampling animated values at their new times. Content in the condensed visual tree is then rendered and composed. Animation and a composition communication protocol are also provided.

System and method for managing visual structure, timing, and animation in a graphics processing system

Growing community of inventors

Duvall, WA, United States of America

Oreste Dorin Ungureanu