Microsoft Technology Licensing, LLC

Zhigu Holdings Limited

Nadim Y Abdo

Wilhelm R Schmieder

Voicu Anton Albu

Tong L Wynn

Graham Edward Fagg

Robert Wilhelm Schmieder

Vladimir Stoyanov

Nelamangal Krishnaswamy Srinivas

B Anil Kumar

Sridhar Sankuratri

Max Alan McMullen

John E Parsons

Charles Lawrence Zitnick, Iii

Adam J Overton

Ivan Brugiolo

Asael Dror

Jason Garms

Scott Field

Lihua Zhu

Costin Hagiu

Joy Chik

Makarand V Patwardhan

Carl M Carter-Schwendler

Oreste Dorin Ungureanu

Elton Saul

David Ethan Zoller

Alvin Loh

Michael V Sliger

Rajneesh Mahajan

Brian C McDowell

Mahesh Sharad Lotlikar

Madan Mohan R Appiah

John E Parsons, Jr

Paul Lee Coleman, Iv

Hammad Butt

Krishna Mohan Malladi

Sanjeev Mehrotra

Ido Miles Ben-Shachar

Alexandre Vicktorovich Grigorovitch

Kirt A Debique

Nikolaj Skallerud Bjorner

Leonardo Esteban Blanco

Dale Alan Sather

Andrew Kadatch

Nelly L Porter

Ivan J Leichtling

Stuart Raymond Patrick

Eduardo P Oliveira

Tad Dennis Brockway

Brendan McKeon

Troy Batterberry

Daniel Wood

Michael A Angiulo

Onur Filiz

Srinivasa Reddy Neerudu

Guatam Swaminathan

Kan Qiu

Ahmed M Tolba

Joy P L Chik

Gautam Swaminathan

Robert-Wilhelm Schmieder

Stuart Ray Patrick

Alp Emre Kanlikilicer

Roland Y Ayala

Joy Chick

TongLu Wynn

Paul L Coleman

Thomas A Thornton

Pui Loi Joy Chik

Arjun Dube

Scott A Field

Charles Lawrence Iii Zitnick

Tad Brockway

Tong Wynn

Joy PL Chik

John Parsons

Embodiments of the present disclosure relate to a remote desktop system which allows an application that executes on a remote computing device to be presented to a remote terminal as if the application is executing on the remote terminal. This system determines which of the remote computing device's application windows are top-level windows, and creates a rendering target for each top-level window. The rendering target is a graphics surface that is marshaled to the remote terminal. A PDU (Protocol Data Channel) is produced over this first graphics surface that includes a mapping of the location of the top-level window. A second graphics surface containing transparency information is created for a top-level window that contains a transparency characteristic. This second graphics surface is encoded and marshaled to the remote terminal separately from the first graphics surface. The client computing device receives and merges the two graphics surfaces, and renders a window with the expected transparency.

Rendering windows having transparent properties from a remote desktop environment

Various techniques for remoting graphics are described in the claims, drawings, and text forming a part of the present disclosure.

Command remoting

An invention is disclosed for encoding and decoding data in a 4:4:4 subsampling scheme, using an encoder/decoder that is not configured to encode or decode data in 4:4:4. In embodiments, an encoder planararizes an input frame into three component frames in a 4:0:0 scheme. The encoder then encodes each component frame in the 4:0:0 scheme, and aggregates the encoded component frames into a bit stream. A decoder receives such a bit stream, and decodes it with a component not configured to decode data in 4:4:4. The decoder decodes the bit stream to produce a representation of the three component frames in 4:0:0, then aggregates the three component frames into a representation of the original frame in 4:4:4.

Low-complexity remote presentation session encoder using subsampling in color conversion space

Techniques for improved command level remoting are disclosed. In embodiments of the invention, commands to generate vertices are sent in a terminal service session. As commands to draw vertices are generated by a server to be sent to a client to display, they are analyzed by the server. Where some of those vertices have been previously sent to the client, such as to generate a previous bitmap image, the server determines not to send those vertices to the client, and sends the client the new vertices.

Command remoting techniques

Embodiments of the present disclosure provide for dividing a display area having rendered data thereon into a plurality of tiles and determining an update frequency for each tile. A determination is then made as to whether the update frequency of each tile exceeds a threshold. For each tile whose update frequency exceeds the threshold, that tile is marked as a candidate tile. Each of the adjacent candidate tiles are then associated to form a heat map. The heat map is then analyzed to determine whether to encode the rendered data associated with the heat map.

Video detection in remote desktop protocols

Methods and systems for processing graphical data received at a computing system from a remote source are described. One method includes decoding received graphical content, the received graphical content including an image being compressed using a plurality of codecs, wherein decoding the received graphical content includes creating a decoded image. The method also includes, based on quality of the received graphical content, selecting from among a plurality of filters to apply to the decoded image. The method further includes applying a plurality of filters to at least a portion of the decoded image.

Post-process filter for decompressed screen content

An invention is disclosed for compressing data. In embodiments of the invention, input data is processed to determine one or more hints, or meta-data about how to compress the data. These hints may be produced based on the contents of the data itself, or by the process which generated the data. A hint may comprise an indication that a portion of the data matches another portion of the data, an indication that the portion of the data should not be compressed by an associated compressor, or an indication that the portion of the data should be compressed normally by the associated compressor. The source data and these hints may then be sent to a compressor, which traverses both the source data and the hints, and encodes the source data accordingly to produce an encoded data output stream.

Data compressor using hints

Systems, methods and computer-readable storage media are disclosed for accelerating bitmap remoting by extracting non-grid tiles from source bitmaps. A server takes a source image, identifies possibly repetitive features, and tiles the image. For each tile that contains part of a possibly repetitive feature, the server replaces that part with the dominant color of the tile. The system then sends to a client a combination of new tiles and features, and indications to tiles and features that the client has previously received and stored, along with an indication of how to recreate the image based on the tiles and features.

Accelerating bitmap remoting by identifying and extracting 2D patterns from source bitmaps

Methods and systems are disclosed in which bitmap data transmission is improved by using some of the advantages of primitive remoting, thus allowing for the reduction of the bandwidth and processing needed to remote a virtual desktop experience. In an embodiment, rendering is performed and bitmaps are remoted, but metadata comprising shortcuts or hints are provided to assist in the rendering of the bitmap data.

Graphics remoting using augmentation data

In various embodiments, remote presentation encoding techniques may be modified in such a way that the data can be transmitted over transports without guaranteed packet delivery. In one embodiment, the desktop graphics data may be encoded in individual frames, each frame comprising self-contained graphics elements that fit in a small number of User Datagram Protocol (UDP) protocol data units (PDUs). The PDUs may then be sent to the client on a separate lossy link instead of the lossless link. On the client side, the client may detect which graphic elements within a frame were 'lost' as a result of dropped UDP packets and request a refresh from the server through the lossless channel.

Loss tolerant protocol for remoting desktop graphics

Methods and systems for delivering screen content to a client device are disclosed. One method includes, for each of a plurality of coding units corresponding to screen regions included in a screen at a particular time, classifying screen content included in the coding unit as having a content type selected from among a plurality of content types, at least one of the content types comprising a screen image type, and, based on a determination that the screen content has a screen image type, applying a progressive standards-based encoding to the screen content of that coding unit. The method also includes transmitting encoded screen content for each of the screen regions to the client device.

Screen map and standards-based progressive codec for screen content coding

An invention is disclosed for conducting a remote presentation session with a client that uses a web browser to conduct the session. In embodiments, a proxy server exists between the remote presentation server and the client. The proxy server establishes a HTTP session with the client and a remote presentation session with the client. The server generates graphics encoded with a remote presentation protocol and sends them to the proxy, which re-encodes them as video and sends them to the client for display in the web browser. The client captures user input at the web browser and sends it to the proxy, which encodes it with the remote presentation protocol and sends it to the server to be processed.

Web-browser based desktop and application remoting solution

In various embodiments, a remote client is allowed to access at least a part of a connection service located on alternate sources other than the primary remote presentation server. In some embodiments, the remote presentation virtual channels may be split into multiple connections with the purpose of allowing better flow control. Some embodiments may be implemented in a virtual machine environment for cases in which the data to be transferred through a data channel is located in the host virtual machine partition but the remote endpoint is located on the guest virtual machine partition.

Multi-link remote protocol

A display area having rendered data thereon is divided into a plurality of tiles and an update frequency for each tile is determined. A determination is then made as to whether the update frequency of each tile exceeds a threshold. For each tile whose update frequency exceeds the threshold, that tile is marked as a candidate tile. Adjacent candidate tiles are then associated to form a heat map. The heat map is then analyzed to determine whether to encode the rendered data associated with the heat map.

Growing community of inventors

Bellevue, WA, United States of America

Nadim Y Abdo