Wyse Technology Inc.

Dell Products Inc.

Richard Goldberg

Oleg Rombakh

Andrew T Fausak

Fault recovery of a video bitstream can be performed in a remote session. A decoder of a remote display protocol client can be configured to process a video bitstream that is transferred over a virtual channel of a remote session. As part of processing the video bitstream prior to passing it to a hardware decoder, the decoder can detect the occurrence of an error in the bitstream and then cause the remote display protocol client to employ the remote display protocol which encapsulates the virtual channel to request an I-frame from the remote display protocol service. This will force the encoder to send an I-frame even if the desktop has low entropy thereby minimizing how long a glitch may persist. Because the remote display protocol itself is employed to request the I-frame, there is no requirement to modify the video stream protocol.

Fault recovery of video bitstream in remote sessions

Audio and video devices can be virtualized using synchronous A/V streaming. When a video device such as a webcam is connected to a client terminal while the client terminal has established a remote session on a server, video data generated by the video device can be encoded into an encoded video stream using the H.264 or similar standard. Additionally, audio data corresponding to the video data can be embedded into the encoded video stream. The encoded video stream with the embedded audio can then be transferred to the server. The server-side components can extract the audio from the stream and perform the necessary decoding on the video and possibly on the audio data prior to providing the decoded data to drivers that function as virtualized audio and video devices on the server.

Virtualizing audio and video devices using synchronous A/V streaming

A remote desktop can be shared with a number of clients. A proxy client can be employed to establish a remote desktop connection with a server for the purpose of accessing a remote desktop. The proxy client can receive desktop display data pertaining to the remote desktop and forward it to a remote desktop client on one or more clients to cause the remote desktop to be displayed on each of the clients. When users interact with the remote desktop displayed on the clients, the remote desktop client can send desktop input data to the proxy client. The proxy client can then forward this desktop input data to the server over the remote desktop connection. The proxy client may selectively block desktop input data received from a client that is not currently authorized to provide input to the remote desktop.

Proxy for sharing remote desktop sessions

Local network resources can be seamlessly accessed from a remote session. A remoting client that executes on a client terminal and a remoting service that executes in a remote session can each be configured to implement a virtual network pseudo device. These virtual network pseudo devices can be configured to communicate network communications via a virtual channel with the virtual channel endpoints performing any necessary network address translation. As a result, when the remote session host attempts to discover local network resources, the corresponding network communications will be routed over the virtual channel and transmitted over the client's local area network. Any resources on the client's local area network will respond accordingly with this responses being routed back over the virtual channel to the remote session host thus causing the resources to appear as if they were part of the same local area network as the remote session host.

Sharing local network resources with a remote VDI instance

In a desktop virtualization environment, a server-side agent can be employed on the server to function as a cast device. Applications executing on a remote desktop will therefore see the agent as a cast device and can direct cast requests to the agent. When the agent receives a cast request, it can forward the cast request to a client-side proxy. The proxy can then transmit the cast request to an actual cast device that is part of the same subnet as the client. In this way, an application executing on the server will be able to seamlessly cast content to a cast device that is not part of the same subnet.

Remote casting of media content

A remoting client can be configured to offload various graphics-based remoting protocol processes to the GPU to thereby free up the CPU for performing other remoting tasks. In this way, a remoting client can be executed on a client terminal that has a less powerful CPU even when a graphics-rich desktop is virtualized on the client terminal. When the remoting client receives remoting communications containing graphics display data, the remoting client can write the graphics display data to a location in memory that is accessible to the GPU and can then pass the graphics display data to the GPU for further processing. The CPU is therefore freed from having to fully process the graphics display data including from having to copy the graphics display data to a display buffer.

Remoting client having GPU off-loader

Synchronization of audio and video data can be enforced by embedding audio within video frame data. In a network environment in which audio and video data are generated on a source computing device and then transferred over the network to a destination computing device for output, the source computing device can be configured to encode the video data into an encoded video stream. As part of this encoding, the source computing device can also embed audio in the encoded video stream in a manner that associates the audio with corresponding video frames. The encoded video stream with the embedded audio can then be transferred over the network. The destination computing device can be configured to parse the encoded video stream to remove the audio and route it to an audio buffer and then route the encoded video stream to a GPU.

Enforcing synchronization by embedding audio within video frame data

In particular embodiments, a computing device establishes a remote desktop connection with a remote host, the remote desktop connection including one or more dynamic virtual channels. The computing device receives from one or more sensors an indication that the computing device has been rotated to a new orientation. The computing device sends to the remote host, via one of the dynamic virtual channels, information associated with the new orientation. The computing device receives from the remote host graphical data based at least in part on the information associated with the new orientation and provides for display the graphical data.

Growing community of inventors

Los Gatos, CA, United States of America

Richard Goldberg