Microsoft Technology Licensing, LLC

Jingyu Qiu

Regis J Crinon

Timothy Mark Moore

Shiwei Wang

Zong Zong Yuan

Warren Vincent Barkley

Humayun Mukhtar Khan

William George Verthein

Guo-Wei Shieh

Ling Niu

Zhengyou Zhang

Michael Jack Sinclair

Zicheng Liu

Eran Shtiegman

Arvind Jayasundar

Mingxuan Sun

The claimed subject matter provides systems and/or methods that facilitate describing, communicating, utilizing, etc. a frame dependency structure in connection with real time video communication. For example, a protocol can be employed to communicate the dependency structure from a sender to a receiver. Moreover, a mechanism on a receiver side can detect frame(s) that will be rendered with artifacts if displayed due to previous frame loss; this mechanism can leverage receiver side knowledge concerning the dependency structure of the of the frames.

Mechanisms to conceal real time video artifacts caused by frame loss

Techniques for conference system location awareness and provisioning are described. An apparatus may comprise a room detection component operative to determine a room identifier of a room which a conference system is in, a database component operative to determine one or more room properties of the detected room by querying a database of room properties using the room identifier, and a conference configuration component operative to configure one or more conference elements using the room properties. Other embodiments are described and claimed.

Techniques for conference system location awareness and provisioning

Techniques to provide active lighting control for video teleconferencing systems are described. In an embodiment, a video teleconferencing (TVC) device receives lighting data from cameras in a room where a VTC is taking place. The VTC device may access lighting profiles for the lights in the room from a lighting control system. The VTC device may compare the current lighting conditions to a target model. The VTC device may use the lighting profiles to select lights to turn on or off via the lighting control system to improve the lighting. The VTC device may monitor the lighting conditions during the conference and may re-adjust the lights if a large change occurs. Other embodiments are described and claimed.

Techniques and system for active lighting control in video conferencing

The claimed subject matter provides systems and/or methods that facilitate describing, communicating, utilizing, etc. a frame dependency structure in connection with real time video communication. For example, a protocol can be employed to communicate the dependency structure from a sender to a receiver. Moreover, a mechanism on a receiver side can detect frame(s) that will be rendered with artifacts if displayed due to previous frame loss; this mechanism can leverage receiver side knowledge concerning the dependency structure of the frames.

Video send and receive capabilities of participants are determined by the respective machines determining available combinations, as well as preferences for the receivers. Receiver capabilities are forwarded to the source for computation of negotiated video capabilities through a logic intersection of the determined capabilities based on desired number of streams and resolutions. If a resolution of a send capability exists within the receive capability, the highest frame and/or bit rate may be selected for transmission.

Multiple video stream capability negotiation

A multiple screen telepresence style video conferencing experience is provided employing generic hardware and intelligent software, which may be based on existing enhanced communication systems such as unified communication systems. Through a component based approach, the system can be deployed in any conference room, assembled on the spot by an untrained user, flexible to accommodate any number of screens.

Unified communication based multi-screen video system

Architecture for enabling a communications endpoint to quickly recover from a packet loss, reducing duration of a signal dropout. A communications component sends a downlink of dependency-structured signals, such as audio and/or video signals using compressed frames between key frames. A multipoint control component (MCC) is located between the communications component and multiple endpoints, and distributes the downlink to the multiple endpoints. A frame caching component caches a key frame of the downlink. If a key frame is lost at one of the endpoints, the endpoint sends a packet loss report to the frame caching component. The key frame is resent from the frame caching component to the endpoint in response to the key frame loss. In this way, the frame caching component can respond to specific frame loss situations on any of the endpoints, without interfering with the performance on the other endpoints.

Error recovery in an audio-video multipoint control component

During remote communication session, there can be situations where information needs to be sent at a high resolution. Sending information at a high resolution allows for the capture of detail that can be lost without the use of a high resolution. A web camera can obtain information in both a higher resolution and standard resolution. A sending component can send this information encoded with markers that allow a receiving component to process and display the information.

Multiple resolution capture in real time communications

An error correction system determines a level of error correction protection to apply to a frame of video data to be transmitted by a sending endpoint to a receiving endpoint based on the predicted impact of packet loss as well as the importance of the frame based on inter-frame dependencies, frame size, packet loss probability, historical packet loss pattern, central processing unit (CPU) load, and available network bandwidth. At the receiving endpoint, when packet loss is detected for a particular frame, the receiving endpoint will attempt to recover the frame using protection packets received along with the video data.

Reducing effects of packet loss in video transmissions

A subject captured by a camera may be affected by environmental lighting provided by nearby light sources and the sun or moon, which may cause underexposure or overexposure of the image or aesthetically displeasing color tones. Image processing and camera adjustments may mitigate some imaging problems with limited effect and introduce undesirable side effects. A lighting array may be devised to expose the subject to various types of light (e.g., white light comprising full spectrum illumination and red, green, and blue lights comprising partial spectrum illumination) to resolve lighting problems in a more effective manner. Moreover, the lighting array may be responsively controlled to adjust the subject image with respect to one or more target spectra specifying desirable colors for the subject image. The lighting array may be iteratively controlled, e.g. by a gradient descent algorithm, for incrementally adjusting parameters with respect to proximate target spectra for the image.

Lighting array control

A video communication system may include a computer program that implements a feedback control process for automatically controlling a light. The feedback control process may include receiving an image from a video camera and determining an initial difference between the received image and a stored image. For example, the feedback control process may determine, on a pixel-by-pixel basis, whether the color and intensity of a facial region in the captured image is sufficiently close to the color and intensity of a facial region in the stored image. If the difference between the captured image and the stored image exceeds a threshold, the feedback control process includes transmitting an optimization instruction to the light. This optimization instruction, when performed by the light, decreases the difference between the received image and the stored image.

Growing community of inventors

Issaquah, WA, United States of America

Jingyu Qiu