Microsoft Technology Licensing, LLC

Sang Kun Choe

Mei Ling Wilson

Yin Li

Christian Palmer Larson

Sathyanarayanan Karivaradaswamy

Fabin Shen

Leonard D Zuvela

Naveen Thumpudi

Aleksey S Kabanov

Sandeep Kanumuri

Hosam Adel Khalil

Humayun Mukhtar Khan

Vinod Prakash

Casey J Dvorak

Trevor Baron

Warren Michael Lam

Hong Wang Sodoma

Joel Corley

Michael J Ruete

Described are examples for providing stream augmenting components. A stream augmenting component having an augmentation function indicating a plurality of interfaces to one or more devices and an output stream can be initialized. At least a portion of the plurality of interfaces for the one or more devices can be accessed to at least one of obtain stream output from the one or more devices or control the one or more devices. A plurality of stream outputs from the one or more devices can be virtualized to the output stream at least in part by modifying or correlating data received over the plurality of stream outputs. The stream augmenting component can output the output stream to one or more other stream augmenting components or applications via at least another portion of the one or more interfaces.

Pluggable components for augmenting device streams

An image sensor is misaligned with an operating orientation. Misalignment information may be registered with an operating system. Misaligned image data may be transformed as a final processing act before being delivered to an application. A method of transforming image misalignment. Image data having a first orientation is received from an image sensor at a first computing component of a computing device. The image data is transformed using misalignment information to transformed image data having a second orientation. Immediately after transforming the image data, the transformed image data is communicated from a final computing component to an application.

Methods of transforming image misalignment

A computing device includes one or more camera systems, each camera system including software and/or hardware to provide various different camera-related capabilities. The camera system maintains one or more profiles, each profile identifying different capabilities of the camera system that the computing device is configured to use concurrently. The one or more profiles are provided to a program on the computing device, allowing the program to know which capabilities the computing device is configured to use concurrently. If a profile provided by the camera system indicates that the computing device is configured to use certain capabilities concurrently (e.g., capturing images and recording video at certain resolutions), then the program allows a user to select options for using those capabilities concurrently. However, if no such profile exists, the program does not allow a user to select options for using those capabilities concurrently.

Profiles identifying camera capabilities

Methods and devices for enabling controls of an imaging device may include receiving a data stream with a request for at least one control of an imaging device, wherein the at least one control is related to Universal Serial Bus (USB) video. The methods and devices may include identifying a defined functionality of the at least one control and transmitting the data stream to the imaging device to specify the operation of the imaging device based on the defined functionality of the at least one control. The methods and devices may also include generating metadata information from received video frame packets from an imaging device. The methods and devices may include identifying metadata information in the header of a video packet when the header size exceeds the standard header size. The methods and devices may include generating a metadata buffer with the identified metadata information.

Universal serial bus (USB) video extension

Described are examples for providing stream augmenting components. A stream augmenting component having an augmentation function indicating a plurality of interfaces to one or more devices and an output stream can be initialized. One or more functions for the one or more devices to at least one of obtain stream output from the one or more devices or control the one or more devices can be accessed. A plurality of stream outputs from the one or more devices can be virtualized to the output stream at least in part by modifying or correlating data received over the plurality of stream outputs. The output stream can be output to one or more other stream augmenting components or applications.

Techniques for arbitrating control access to a shared resource among multiple client applications concurrently consuming a shared data stream associated with the shared resource are described. A server component instantiates a shared resource component representing the shared resource and associated shared data stream. The server component publishes a shared resource interface that provides central interface for the multiple client applications to access the shared resource and associated shared data stream. Each client application may access the shared resource in either control mode or shared mode to consume the shared data stream. In control mode, the client application has read-write access to control parameters representing a configuration of the shared resource that are usable to modify aspects of the shared data stream. In shared mode, the client application has read-only access to the control parameters.

Arbitrating control access to a shared resource across multiple consumers

Methods and devices for monitoring camera resource activities may include receiving a camera resource request from an application that identifies at least one camera resource being requested for use by the application. The methods and devices may include determining whether the camera resource is available for use by checking a state of the camera resource using a camera resource log that provides the state of the camera resource. The methods and devices may include granting access to the camera resource when the state of the camera resource is available for use and updating the state of the camera resource when access is granted to the camera resource. The methods and devices may include updating the camera resource log when access is granted to the camera resource with an application identification (ID) for the application using the camera resource and the state of the camera resource.

Camera usage notification

Methods and devices for allocating memory for use with a camera resources may include receiving camera resource requests from application plurality of applications to use a camera resource. The methods and devices may include determining a memory type to allocate to the applications for the camera resource based on the camera resource request and compatibility information of the camera resource. The methods and devices may include determining a buffer and a buffer type to provide each of the applications based on an access mode of the camera resource, wherein the buffer type comprises one or more of a shared type, a copy type, and a secure type. The methods and devices may include providing the application access to the buffer based on the determination.

Memory allocation type for media buffer

Described are examples for outputting stream data from a plurality of stream sources. A first data stream output for a first stream source and a second data stream output for a second stream source can be received. First data of the first data stream output can be correlated, in time, with second data of the second data stream output. One or more output frames can be output including the first data and the second data as correlated in time.

Temporally correlating multiple device streams

Technology related to virtualizing sensors is disclosed. In one example of the disclosed technology, a method can be used to allocate resources of a computing system. The method can include enumerating hardware sensors and software modules that are capable of interacting with one another. A topology can be negotiated that is compatible with capabilities of the enumerated hardware sensors and software modules. A first request can be received from a first requestor to configure at least one of the enumerated hardware sensors and software modules. The at least one of the enumerated hardware sensors and software modules can be configured in response to the received first request.

Virtualizing sensors

Profiles identifying camera capabilities that are usable concurrently

Detecting at least one of an echo detector and a noise detector based on analysis of audio streams transmitted to and received from each endpoint of a conference. When certain characteristics of the respective audio streams for a given endpoint are classified as significant against certain criteria, a determination is made as to whether that endpoint is a source of echo and/or noise. Subsequent actions are taken to alert users and/or prevent broadcast of impaired signals.

Conference signal anomaly detection

Embodiments are configured to provide communication environments to communicating participants using a number of modality control features, but are not so limited. In an embodiment, a system includes a communications manager to manage an amount of available communication bandwidth to a number of communication modalities that include an audio modality, a video modality, an application sharing modality, and/or a file transfer modality. In one embodiment, available bandwidth can be distributed by controlling an audio state, a video state, an application sharing state, and/or a file transfer state, including using first and second distribution ratios as part of allocating available bandwidth.

Growing community of inventors

Redmond, WA, United States of America

Sang Kun Choe