Microsoft Technology Licensing, LLC

Thomson Licensing S.a.

Microsoft Corporation

Naveen Thumpudi

Wei-Ge Chen

Ming-Chieh Lee

Yongjun Wu

Wei-ge Chen

Shyam Sadhwani

Louis-Philippe Bourret

Sandeep Kanumuri

Weidong Zhao

Sathyanarayanan Karivaradaswamy

Gang Ji

Nikola Borisov

Chao He

Matthew Richard Wozniak

Eric Christoffersen

James David Johnston

Glenn Frederick Evans

Serge Smirnov

Sang Kun Choe

Sudheer Sirivara

Florin Folta

Christian Palmer Larson

Chris Messer

Ali Jezu Tabatabai

Rui Zhao

Mei Ling Wilson

Stephen Estrop

Daniel Dinu

Mehmet Kucukgoz

Anil M Murching

Timothy E Onders

Raymond Cheng

Isuru Chamara Pathirana

Christopher Stephen Messer

Sergey Smirnov

Kim-Chyan Gan

Jesse Hakanen

Jitesh Krishnan

Michael Jeffrey Ajax

William R Sanders

Wenjie Shi

Ravikant Gupta

Marcin Stankiewicz

Anton Victor Polinger

Joel Corley

Jinglin Shen

Jeffrey D Day

Ziran Wu

Onji Bae

Suhib F M Alsisan

Karthik Elangovan

Andrew Wathen Quirk

Alsisan F Suhib

Spandan Tiwari

Sang Choe

Nicola Borisov

The techniques disclosed herein enable a guest operating system (OS) to access and use a color space conversion component on a host OS. The guest OS provides, via an application programming interface, a request for the host OS to generate media data in a color space format that is used by the guest OS. To generate the media data, the host OS uses a color space conversion component on the host OS, which is more performant than a corresponding color space conversion component on the guest OS because the color space conversion component on the host OS has access to hardware-accelerated functionality. Accordingly, the color space conversion component on the host OS converts media data into the color space format that is used by the guest OS, and stores the media data in memory that is accessible to the guest OS.

Providing host media processing functionality to a guest operating system

A media processing tool adds custom data to an elementary media bitstream or media container. The custom data indicates nominal range of samples of media content, but the meaning of the custom data is not defined in the codec format or media container format. For example, the custom data indicates the nominal range is full range or limited range. For playback, a media processing tool parses the custom data and determines an indication of media content type. A rendering engine performs color conversion operations whose logic changes based at least in part on the media content type. In this way, a codec format or media container format can in effect be extended to support full nominal range media content as well as limited nominal range media content, and hence preserve full or correct color fidelity, while maintaining backward compatibility and conformance with the codec format or media container format.

Custom data indicating nominal range of samples of media content

The present disclosure relates to systems, methods, and computer-readable media for selectively identifying image frames from an input video to provide to an image processing model based on camera statistics. For example, systems disclosed herein include receiving an input video and associated camera statistics from a video capturing device. The systems disclosed herein further include identifying select image frames to provide to the image processing model based on the camera statistics and based on an application of the image processing model. The systems disclosed herein further include selectively identifying and providing camera statistics to the image processing model. By selectively providing data to the image processing model based on camera statistics, the systems disclosed herein can leverage capabilities of video capturing devices to significantly reduce the expense of processing resources when utilizing a variety of image processing models.

Pre-processing image frames based on camera statistics

The present disclosure relates to systems, methods, and computer-readable media for selectively identifying pixel data to provide as an input to an image processing model based on motion data associated with the content of a digital video. For example, systems disclosed herein include receiving a compressed digital video and decompressing the compressed digital video to generate a decompressed digital video. The systems disclosed herein further include extracting or otherwise identifying motion data while decompressing the compressed digital video. The systems disclosed herein also include analyzing the motion data to determine a subset of pixel data from the decompressed digital video to provide as input to an image processing model trained to generate an output based on input pixel data.

Selectively identifying data based on motion data from a digital video to provide as input to an image processing model

A method of providing environmental information to an electronic device includes, at the electronic device, receiving ambient light from a surrounding environment of the electronic device with one or more camera sensors in data communication with a processor and capturing a raw pattern with the camera sensor, wherein the raw pattern includes light intensity information and light spectrum information. The method further includes deriving at least one ambient light value from the light intensity information and light spectrum information and providing the ambient light value to the processor of the electronic device.

Systems and methods for providing human interface device information via a camera sensor

An image sensor is misaligned with an operating orientation. Misalignment information may be registered with an operating system. Misaligned image data may be transformed as a final processing act before being delivered to an application. A method of transforming image misalignment. Image data having a first orientation is received from an image sensor at a first computing component of a computing device. The image data is transformed using misalignment information to transformed image data having a second orientation. Immediately after transforming the image data, the transformed image data is communicated from a final computing component to an application.

Methods of transforming image misalignment

Video image stabilization provides better performance on a generic platform for computing devices by evaluating available multimedia digital signal processing components, and selecting the available components to utilize according to a hierarchy structure for video stabilization performance for processing parts of the video stabilization. The video stabilization has improved motion vector estimation that employs refinement motion vector searching according to a pyramid block structure relationship starting from a downsampled resolution version of the video frames. The video stabilization also improves global motion transform estimation by performing a random sample consensus approach for processing the local motion vectors, and selection criteria for motion vector reliability. The video stabilization achieves the removal of hand shakiness smoothly by real-time one-pass or off-line two-pass temporal smoothing with error detection and correction.

Motion vector estimation for video image stabilization

Methods and devices for compensating for detected motion when capturing an image may include determining at least one of a global movement of an imaging device and a local movement of one or more objects in a scene captured by the imaging device. The methods and devices may include comparing at least one of the global movement and the local movement to a movement threshold related to a current mode of operation of the imaging device. The methods and devices may include automatically selecting a mode of operation for the imaging device when at least one of the global movement and the local movement exceeds the movement threshold, wherein the selected mode of operation reduces blur in the captured image. The methods and devices may include transmitting information about the mode of operation.

Motion blur detection

Methods and devices for enabling controls of an imaging device may include receiving a data stream with a request for at least one control of an imaging device, wherein the at least one control is related to Universal Serial Bus (USB) video. The methods and devices may include identifying a defined functionality of the at least one control and transmitting the data stream to the imaging device to specify the operation of the imaging device based on the defined functionality of the at least one control. The methods and devices may also include generating metadata information from received video frame packets from an imaging device. The methods and devices may include identifying metadata information in the header of a video packet when the header size exceeds the standard header size. The methods and devices may include generating a metadata buffer with the identified metadata information.

Universal serial bus (USB) video extension

Described are examples for generating a high dynamic range image from a plurality of images. A plurality of images of a real world scene can be obtained from one or more image sensors, wherein at least two of the plurality of images are captured based on different intensity parameters. Intensity information for the real world scene can be determined based at least in part on processing the at least two of the plurality of images. A high dynamic range image corresponding to the real world scene can be generated based at least in part on adding the intensity information to pixels of at least one of the plurality of images.

Dynamic range extension to produce images

Described are examples for storing advanced color images using legacy containers. An advanced color image can be obtained in a first image format comprising a number of parameters at a first bit depth per pixel. Values of the number of parameters of the advanced color image can be encoded into second values of one or more legacy containers, where each of the one or more legacy containers are of a second image format including the same number of parameters at a second bit depth per pixel. The advanced color image can be stored and/or communicated as the one or more legacy containers.

Representing advanced color images in legacy containers

Described are examples for securely storing stream data received from a stream source. Stream data can be received from the stream source for storing in one or more secured buffers of a secure memory, wherein the stream data includes a header portion generated by a driver for the stream source and a payload portion generated from the stream source. The payload portion of the stream data can be stored in the one or more secured buffers and contiguous to a previous payload portion of previous stream data received from the stream source. The header portion of the stream data can be stored in another portion of the secure memory or a non-secure memory. A data frame, from the one or more secured buffers, comprising at least the payload portion of the stream data and the previous payload portion of the previous stream data can be provided to an application.

Parsing, processing, and/or securing stream buffers

Growing community of inventors

Sammamish, WA, United States of America

Naveen Thumpudi