Amazon Technologies, Inc.

Charles Benjamin Waggoner

Hai Wei

Yongjun Wu

Jeffrey P Bezos

Colin Jon Taylor

Douglas Ryan Gray

Lei Li

Amarsingh Buckthasingh Winston

Zongyi Liu

Rahul Vanam

Nandini Iyer

James Mutton

Steve Huynh

Deepthi Nandakumar

Avisar Ten-Ami

Benjamin Raphael Forman

Srinivas Rajagopalan

Prasanth Saraswatula

Andrew James McVeigh

Hani Suleiman

Ophir Hechter

Joel Peter Korpi

Snehith Alapati

Techniques for combining dynamic metadata for multiple view (multiview) video displaying are described. According to some examples, a computer-implemented method includes receiving, by a client device, a first video comprising a first set of dynamic metadata including a corresponding first color value histogram for a plurality of frames of the first video, and a second video comprising a second set of dynamic metadata including a corresponding second color value histogram for a plurality of frames of the second video; combining the first video and the second video into a combined video; generating a first combined color value histogram for a first frame of the combined video based on a first color value histogram of the first set of dynamic metadata for a first frame of the first video and a second color value histogram of the second set of dynamic metadata for a first frame of the second video, and a second different combined color value histogram for a second frame of the combined video based on a third color value histogram of the first set of dynamic metadata for a second frame of the first video and a fourth color value histogram of the second set of dynamic metadata for a second frame of the second video; performing, by a tone mapper of the client device, a tone mapping of the combined video based on the first combined color value histogram and the second different combined color value histogram to generate an output video with multiple views; and sending the output video to a display or storage.

Computer-implemented methods for combining dynamic metadata for multiple view (multiview) video displaying

Techniques are disclosed for correcting noisy clamped image sources while preserving original luma, chroma, or other channel value. A computing device can receive an image that has a plurality of pixels associated with respective channel values. The computing device can then determine a region of the image for correction and generate a histogram of the respective channel values in the region. Based on the histogram, the computing device can generate a corrected histogram of corrected channel values. The computing device can then denoise the corrected channel values.

Techniques for preserving original luma with noisy clamped sources

Methods and apparatus are described for high-resolution video encoding using spatial lapping to reduce visual discontinuities within video frames. A plurality of frame regions may be encoded to form a higher-resolution video frame. For example, a 7680×4320 video frame may be constructed from four 4096×2160 frame regions arranged into a 2×2 grid. The encoding of the frame regions may be done in parallel. The encoded frame regions may be arranged such that the frame regions lap one another at one or more overlapping regions. Encoding of border regions adjacent to the overlapping regions may be done based on an encoding parameter (e.g., quantization parameter) of pixels of an overlapping region to determine an encoding parameter of pixels of the border regions to reduce visual artifacts at seams between frame regions and overlapping regions.

Spatially lapped encoding

Techniques for a dynamic encoder-time scaling service for live and on-demand adaptive streaming are described. As one example, a computer-implemented method includes determining a first resolution for a first fragment of a video file based on a first encoding complexity of the first fragment at a bitrate, encoding the first fragment at the first resolution for the bitrate to generate an encoded first fragment, determining a second different resolution for a second fragment of the video file based on a second different encoding complexity of the second fragment at the bitrate, encoding the second fragment at the second different resolution for the bitrate to generate an encoded second fragment, receiving a request for a manifest for the video file from a client device, generating the manifest for the client device that identifies a single video representation for the bitrate that comprises the encoded first fragment and the encoded second fragment, and sending the manifest to the client device.

Dynamic encoder-time scaling service for live and on-demand adaptive streaming

Disclosed are systems and methods that detect segments of video, such as HDR video, that include content, such as edges and details in dark scenes, that cannot be presented on some displays. Output models for different display types, such as edge-lit LCD, backlit LCD, etc., may be created and used to process video with respect to those different display types to determine if segments of the video cannot be presented on the display type at the pixel brightness values indicated in the video. In some implementations, HDR video may also or alternatively be compared to SDR video to determine segments of the video that are of interest, especially in low light scenes.

Determining visibility of dark scenes in video

Techniques for applying a perceptual quantizer (PQ) electro-optical transfer function to optimize dithering and adaptive quantization for non-perceptual quantizer (e.g., SDR) color spaces are described. According to some embodiments, a computer-implemented method includes receiving a request to encode a video comprising a frame having pixels with non-perceptual quantizer code values of luminance at a content delivery service, determining, by the content delivery service, perceptual quantizer code values for the frame based at least in part on the non-perceptual quantizer code values, determining, by the content delivery service, one or more encoding parameters based at least in part on the perceptual quantizer code values, encoding, by the content delivery service, the frame based at least in part on the one or more encoding parameters into an encoded frame, and transmitting the encoded frame from the content delivery service to a viewer device.

Systems and methods for applying a perceptual quantizer electro-optical transfer function to optimize dithering and adaptive quantization for non-perceptual quantizer color spaces

Determining candidate frames

Disclosed are systems and methods to deliver media files at a highest perceived presented quality. Rather than measure quality as a difference between an encoded version of the media file and the original version of the media file, in accordance with the disclosed implementations, quality is based on a presented quality of each fragment of a media file when presented by a device to a user. The disclosed implementations determine a presented quality score for each fragment of a media file, the presented quality score indicative of a predicted quality of the fragment as perceived by a user when the fragment is presented. The presented quality score may be determined based on one or more of a bitrate used to encode the media segment, a device type of a device used to present the media segment, the content of the segment itself, etc.

Predicted presented quality metrics

Some implementations include methods for generating a portable entitlement for a digital asset and may include generating a portable entitlement to a digital asset based on a request initiated by a first user having an entitlement to the digital asset, the portable entitlement to enable the first user to access the digital asset using a second computing device of a second user, the request initiated using a first computing device of the first user, the portable entitlement having a limited lifetime; and terminating the second computing device from accessing the digital asset based on one or more of determining that a proximity between the first and second computing devices violate the distance threshold and the lifetime of the portable entitlement has expired.

Portable entitlement

Techniques for using variable refresh rate to seamlessly adapt to arbitrary and variable video frame rates are described. According to some embodiments, a computer-implemented method includes receiving, by a media player, a video entirely encoded at a fixed frame rate, decoding the encoded video into a rendered video at the fixed frame rate with a video decoder of the media player, setting a display and a display interface that is to output the rendered video to the display to a variable refresh rate mode that synchronizes a refresh rate of the display to a varying frame rate of rendered frames, sending the rendered video at the fixed frame rate from the media player to the display interface, sending the rendered video from the display interface to the display at the fixed frame rate when the display interface is in the variable refresh rate mode, and displaying the rendered video on the display at the fixed frame rate when the display is in the variable refresh rate mode.

Using variable refresh rate to seamlessly adapt to arbitrary and variable video frame rates

Techniques for emulating frequency coefficients of film grain for video (e.g., frame) encoding are described. According to some embodiments, a computer-implemented method includes receiving a request to encode a video with film grain at a content delivery service, performing a film grain synthesis on a frame of the video with film grain to generate film grain metadata for the frame and generate a degrained frame from the frame, determining film grain emulation frequency coefficients based at least in part on the film grain metadata for the frame, performing a frequency transform on the degrained frame to generate frequency coefficients for the degrained frame, encoding the frame into an encoded frame, by the content delivery service, based at least in part on the frequency coefficients for the degrained frame and the film grain emulation frequency coefficients, and transmitting the encoded frame from the content delivery service to a viewer device.

Efficient coefficient film grain synthesis for codecs without film grain synthesis

Techniques for synchronized out-of-order live video encoding are described. As one example, a computer-implemented method includes receiving a first real-time encoded live video, that is in a coded order that is different than a display order, at a content delivery service from a contribution encoder at a different location than the content delivery service, performing, in the coded order, a real-time decode of the first real-time encoded live video by a distribution decoder of the content delivery service to generate a decoded video in the coded order, performing, in the coded order, a real-time encode of the decoded video by a distribution encoder of the content delivery service to generate a second real-time encoded video in the coded order without waiting on a reordering of the decoded video into the display order, and transmitting the second real-time encoded video in the coded order to a client device.

Synchronized out-of-order live video encoding for reduced latency

Techniques for dynamic compute allocation in multiple-bitrate live video streaming are described. As one example, a computer-implemented method includes receiving a request to perform a real-time encode of a live video at a content delivery service, dynamically allocating, by the content delivery service, a set of compute resources between parallel encoders to respectively encode different renditions of the live video based at least in part on real-time usage data, performing parallel real-time encoding of each of the different renditions of the live video by the set of compute resources of the content delivery service, and transmitting at least one of the encoded different renditions of the live video from the content delivery service to a viewer device.

Dynamic compute allocation in multiple-bitrate live video

Techniques for a texture modification feature are described herein. First data identifying a position and a distance of an actor in an environment from a view point is obtained. The actor may correspond to a mesh comprised of a plurality of triangles. Second data identifying a location, an angle, and size for each triangle of the plurality of triangles with respect to a spectrum of pre-defined viewpoints is obtained. A value for each triangle may be determined based on the first data and the second data. The value may represent a level of detail to optimize viewing of each triangle of the actor from a corresponding viewpoint of the spectrum of pre-defined viewpoints. One or more areas of a texture that corresponds to the mesh may be modified prior to applying the texture to the mesh based on the associated values for triangles of the mesh.

Geometry-aware encoding of 2D elements

Embodiments include systems, methods, and computer-readable media for optimized reduced bitrate encoding for text-based content in video frames. Example methods may include determining that a first segment of video content includes a content scene, determining that a second segment of the video content includes text, and determining a first encoder configuration to encode the first segment of video content, where the first encoder configuration includes a first encoding parameter setting. Example methods may include determining a second encoder configuration to encode the second segment of the video content, where the second encoder configuration includes a second encoding parameter setting, encoding the first segment using the first encoder configuration, and encoding the second segment using the second encoder configuration. The first segment may be encoded at a first bitrate that is greater than a second bitrate at which the second segment is encoded.

Growing community of inventors

Portland, OR, United States of America

Charles Benjamin Waggoner