Samsung Electronics Co., Ltd.

Seongnam Oh

Soojung Hyun

Hunsop Hong

William Mandel

Sunil Bharitkar

Carlos Tejeda Ocampo

Yeong-Taeg Kim

Li Tao

Allan O Devantier

Berkay Kanberoglu

One embodiment provides a method of audio upmixing comprising performing video scene analysis by segmenting visual objects from video frames of a video, and performing audio analysis by extracting audio signals from an audio corresponding to the video. The method further comprises determining whether any of the audio signals correspond to any of the visual objects, and estimating a video-based trajectory of a visual object if the visual object is in motion and transitions from on-screen to off-screen, or vice versa, during the video. The method further comprises positioning an audio trajectory of an audio signal from at least one speaker associated with the display to at least one other speaker associated with providing surround sound. The audio trajectory is automatically matched with the video. The audio signal is delivered to the at least one speaker and the at least one other speaker for audio reproduction during the presentation.

Surround sound to immersive audio upmixing based on video scene analysis

One embodiment provides a method comprising generating, via an edge detection algorithm, a first edge map based on a first frame of an input content comprising a sequence of frames. The method further comprises generating, via the edge detection algorithm, a second edge map based on a second frame of the input content. The first frame precedes the second frame in the sequence of frames. The method further comprises determining a difference between the first edge map and the second edge map, determining a metric indicative of an estimated amount of judder present in the input content based on the difference, and dynamically adjusting a frame rate of the input content based on the metric. The input content is displayed on a display device at the adjusted frame rate.

Judder detection for dynamic frame rate conversion

One embodiment provides a computer-implemented method that includes creating, during content production, an audio object and metadata associated with the audio object based on a motion vector analysis of an object in one or more image frames in a video. The method can include, during the content production, inserting the audio object and the metadata associated with the audio object into at least one of an audio encoder or a video encoder. The method can include, during content playback, rendering the audio object, without image frame analysis, based on decoding the audio object and parsing the metadata associated with the audio object.

Video-derived audio processing

One embodiment provides a method comprising acquiring 3D content comprising a 3D object in 3D space. The 3D object has object information indicative of a location of the 3D object in the 3D space. The method further comprises projecting the 3D object to a 2D object in 2D space based on the object information. The 2D object has one or more 2D vertices indicative of a location of the 2D object in the 2D space. The method further comprises determining one or more latent variables in the 2D space based on the object information and the one or more 2D vertices, and generating a 2D feature database including the one or more latent variables.

Two-dimensional (2D) feature database generation

A computer-implemented method includes performing analysis to determine information associated with a high dynamic range (HDR) media content item. A standard dynamic range (SDR) version of the HDR media content item is derived using HDR metadata. The derivation including encoding the HDR media content item to SDR content and normalizing data of the SDR content. The HDR metadata and the SDR version of the HDR media content item are transmitted with embedding of the HDR metadata within a protocol with the SDR version to a storage service. The HDR metadata and the SDR version are caused to be received at a display device. The SDR version is converted to HDR per incremental portion with a dynamic range bounded based on the HDR metadata of the protocol.

Standard dynamic range (SDR) / hybrid log-gamma (HLG) with high dynamic range (HDR) 10+

One embodiment provides a method comprising segmenting an input video into a first video chunk and one or more subsequent video chunks. The method further comprises, for each subsequent video chunk, generating a corresponding window of overlapped frames by selecting a subsequence of frames from a different video chunk immediately preceding the subsequent video chunk. The method further comprises generating metadata corresponding to each video chunk by processing each video chunk in parallel. Each subsequent video chunk is processed based in part on a corresponding window of overlapped frames. The method further comprises, for each subsequent video chunk, discarding a portion of metadata corresponding to the subsequent video chunk, where the portion discarded is specific to a corresponding window of overlapped frames. The method further comprises merging each video chunk into a single output video. Each video chunk merged is associated with any remaining corresponding metadata.

Parallel metadata generation based on a window of overlapped frames

A computer-implemented method includes accessing a high dynamic range (HDR) media content item. Statistical analysis is performed to determine statistical information associated with the HDR media content item at each incremental portion of the HDR media content item. Metadata for each incremental portion of the HDR media content item is generated. A standard dynamic range (SDR) version of the content is derived using the HDR metadata. The metadata and an SDR version of the HDR media content item is transmitted to a storage service. The metadata and the SDR version are caused to be received at a display device. The SDR version is converted to HDR with a dynamic range bounded based on the metadata.

A method for video tone mapping includes receiving an overlay indication from an input data stream indicating whether a graphic is being overlaid on image data for a High Dynamic Range (HDR) scene. Based on the overlay indication, a hardware processor processes a video stream using a first tone mapping function to generate a first tone mapped video, or a second tone mapping function to generate a second tone mapped video.

Adaptive high dynamic range (HDR) tone mapping with overlay indication

A method for content rendering in a clustered display network. The method includes assigning a role to each of multiple client display devices by a distributing display device. A rendering responsibility for each of the client display devices is assigned by the distributing display device. Received content is fed, by the distributing display device, to one or more display groups each including at least a portion of the client display devices.

Growing community of inventors

Irvine, CA, United States of America

Seongnam Oh