Samsung Electronics Co., Ltd.

Woohyun Nam

Yangwook Kim

Seungho Lee

Sunghee Hwang

Hyunkwon Chung

Yoonjae Son

Tammy Lee

Sangchul Ko

Kyungrae Kim

Jungkyu Kim

Sunmin Kim

A video processing apparatus includes a memory storing instructions, and at least one processor configured to execute the instructions to generate a plurality of feature information by analyzing a video signal comprising a plurality of images based on a first DNN, extract a first altitude component and a first planar component corresponding to a movement of an object in a video from the video signal based on a second DNN, extract a second planar component corresponding to a movement of a sound source in audio from a first audio signal based on a third DNN, generate a second altitude component based on the first altitude component, the first planar component, and the second planar component, output a second audio signal comprising the second altitude component based on the feature information, and synchronize the second audio signal with the video signal and output the synchronized second audio signal and video signal.

Video processing device and method

An electronic apparatus is provided. The electronic apparatus includes a camera, a processor and a memory configured to store at least one instruction executable by the processor where and the processor is configured to input input audio data to an artificial intelligence model corresponding to user information, and obtain output audio data from the artificial intelligence model, and the artificial intelligence model is a model learned based on first learning audio data obtained by recording a sound source with a first recording device, second learning audio data obtained by recording the sound source with a second recording device, and information on a recording device for obtaining the second learning audio data, and the second learning audio data is binaural audio data.

Electronic apparatus and controlling method thereof

An apparatus for processing audio includes at least one processor configured to obtain a down-mixed audio signal from a bitstream, to obtain down-mixing-related information from the bitstream, to de-mix the down-mixing-related information by using down-mixing-related information, and to reconstruct an audio signal including at least one frame based on the de-mixed audio signal. The down-mixing-related information is information generated in units of frames by using an audio scene type.

Apparatus and method for processing multi-channel audio signal

A method of matching a voice for each object included in a video, includes: separating a plurality of voices in a video; determining a dissimilarity between the plurality of voices; selecting a partial duration in an entire duration of the video as a matching duration, based on the dissimilarity between the plurality of voices; matching, within the matching duration, the plurality of voices with a plurality of objects in the video respectively, based on mouth movements of the plurality of objects; and matching the plurality of voices with the plurality of objects respectively in the entire duration of the video, based on results of the matching between the plurality of voices and the plurality of objects within the matching duration.

Method of matching sound source for each object included in video, and computing device for performing the same

According to various embodiments of the disclosure, an audio processing apparatus includes at least one processor configured to execute one or more instructions to obtain a second audio signal down-mixed from at least one first audio signal, obtain information related to error removal for the at least one first audio signal, de-mix the at least one first audio signal from the down-mixed second audio signal, and reconstruct the at least one first audio signal by applying the information related to the error removal for the at least one first audio signal to the at least one first audio signal de-mixed from the second audio signal. The information related to the error removal having been generated using at least one of an original signal power of the at least one first audio signal or a second signal power of the at least one first audio signal after decoding.

An electronic apparatus is provided. The electronic apparatus includes a camera, a processor and a memory configured to store at least one instruction executable by the processor where and the processor is configured to input audio data to an artificial intelligence model corresponding to user information, and obtain output audio data from the artificial intelligence model, and the artificial intelligence model is a model learned based on first learning audio data obtained by recording a sound source with a first recording device, second learning audio data obtained by recording the sound source with a second recording device, and information on a recording device for obtaining the second learning audio data, and the second learning audio data is binaural audio data.

An audio processing apparatus may obtain second audio signals corresponding to channels included in a second channel group from first audio signals corresponding to channels included in a first channel group, downsample at least one third audio signal corresponding to at least one channel identified based on a correlation with the second channel group from among the channels included in the first channel group, by using an artificial intelligence (AI) model, and generate a bitstream including the second audio signals corresponding to the channels included in the second channel group and the downsampled at least one third audio signal. The first channel group includes a channel group of an original audio signal, and the second channel group is constructed by combining at least two channels from among the channels included in the first channel group.

Apparatus and method for processing audio

Provided are an artificial intelligence (AI) system using a machine learning algorithm such as deep learning and an application of the AI system. Provided is a method of converting sound data, the method including acquiring binaural sound data; converting the binaural sound data by using a pre-generated training network model, based on a parameter indicating a context at a time of acquiring the binaural sound data; and outputting the converted binaural sound data.

Method, terminal and terminal case for converting sound data

Disclosed is an electronic apparatus. The electronic apparatus includes: a camera; a first microphone; a second microphone; and a processor configured to: control the electronic apparatus to obtain first sound data through the first microphone, control the electronic apparatus to obtain second sound data through the second microphone, identify an object corresponding to the first sound data and the second sound data in image data obtained through the camera, obtain position information of the identified object from the image data, and change volume information of at least one of the first sound data or the second sound data based on the obtained position information.

Growing community of inventors

Suwon-si, South Korea

Woohyun Nam