Korea Electronics Technology Institute

Choong Sang Cho

Young Han Lee

Hwa Seon Shin

Byeong Ho Choi

Hye Dong Jung

Je Woo Kim

Yong Hwan Kim

Charles Hyok Song

Joo Hyung Kang

Min Seok Park

Jong Yeol Yang

Sang Ki Ko

Dong Sun Kim

Bo Eun Kim

Ju Hong Yoon

Seung Yerl Lee

Sang Seol Lee

There is provided a self-directed visual intelligence system, The self-directed visual intelligence system according to an embodiment prepares data necessary for training a visual intelligence model when a change in a visual context of a real world is recognized, configures a visual intelligence model and configures training data of the visual intelligence model, based on the changed visual context of the real world, trains the configured visual intelligence model with the training data, and evaluates performance of the trained visual intelligence model. Accordingly, the visual intelligence model is corrected/improved in a self-directed way according to a change in a visual context of a real world, and is grown/advanced by itself, so that performance of the visual intelligence model is maintained in a best state even in response to any change in the context of the real world.

Self-directed visual intelligence system

There are provided a method and a system for image segmentation utilizing a GAN architecture. A method for training an image segmentation network according to an embodiment includes: inputting an image to a first network which is trained to output a region segmentation result regarding an input image, and generating a region segmentation result; and inputting the region segmentation result generated at the generation step and a ground truth (GT) to a second network, and acquiring a discrimination result, the second network being trained to discriminate inputted region segmentation results as a result generated by the first network and a GT, respectively; and training the first network and the second network by using the discrimination result. Accordingly, region segmentation performance of a semantic segmentation network regarding various images can be enhanced, and a very small image region can be exactly segmented.

Image segmentation method and system using GAN architecture

An image region segmentation method and system suing self-spatial adaptive normalization is provided. The image region segmentation system includes: an encoder configured to encode an image for segmenting a region by using a plurality of encoding blocks; and a decoder configured to decode the image encoded by the encoder and to generate a region-segmented image by using a plurality of decoding blocks, wherein each of the encoding blocks processes an inputted image into a convolution layer, performs spatial adaptive normalization, and then reduces the image and delivers the image to the next encoding block. Accordingly, spatial characteristics of the image are considered in an encoding process and a decoding process, so that region segmentation can be exactly performed with respect to various images.

Image region segmentation method and system using self-spatial adaptive normalization

An audio segmentation method based on an attention mechanism is provided. The audio segmentation method according to an embodiment obtains a mapping relationship between an 'inputted text' and an 'audio spectrum feature vector for generating an audio signal', the audio spectrum feature vector being automatically synthesized by using the inputted text, and segments an inputted audio signal by using the mapping relationship. Accordingly, high quality can be guaranteed and the effort, time, and cost can be noticeably reduced through audio segmentation utilizing the attention mechanism.

Audio segmentation method based on attention mechanism

An audio synthesis method adapted to video characteristics is provided. The audio synthesis method according to an embodiment includes: extracting characteristics x from a video in a time-series way; extracting characteristics p of phonemes from a text; and generating an audio spectrum characteristic Sused to generate an audio to be synthesized with a video at a time t, based on correlations between an audio spectrum characteristic S, which is used to generate an audio to be synthesized with a video at a time t&#x2212;1, and the characteristics x. Accordingly, an audio can be synthesized according to video characteristics, and speech according to a video can be easily added.

Method for audio synthesis adapted to video characteristics

Deep learning-based automatic gesture recognition method and system are provided. The training method according to an embodiment includes: extracting a plurality of contours from an input image; generating training data by normalizing pieces of contour information forming each of the contours; and training an AI model for gesture recognition by using the generated training data. Accordingly, robust and high-performance automatic gesture recognition can be performed, without being influenced by an environment and a condition even while using less training data.

Deep learning-based automatic gesture recognition method and system

The present disclosure relates to a method and system for controlling loudness of an audio based on signal analysis and deep learning. The method includes analyzing an audio characteristic in a frame level based on signal analysis, analyzing the audio characteristic in the frame level based on learning, and controlling loudness of the audio in the frame level, by combining the analysis results. Accordingly, reliability of audio characteristic analysis can be enhanced and audio loudness can be optimally controlled.

Audio loudness control method and system based on signal analysis and deep learning

A method and a system for automatic image caption generation are provided. The automatic image caption generation method according to an embodiment of the present disclosure includes: extracting a distinctive attribute from example captions of a learning image; training a first neural network for predicting a distinctive attribute from an image, by using a pair of the extracted distinctive attribute and the learning image; inferring a distinctive attribute by inputting the learning image to the trained first neural network; and training a second neural network for generating a caption of an image by using a pair of the inferred distinctive attribute and the learning image. Accordingly, a caption well indicating a feature of a given image is automatically generated, such that an image can be more exactly explained and a difference from other images can be clearly distinguished.

Method and system for automatic image caption generation

Provided herein is a robust region segmentation method and a system using the same, the method including receiving setting of an image in an input image; calculating representative values for each of an internal portion and an external portion of the region; calculating a cost by substituting the representative values and a pixel value of the image in a cost function, and updating the region based on the calculated cost, wherein the cost function includes a term in which a difference between the updated pixel value and an original pixel value is reflected, thereby enabling an accurate region segmentation even in ambiguous images that are complicated and where division of regions is unclear.

Robust region segmentation method and system using the same

Provided herein is a topological derivatives (TDs)-based image segmentation method and system using heterogeneous image features data. The image segmentation method according to an embodiment of the present disclosure involves calculating TDs having each of the heterogeneous image features data as an input value, and segmenting an image into a plurality of regions using the calculated TDs. Accordingly, performance may be improved, and robustness against noise may be further improved.

Topological derivative-based image segmentation method and system with heterogeneous image features

The present invention relates to a multimedia-data-processing method which enables a media graph to always be constructed in a 'connection without negotiation' manner, on the basis of an already known media graph construction, and thus provides a media framework in which procedures for connecting components are minimized, thereby improving the performance of a system and satisfying the requests of an OS platform builder and a media application developer. The multimedia-data-processing method of the present invention is performed by a multimedia framework, and comprises: (a) a step of receiving component information required for the construction of the media graph and component connection information from a media application; and (b) a step of ensuring that the media graph is constructed by the content received in step (a), and that the media graph waits for a rendering command, thereby eliminating the necessity of permitting the media application to check the construction of the media graph.

Multimedia-data-processing method

A method for separating audio sources and an audio system using the same are provided. The method introduces the concept of a residual signal to separate a mixed audio signal into audio sources, and separates an audio signal corresponding to at least two of the audio sources as a residual signal and processes the audio signal separately. Therefore, audio separation performance can be improved. In addition, the method re-separates a separated residual signal and adds the separated residual signals to corresponding audio sources. Therefore, audio sources can be separated more safely.

Method for separating audio sources and audio system using the same

Disclosed is a multimedia data processing method by a framework, in which the framework is capable of directly controlling data input and output of components in a state of the framework being interposed between the components and an application program, thereby reducing the time and effort involved in developing the components or the application program.

Multimedia data processing method

Disclosed is an apparatus for playing and producing realistic object audio. The apparatus for playing realistic object audio includes: a deformatter unit individually separating scene description (SD) compression data and object audio compression data from inputted audio files; an SD decoding unit decoding the SD compression data to restore SD information; an object audio decoding unit decoding the object audio compression data to restore object audio signals which are respective audio signals of a plurality of objects; and an object audio effect unit adding an audio effect for each object to the object audio signals according to SD information for each object corresponding to the object audio signals among the SD information to produce a realistic object audio signal corresponding to each of the object audio signals.

Apparatus for playing and producing realistic object audio

The present invention provides a new recursive FIR filter scheme which supports a variable order short-term predictor, and uses a pipeline stall based on the radix-2 algorithm and an autocorrelation processing time for reducing the complexity of MPEG-4 ALS hardware implementation.

Growing community of inventors

Seongnam-si, South Korea

Choong Sang Cho