Tsinghua University

Hyundai Motor Company

Kia Corporation

Liangrui Peng

Gang Yao

Shanyu Xiao

Ruijie Yan

Shengjin Wang

Jong Ub Suk

Chi Fang

Xiaoqing Ding

Jaesik Min

Xuewen Wang

Changsong Liu

A method and a system for detecting a scene text may include extracting a first feature map for a scene image input based on a convolutional neural network, and delivering the first feature map to a sequential deformation module; obtaining sampled feature maps corresponding to sampling positions by performing iterative sampling for the first feature map, obtaining a second feature map by performing a concatenation operation in deep learning according to a channel dimension for the first feature map and the sampled feature maps; obtaining a third feature map by performing a feature aggregation operation for the second feature map in the channel dimension, and delivering the third feature map to the object detection baseline network; and performing text area candidate box extraction for the third feature map and obtaining a text area prediction result as a scene text detection result through regression fitting.

Scene text detection method and system based on sequential deformation

A method of multi-directional scene text recognition based on multi-element attention mechanism include: performing normalization processing for a text row/column image output from an external text detection module by a feature extractor, extracting a feature for the normalized image by using a deep convolutional neural network to acquire an initial feature map, adding a 2-dimensional directional positional encoding P to the initial feature map in order to output a multi-channel feature map, converting the multi-channel feature map output from a feature extractor by an encoder into a hidden representation, and converting the hidden representation output from the encoder into a recognized text by a decoder and using the recognized text as the output result.

Multi-directional scene text recognition method and system based on multi-element attention mechanism

In a method for character recognition based on Gabor filter group the Gabor filter's joint spatial/spatial-frequency localization and capability to efficiently extract characters' local structural features are employed to extract, from the character image, information of the stroke direction of characters as the recognition information of characters, so as to improve the capability to resist the noises, backgrounds, brightness variances in images and the deformation of characters. Using this information, a simple and effective parameter design method is put forward to optimally design the Gabor filter, ensuring a preferable recognition performance; a corrected Sigmoid function is used to non-linearly adaptively process the stroke direction information output from the Gabor filter group. When extracting the feature from blocks, Gaussian filter array is used to process the positive and negative values output from Gabor filter group to enhance the discrimination ability of the extracted features.

Method for character recognition based on gabor filters

Growing community of inventors

Beijing, China

Liangrui Peng