Samsung Sds Co., Ltd.

Ju-Dong Kim

Hyun-Jin Choi

Hyun-Jae Lee

Jae-Woong Yun

Bong-Kyu Hwang

Seong-Ho Joe

Young-June Gwon

An apparatus for processing natural language according to an embodiment includes a collection module that collects documents having tags, a parsing module that extracts text from the collected documents and extracts tag-related information on the tag surrounding each extracted text, and a preprocessing module that generates tokens of a preset unit by tokenizing each extracted text, generates token position information for each token in full text of the document, and sets the token and the token position information as training data in matching with the tag-related information.

Apparatus and method for processing natural language

An apparatus for training a document summarization model includes a token generation unit, a named entity recognition unit, and a model training unit. The token generation unit generates document tokens and summarization tokens. The named entity recognition unit assigns named entity token status to a summarization token, recognized as a named entity through NER, and assigns non-named entity token status to the other tokens. The model training unit obtains feature vectors by inputting the plurality of document tokens into an encoder inside a document summarization model, obtains a first loss related to the named entity token, a second loss related to the other tokens, and a total loss using a weighted value by inputting the feature vectors, the summarization tokens, the named entity token, and the non-named entity token into a decoder inside the document summarization model, and trains the document summarization model on the basis of the total loss.

Apparatus and method for training model for document summarization

Growing community of inventors

Seoul, South Korea

Ju-Dong Kim