Korea Advanced Institute of Science and Technology

S2w Inc.

Jian Cui

Yong Jae Lee

Seung Won Shin

Chang Hoon Yoon

Jin Woo Chung

Young Jin Jin

Da Yeon Yim

Eu Gene Jang

Provided is a system for training a language model for cybersecurity, which includes: a document collection unit that collects a cybersecurity document used for training a language model for cybersecurity; an extraction unit that identifies non-linguistic elements in the cybersecurity document based on a non-linguistic element database; a tokenization unit that tokenizes the cybersecurity document to generate a plurality of tokens; and a language model application unit that controls the language model to simultaneously perform a first task of classifying types of the non-linguistic elements including at least one of a Bitcoin address, a hash value, an IP address, and a vulnerability identifier included in the cybersecurity document and a second task of recovering only linguistic elements of the cybersecurity document.

Method of training language model for cybersecurity and system performing the same

Growing community of inventors

Bloomington, IN, United States of America

Jian Cui