The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Sep. 16, 2025
Filed:
Jul. 23, 2021
Beijing Bytedance Network Technology Co., Ltd., Beijing, CN;
Beijing Bytedance Network Technology Co., Ltd., Beijing, CN;
Abstract
Disclosed are a language representation model system, a language representation model pre-training method, a natural language processing method, an electronic device, and a storage medium. The language representation model system includes: a word granularity language representation sub-model based on segmentation in units of words, and a phrase granularity language representation sub-model based on segmentation in units of words. The word granularity language representation sub-model is configured to output, based on a sentence segmented in units of words, a first semantic vector corresponding to a semantic expressed by each segmented word in the sentence. The phrase granularity language representation sub-model is configured to output, based on the sentence segmented in units of phrases, a second semantic vector corresponding to a semantic expressed by each segmented phrase in the sentence.