Company Filing History:
Years Active: 2024-2025
Title: Innovations of Yang Zhao in Language Modeling
Introduction
Yang Zhao is a prominent inventor based in Tokyo, Japan. He has made significant contributions to the field of language modeling, holding 2 patents that showcase his innovative approaches. His work primarily focuses on improving mono-lingual language models through advanced computational methods.
Latest Patents
Yang Zhao's latest patents include "Mono-lingual language models using parallel data" and "Dependency tree-based data augmentation for sentence well-formedness judgement." The first patent provides systems, computer-implemented methods, and computer program products designed to enhance a mono-lingual language model using pre-trained models and parallel data. This system comprises a processor executing components stored in memory, including a training component that utilizes a first language model to improve a mono-lingual second language model through mask language modeling (MLM) training and contrastive learning. Additionally, it features a data component that collects parallel data for both language models and a tokenizing component that tokenizes this data. An alignment component is also included to create an alignment of the tokenized parallel data.
The second patent focuses on a computer-implemented method for dependency tree-based data augmentation for sentence well-formedness judgement. In this method, a computer applies a dependency parser to generate a dependency tree for a sentence. It then removes one or more nodes in the dependency tree based on a predetermined removal ratio for a rating score. The computer generates a partial tree for the sentence and outputs a rated sentence based on this partial tree, which is used as training data.
Career Highlights
Yang Zhao is currently employed at International Business Machines Corporation (IBM), where he continues to develop innovative solutions in language processing. His work has garnered attention for its practical applications in enhancing language models.
Collaborations
Yang has collaborated with notable coworkers, including Masayasu Muraoka and Issei Yoshida, contributing to a dynamic and innovative work environment.
Conclusion
Yang Zhao's contributions to language modeling through his patents reflect his expertise and commitment to advancing technology in this field. His innovative methods are paving the way for future developments in language processing.