Tencent America LLC

Wenlin Yao

Dong Yu

Jianshu Chen

Hongming Zhang

Xiaoman Pan

There is included a method and apparatus comprising computer code for instance-wise adaptive knowledge injection in a pre-trained language model (PTLM) including determining a necessity of external knowledge in a plurality of queries of a first dataset based on a likelihood that a respective query is solved by internal knowledge of a target model. Then, the one or more queries determined to need external knowledge may be augmented with pieces of external knowledge. A combined dataset may be generated by combining the first dataset and the one or more augmented queries, and the combined dataset may be applied to the target model.

Growing community of inventors

Mill Creek, WA, United States of America

Wenlin Yao