Company Filing History:
Years Active: 2025
Title: Innovations of Jianmo Ni in Language Models
Introduction
Jianmo Ni is an accomplished inventor based in Santa Clara, CA (US). He has made significant contributions to the field of language models, particularly through his innovative patent. His work focuses on enhancing the capabilities of language models by integrating relevant world knowledge.
Latest Patents
Jianmo Ni holds a patent titled "Soft knowledge prompts for language models." This technology employs soft knowledge prompts (KPs) to inject relevant world knowledge into language models. The method involves training KPs via self-supervised learning on data from one or more knowledge bases. KPs are designed to be task-independent and can function as an external memory for language models. They may be entity-centric, meaning that each prompt primarily encodes information about one entity from a given knowledge base. The process includes identifying a KP in response to a received input text, concatenating that KP to a sequence of word embeddings of the input text, applying the concatenated information to a trained language model, predicting an object entity name, computing a cross-entropy loss, and updating the identified KP based on the computed cross-entropy loss.
Career Highlights
Jianmo Ni is currently employed at Google Inc., where he continues to push the boundaries of technology in language processing. His work has garnered attention for its innovative approach to integrating knowledge into language models, making them more effective and versatile.
Collaborations
Some of Jianmo Ni's notable coworkers include Siamak Shakeri and Cicero Nogueira Dos Santos. Their collaborative efforts contribute to the advancement of research and development in the field of artificial intelligence and language processing.
Conclusion
Jianmo Ni's contributions to language models through his patent on soft knowledge prompts exemplify the innovative spirit of modern inventors. His work at Google Inc. and collaborations with talented colleagues further enhance the impact of his inventions in the technology landscape.