Liang-yu Chen

Title: The Innovations of Liang-yu Chen

Introduction

Liang-yu Chen is an inventive mind based in Sunnyvale, CA. He has made significant strides in the field of multimodal technologies. His work focuses on generating and utilizing multimodal embeddings and enhancing human-computer interactions through advanced language models.

Latest Patent Applications

Liang-yu Chen has filed several notable patent applications. One of his latest applications is titled "MULTIMODAL EMBEDDINGS." This implementation relates to generating and using multimodal embeddings. In various implementations, first modality data may be obtained and encoded into first modality embedding(s) using a trained first modality encoder that is stored in memory of edge-based client device(s). Second modality data may be obtained and encoded into second modality embedding(s) using a trained second modality encoder that is also stored in the memory of the edge-based client device(s). The first and second modality embeddings may be processed using an edge-based multimodal LLM that is also stored locally in memory of the edge-based client device(s) to generate a multimodal contextual embedding, which may be provided to a remote server that hosts a central LLM, e.g., in conjunction with a natural language input provided by the user. Information generated using the central LLM, responsive to the natural language input, may be received from the remote server. Another application is "MULTIMODAL DIALOGS USING LARGE LANGUAGE MODEL(S) AND VISUAL LANGUAGE MODEL(S)." This implementation relates to leveraging large language model(s) (LLMs) and vision language model(s) (VLMs) to facilitate human-to-computer dialogs. In various implementations, one or more digital images may be processed using one or more VLMs to generate VLM output indicative of a state of an environment. An LLM prompt may be assembled based on the VLM output and a natural language input. The LLM prompt may be processed using one or more LLMs to generate content that is responsive to the natural language input. The content that is responsive to the natural language input may subsequently be rendered at one or more output devices.

Conclusion

Liang-yu Chen is an innovative inventor whose work in multimodal technologies is paving the way for advanced human-computer interactions. His latest patent applications reflect his commitment to enhancing the capabilities of language models and their applications in real-world scenarios.