Yunfan Ye

Title: Yunfan Ye - Innovator in Multimodal Technologies

Introduction

Yunfan Ye is an inventive mind based in Sunnyvale, CA (US). He is focused on advancing the field of multimodal technologies, particularly through the development of innovative applications that leverage large language models and visual language models. His work aims to enhance human-computer interactions by integrating various modalities of data.

Latest Patent Applications

Yunfan Ye has submitted several notable patent applications, including:

1. **MULTIMODAL EMBEDDINGS** - This application relates to generating and using multimodal embeddings. It involves obtaining first modality data and encoding it into first modality embeddings using a trained first modality encoder stored in the memory of edge-based client devices. Additionally, second modality data is obtained and encoded into second modality embeddings using a trained second modality encoder. The embeddings are processed using an edge-based multimodal LLM to generate a multimodal contextual embedding, which can be sent to a remote server hosting a central LLM.

2. **MULTIMODAL DIALOGS USING LARGE LANGUAGE MODEL(S) AND VISUAL LANGUAGE MODEL(S)** - This application focuses on leveraging LLMs and VLMs to facilitate human-to-computer dialogs. It involves processing digital images with VLMs to generate outputs indicative of an environment's state. An LLM prompt is then assembled based on the VLM output and natural language input, which is processed to generate responsive content that can be rendered on output devices.

Conclusion

Yunfan Ye is an emerging inventor whose work in multimodal technologies holds promise for enhancing interactions between humans and computers. His latest patent applications reflect his innovative approach to integrating various data modalities for improved user experiences.