Yulong Pei

Title: Yulong Pei: Innovator in Visually Rich Document Understanding

Introduction

Yulong Pei is a notable inventor based in Eindhoven, Netherlands. He has made significant contributions to the field of document understanding through his innovative patent. His work focuses on enhancing the capabilities of language models to better interpret visually rich documents.

Latest Patents

Yulong Pei holds a patent titled "System and method for layout-aware generative pretraining for visually rich document understanding." This patent discloses various methods and processes, apparatuses/systems, and media for performing spatial-aware reading for visual documents. The invention involves a processor that implements a language model, modifies existing parameters and architecture to incorporate new parameters, and integrates a disentangled spatial attention process. The modified model is pretrained using an autoregressive block infilling process on multiple document pages, which trains the new parameters while adjusting the existing ones. The model is then instruction-tuned on data from various visually rich document understanding datasets, enabling it to follow document-oriented instructions or answer questions about documents by leveraging their content and spatial layout.

Career Highlights

Yulong Pei is currently employed at JPMorgan Chase Bank, N.A., where he applies his expertise in document understanding and language models. His innovative approach has positioned him as a key player in the development of advanced technologies in this domain.

Collaborations

Yulong has collaborated with notable colleagues such as Dongsheng Wang and Natraj Raman. Their combined efforts contribute to the advancement of technologies in visually rich document understanding.

Conclusion

Yulong Pei's work in the field of visually rich document understanding showcases his innovative spirit and dedication to enhancing language models. His contributions are paving the way for more effective document processing technologies.