Ting Hua

Title: Innovations by Inventor Ting Hua

Introduction

Ting Hua is an accomplished inventor based in Cupertino, California. He has made significant contributions to the field of technology, particularly in the development of transformer models for various tasks. His innovative approach has led to the creation of a unique patent that showcases his expertise and creativity.

Latest Patents

Ting Hua holds a patent for a "Small and fast transformer model for multi-modal or other tasks." This patent describes a method that includes obtaining a weight matrix associated with a trained transformer model using a first electronic device. The method involves factorizing the weight matrix into a dictionary weight matrix and an intermediate matrix. It also includes pruning the intermediate matrix to generate a sparse intermediate matrix. Furthermore, the method fine-tunes the sparse intermediate matrix based on a training dataset to create a fine-tuned sparse intermediate matrix. The process continues with determining an index matrix and a coefficient matrix based on the fine-tuned sparse intermediate matrix. Notably, the deployment of the dictionary weight matrix, the index matrix, and the coefficient matrix to a second electronic device occurs without deploying the weight matrix itself. The number of parameters in the dictionary weight matrix, the index matrix, and the coefficient matrix is smaller than that in the original weight matrix.

Career Highlights

Ting Hua is currently employed at Samsung Electronics Co., Ltd., where he continues to push the boundaries of technology through his innovative work. His dedication to research and development has positioned him as a key player in the tech industry.

Collaborations

Ting has collaborated with talented individuals such as Qian Lou and Yen-Chang Hsu, who contribute to the dynamic environment of innovation at Samsung Electronics.

Conclusion

Ting Hua's contributions to the field of technology, particularly through his patent on transformer models, highlight his innovative spirit and expertise. His work continues to influence advancements in multi-modal tasks and showcases the importance of collaboration in driving innovation forward.