Location History:
- Warren, NJ (US) (2010 - 2011)
- Beijing, CN (2010 - 2017)
Company Filing History:
5 out of 54,789 
1 out of 125 Years Active: 2010-2017
Title: Frank Soong: Innovator in Photorealistic Synthesis
Introduction
Frank Soong is a prominent inventor based in Beijing, China. He holds a total of 6 patents that focus on advanced audiovisual technologies. His work primarily revolves around the synthesis of photorealistic images and animations that synchronize lip movements and facial features with speech.
Latest Patents
One of his latest patents is titled "Photo-realistic synthesis of image sequences with lip movements synchronized with speech." This innovation involves obtaining and storing audiovisual data of an individual reading a known script in both an audio library and an image library. The data is processed to extract feature vectors that train a statistical model. An input audio feature vector is then provided, which corresponds to the desired speech. The statistical model generates a trajectory of visual feature vectors that match the input audio feature vector. This results in a sequence of images that provides a photorealistic image sequence with synchronized lip movements.
Another significant patent is "Photo-realistic synthesis of three-dimensional animation with facial features synchronized with speech." This invention utilizes dynamic texture mapping to create a photorealistic three-dimensional animation of an individual. Similar to the previous patent, audiovisual data is obtained and processed to train a statistical model. The resulting animation features synchronized facial movements, including lip movements, that align with the desired speech.
Career Highlights
Frank Soong has worked with notable companies such as Microsoft Technology Licensing, LLC and Microsoft Corporation. His contributions to these organizations have significantly advanced the field of audiovisual technology.
Collaborations
Some of his coworkers include Lijuan Wang and Shi Han, who have collaborated with him on various projects.
Conclusion
Frank Soong's innovative work in photorealistic synthesis has made a substantial impact on the field of audiovisual technology. His patents demonstrate a commitment to enhancing the synchronization of visual and audio elements, paving the way for future advancements in this area.