Heng Yu

Title: The Innovative Mind of Heng Yu

Introduction

Heng Yu is a prominent inventor based in Los Angeles, CA. He has made significant contributions to the field of technology, particularly in the area of scene generation. His innovative approach combines advanced methodologies to create immersive experiences.

Latest Patents

Heng Yu holds a patent for "Photorealistic 4D scene generation using video diffusion models." This method allows for the generation of photorealistic 4D scenes from text inputs. It utilizes a text-to-video diffusion model to create both a reference video and a freeze-time video. A canonical 3D representation is reconstructed using deformable 3D Gaussian Splats (D-3DGS) based on the freeze-time video. The method captures dynamic interactions through learned temporal deformations in the reference video. A novel Score Distillation Sampling strategy enhances consistency and robustness by combining multi-view and temporal aspects. The resulting 4D scenes feature multiple objects interacting within detailed background environments, viewable from various angles and times. This method also enables flexible camera control and integration with augmented and virtual reality applications, including features such as image-to-4D generation.

Career Highlights

Heng Yu is currently employed at Snap Inc., where he continues to push the boundaries of technology and innovation. His work has garnered attention for its potential applications in various fields, including entertainment and education.

Collaborations

Heng Yu collaborates with talented individuals in his field, including his coworker Hsin-Ying Lee. Their combined expertise contributes to the advancement of innovative technologies.

Conclusion

Heng Yu's contributions to the field of photorealistic scene generation exemplify the power of innovation in technology. His work not only enhances visual experiences but also opens new avenues for augmented and virtual reality applications.