Company Filing History:
Years Active: 2020-2021
Title: Innovations of Huaizu Jiang in Scene Flow Estimation and Video Interpolation
Introduction
Huaizu Jiang is a prominent inventor based in Amherst, MA, known for his contributions to the fields of computer vision and video processing. He has been instrumental in developing technologies that enhance the understanding of motion and depth in video sequences. With a total of 2 patents, his work is particularly relevant in the context of autonomous driving and video interpolation.
Latest Patents
One of Huaizu Jiang's latest patents is titled "Scene flow estimation using shared features." This innovation focuses on representing the three-dimensional (3D) structure and movement of objects in a video sequence. The technology utilizes a neural network system to track objects and estimate their speeds, which is crucial for autonomous driving applications. The system captures video sequences from at least two viewpoints, such as a left-eye and right-eye perspective. An encoder extracts features from the frames, which are then processed by decoders to predict optical flow and disparity, ultimately representing the scene flow.
Another significant patent is "Multi-frame video interpolation using optical flow." This invention aims to predict intermediate frames between two consecutive frames in a video. A first neural network model approximates the optical flow data, while a second model refines this data and predicts visibility maps for each timestep. The consecutive frames are warped according to the refined optical flow, producing pairs of warped frames. The second model then fuses these frames based on visibility maps to create the intermediate frames, effectively reducing artifacts caused by motion boundaries and occlusions.
Career Highlights
Huaizu Jiang is currently employed at Nvidia Corporation, a leading company in graphics processing and AI technology. His work at Nvidia has allowed him to push the boundaries of what is possible in video processing and computer vision.
Collaborations
Huaizu has collaborated with notable colleagues, including Deqing Sun and Varun Jampani, who share his passion for advancing technology in the field.
Conclusion
Huaizu Jiang's innovative patents in scene flow estimation and video interpolation demonstrate his significant contributions to the fields of computer vision and video processing. His work not only enhances the capabilities of autonomous driving technologies but also improves the quality of video content.