The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 18, 2024

Filed:

Aug. 23, 2021
Applicant:

Google Llc, Mountain View, CA (US);

Inventors:

Jing Yu Koh, Singapore, SG;

Honglak Lee, Ann Arbor, MI (US);

Yinfei Yang, Sunnyvale, CA (US);

Jason Michael Baldridge, Austin, TX (US);

Peter James Anderson, Austin, TX (US);

Assignee:

GOOGLE LLC, Mountain View, CA (US);

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06T 11/00 (2006.01); G06F 18/213 (2023.01); G06N 3/045 (2023.01); G06N 3/08 (2023.01); G06T 7/10 (2017.01); G06T 15/00 (2011.01); G06T 15/08 (2011.01);
U.S. Cl.
CPC ...
G06T 11/00 (2013.01); G06F 18/213 (2023.01); G06N 3/045 (2023.01); G06N 3/08 (2013.01); G06T 7/10 (2017.01); G06T 15/00 (2013.01); G06T 15/08 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20081 (2013.01);
Abstract

A computing system for generating predicted images along a trajectory of unseen viewpoints. The system can obtain one or more spatial observations of an environment that may be captured from one or more previous camera poses. The system can generate a three-dimensional point cloud for the environment from the one or more spatial observations and the one or more previous camera poses. The system can project the three-dimensional point cloud into two-dimensional space to form one or more guidance spatial observations. The system can process the one or more guidance spatial observations with a machine-learned spatial observation prediction model to generate one or more predicted spatial observations. The system can process the one or more predicted spatial observations and image data with a machine-learned image prediction model to generate one or more predicted images from the target camera pose. The system can output the one or more predicted images.


Find Patent Forward Citations

Loading…