Uatc, LLC

Shivam Duggal

Raquel Urtasun

Shenlong Wang

Sivabalan Manivasagam

Ersin Yumer

Xinchen Yan

Yun Chen

Frieda Rong

Wei-Chiu Ma

The present disclosure provides systems and methods for generating photorealistic image simulation data with geometry-aware composition for testing autonomous vehicles. In particular, aspects of the present disclosure can involve the intake of data on an environment and output of augmented data on the environment with the photorealistic addition of an object. As one example, data on the driving experiences of a self-driving vehicle can be augmented to add another vehicle into the collected environment data. The augmented data may then be used to test safety features of software for a self-driving vehicle.

Photorealistic image simulation with geometry-aware composition

Systems, methods, tangible non-transitory computer-readable media, and devices associated with depth estimation are provided. For example, a feature representation associated with stereo images including a first and second plurality of points can be accessed. Sparse disparity estimates associated with disparities between the first and second plurality of points can be determined. The sparse disparity estimates can be based on machine-learned models that estimate disparities based on comparisons of the first plurality of points to the second plurality of points. Confidence ranges associated with the disparities between the first and second plurality of points can be determined based on the sparse disparity estimates and the machine-learned models. A disparity map for the stereo images can be generated based on using the confidence ranges and machine-learned models to prune the disparities outside the confidence ranges. Furthermore, three-dimensional depth estimates associated with the stereo images can be generated based on the disparity map.

Depth estimation for autonomous devices

Growing community of inventors

Toronto, Canada

Shivam Duggal