Scene creation system for autonomous vehicles and methods thereof

Abstract

This disclosure describes a vehicle system for identifying environmental objects within an operator's surroundings in a first window and removing object obstructions through a neural network in a second window to generate a rendered window, or scene, for display. As more windows are processed, the neural network may increase its understanding of the surroundings. The neural network may be a generative adversarial network (GAN) that may be trained to identify environmental objects by introducing noise data into those environmental objects. After receiving a first window from at least one camera on the vehicle, a rendered window may be created from a second window received from the at least one camera based on environmental objects identified within the first window through the GAN and removing object obstructions. The rendered window, without the object obstructions, and having superimposed environmental objects based on the GAN, may be displayed on an output device.