Tesla, Inc.

Anting Shen

Forrest Nelson Iandola

Harsimran Singh Sidhu

Paras Jagdish Jain

Donald Benton MacMillen

Romi Phadte

Gayatri Joshi

Daniel Paden Tomasello

Rohan Nandkumar Phadte

Systems and methods include machine learning models operating at different frequencies. An example method includes obtaining images at a threshold frequency from one or more image sensors positioned about a vehicle. Location information associated with objects classified in the images is determined based on the images. The images are analyzed via a first machine learning model at the threshold frequency. For a subset of the images, the first machine learning model uses output information from a second machine learning model, the second machine learning model being performed at less than the threshold frequency.

Machine learning models operating at different frequencies for autonomous vehicles

Systems and methods for enhanced object detection for autonomous vehicles based on field of view. An example method includes obtaining an image from an image sensor of one or more image sensors positioned about a vehicle. A field of view for the image is determined, with the field of view being associated with a vanishing line. A crop portion corresponding to the field of view is generated from the image, with a remaining portion of the image being downsampled. Information associated with detected objects depicted in the image is outputted based on a convolutional neural network, with detecting objects being based on performing a forward pass through the convolutional neural network of the crop portion and the remaining portion.

Enhanced object detection for autonomous vehicles based on field view

An autonomous control system generates synthetic data that reflect simulated environments. Specifically, the synthetic data is a representation of sensor data of the simulated environment from the perspective of one or more sensors. The system generates synthetic data by introducing one or more simulated modifications to sensor data captured by the sensors or by simulating the sensor data for a virtual environment. The autonomous control system uses the synthetic data to train computer models for various detection and control algorithms. In general, this allows autonomous control systems to augment training data to improve performance of computer models, simulate scenarios that are not included in existing training data, and/or train computer models that remove unwanted effects or occlusions from sensor data of the environment.

Data synthesis for autonomous control systems

An annotation system uses annotations for a first set of sensor measurements from a first sensor to identify annotations for a second set of sensor measurements from a second sensor. The annotation system identifies reference annotations in the first set of sensor measurements that indicates a location of a characteristic object in the two-dimensional space. The annotation system determines a spatial region in the three-dimensional space of the second set of sensor measurements that corresponds to a portion of the scene represented in the annotation of the first set of sensor measurements. The annotation system determines annotations within the spatial region of the second set of sensor measurements that indicates a location of the characteristic object in the three-dimensional space.

Annotation cross-labeling for autonomous control systems

An autonomous control system combines sensor data from multiple sensors to simulate sensor data from high-capacity sensors. The sensor data contains information related to physical environments surrounding vehicles for autonomous guidance. For example, the sensor data may be in the form of images that visually capture scenes of the surrounding environment, geo-location of the vehicles, and the like. The autonomous control system simulates high-capacity sensor data of the physical environment from replacement sensors that may each have lower capacity than high-capacity sensors. The high-capacity sensor data may be simulated via one or more neural network models. The autonomous control system performs various detection and control algorithms on the simulated sensor data to guide the vehicle autonomously.

Multi-channel sensor simulation for autonomous control systems

An annotation system provides various tools for facilitating training data annotation. The annotation tools include a bidirectional annotation model that generates annotations for an image sequence based on both forward information and backward information in an image sequence. The annotation system also facilitates annotation processes by automatically suggesting annotations to the human operator based on a set of annotation predictions and locations of interactions of the human operator on the image. This way, the annotation system provides an accelerated way to generate high-quality annotations that take into account input from a human operator by using the predictions as a guide when it appears that an estimated annotation is consistent with the judgement of the human operator. The annotation system also updates annotations for an overlapping set of objects based on input from human operators.

Growing community of inventors

Berkeley, CA, United States of America

Anting Shen