Ford Global Technolgoies, LLC

Apurbaa Mallik

Vijay K Nagasamy

Gurjeet Singh

Hitha Revalla

Zafar Iqbal

Praveen Narayanan

Steven Chao

Aniruddh Ravindran

Kaushik Balakrishnan

Ganesh Kumar

Sowndarya Sundar

Rohun Atluri

A computer includes a processor and a memory, and the memory stores instructions executable by the processor to receive an image frame from a camera, generate a feature map from the image frame, generate a depth map from the feature map, classify an object in the image frame based on the feature map, and estimate a distance to the object based on the depth map and based on an input to generating the feature map.

Distance determination from image data

Systems and methods for transforming autonomous aerial vehicle sensor data between platforms are disclosed herein. An example method can include receiving, by an UAV, vehicle radar data and radar calibration data from a vehicle, as well as location information for a location of the vehicle, determining a simulated UAV at the location, establishing an orientation for a simulated radar on a bottom of the simulated UAV, determining a height for the simulated UAV to match a field of view of the simulated radar, performing a geometrical transformation to convert the vehicle radar data set into a UAV perspective, converting the vehicle radar data into a vehicle coordinate frame using the radar calibration using vehicle global positioning system (GPS) coordinates, converting the vehicle coordinate frame from a global frame into a UAV coordinate frame using UAV GPS coordinates, and converting the UAV coordinate frame into simulated radar sensor frame.

Systems and methods for transforming autonomous aerial vehicle sensor data between platforms

The disclosure is generally directed to systems and methods for inference quality determination of a deep neural network (DNN) without requiring ground truth information for use in driver-assisted vehicles, including receiving an image frame from a source; applying a normal inference DNN model to the image frame to produce a first inference with a first bounding box using a normal inference DNN model; applying a deep inference DNN model to a plurality of filtered versions of the image frame to produce a plurality of deep inferences with a plurality of bounding boxes; comparing the plurality of bounding boxes to identify a cluster condition of the plurality of bounding boxes; and determining an inference quality of the image frame of the normal inference DNN model as a function of the cluster condition.

Systems and methods for detecting deep neural network inference quality using image/data manipulation without ground truth information

A computer includes a processor and a memory storing instructions executable by the processor to receive image data from a camera, generate a depth map from the image data, detect an object in the image data, apply a bounding box circumscribing the object to the depth map, mask the depth map by setting depth values for pixels in the bounding box in the depth map to a depth value of a closest pixel in the bounding box, and determine a distance to the object based on the masked depth map. The closest pixel is closest to the camera of the pixels in the bounding box.

A first image can be acquired from a first sensor included in a vehicle and input to a deep neural network to determine a first bounding box for a first object. A second image can be acquired from the first sensor. Input latitudinal and longitudinal motion data from second sensors included in the vehicle corresponding to the time between inputting the first image and inputting the second image. A second bounding box can be determined by translating the first bounding box based on the latitudinal and longitudinal motion data. The second image can be cropped based on the second bounding box. The cropped second image can be input to the deep neural network to detect a second object. The first image, the first bounding box, the second image, and the second bounding box can be output.

Image annotation for deep neural networks

A system includes a computer including a processor and a memory, the memory storing instructions executable by the processor to generate a synthetic image by adjusting respective color values of one or more pixels of a reference image based on a specified meteorological optical range from a vehicle sensor to simulated fog, and input the synthetic image to a machine learning program to train the machine learning program to identify a meteorological optical range from the vehicle sensor to actual fog.

Enhanced vehicle operation

A training system for a deep neural network and method of training is disclosed. The system and/or method may comprise: receiving, from an eye-tracking system associated with a sensor, an image frame captured while an operator is controlling a vehicle; receiving, from the eye-tracking system, eyeball gaze data corresponding to the image frame; and iteratively training the deep neural network to determine an object of interest depicted within the image frame based on the eyeball gaze data. The deep neural network generates at least one feature map and determine a proposed region corresponding to the object of interest within the at least one feature map based on the eyeball gaze data.

Growing community of inventors

Sunnyvale, CA, United States of America

Apurbaa Mallik