Michigan State University

Ford Global Technolgoies, LLC

Daniel Morris

Punarjay Chakravarty

Hayder Radha

Praveen Narayanan

Marcos Paul Gerardo Castro

Xiaoming Liu

Su Pang

Yunfei Long

Carol Louise Okubo

Paul Martin Niessen

Paul M Gartner

A computer includes a processor and a memory storing instructions executable by the processor to receive radar data including a radar pixel having a radial velocity from a radar; receive camera data including an image frame including camera pixels from a camera; map the radar pixel to the image frame; generate a region of the image frame surrounding the radar pixel; determine association scores for the respective camera pixels in the region; select a first camera pixel of the camera pixels from the region, the first camera pixel having a greatest association score of the association scores; and calculate a full velocity of the radar pixel using the radial velocity of the radar pixel and a first optical flow at the first camera pixel. The association scores indicate a likelihood that the respective camera pixels correspond to a same point in an environment as the radar pixel.

Vehicle using full-velocity determination with radar

A method and system of operating a vehicle includes a first sensor generating first sensor data for an object comprising a first bounding box from a first sensor. The first sensor data comprising a first confidence score. A second sensor generates second sensor data for the object comprising a second bounding box from a second sensor different than the second sensor. The second sensor data comprises a second confidence score. A bounding box circuit is programmed to generate a third confidence score for the object based on the first sensor data and the second sensor data and utilize the first sensor data, the second sensor data and the third confidence score to control operation of a vehicle system.

Lidar camera fusion for autonomous vehicles

A computer includes a processor and a memory storing instructions executable by the processor to receive radar data from a radar, the radar data including radar pixels having respective measured depths; receive camera data from a camera, the camera data including an image frame including camera pixels; map the radar pixels to the image frame; generate respective regions of the image frame surrounding the respective radar pixels; for each region, determine confidence scores for the respective camera pixels in that region; output a depth map of projected depths for the respective camera pixels based on the confidence scores; and operate a vehicle including the radar and the camera based on the depth map. The confidence scores indicate confidence in applying the measured depth of the radar pixel for that region to the respective camera pixels.

Depth map generation

Accurate vehicle localization is arguably the most critical and fundamental task for autonomous vehicle navigation. While dense 3D point-cloud-based maps enable precise localization, they impose significant storage and transmission burdens when used in city-scale environments. A highly compressed representation for LiDAR maps, along with an efficient and robust real-time alignment algorithm for on-vehicle LiDAR scans, is proposed here. The proposed mapping framework, requires less than 0.1% of the storage space of the original 3D point cloud map. In essence, mapping framework emulates an original map through feature likelihood functions. In particular, the mapping framework models planar, pole and curb features. These three feature classes are long-term stable, distinct and common among vehicular roadways. Multiclass feature points are extracted from LiDAR scans through feature detection. A new multiclass-based point-to-distribution alignment method is also proposed to find the association and alignment between the multiclass feature points and the map.

Mapping and localization system for autonomous vehicles

A method is disclosed for controlling an internal combustion engine in a vehicle powertrain. A filtered driver demand for torque at vehicle traction wheels is used to determine an engine torque command. The engine torque command is initialized to a percentage of a target engine torque as a function of variables that may include a smoothness factor.

Growing community of inventors

Okemos, MI, United States of America

Daniel Morris