Gm Global Technolgoy Operations, Inc.

Noa Garnett

Dan Levi

Oded Bialer

Omer Tsimhoni

Amnon Jonas

Ron M Hecht

Michael Baltaxe

Ke Liu

Yi G Glaser

Shaul Oron

Bat El Shlomo

Ofer Givati

Max Bluvstein

Amit Batikoff

Roy Uziel

Netalee Efrat Sela

Doron Portnoy

Tal Furman

Shahar Ben Ezra

Ethan Fetaya

A system in a vehicle includes an image sensor to obtain images in an image sensor coordinate system and a depth sensor to obtain point clouds in a depth sensor coordinate system. Processing circuitry implements a neural network to determine a validation state of a transformation matrix that transforms the point clouds in the depth sensor coordinate system to transformed point clouds in the image sensor coordinate system. The transformation matrix includes rotation parameters and translation parameters.

Alignment validation in vehicle-based sensors

A system for analyzing images includes a processing device includes a receiving module configured to receive an image, and an analysis module configured to apply the received image to a machine learning network and classify one or more features in the received image, the machine learning network configured to propagate image data through a plurality of convolutional layers, each convolutional layer of the plurality of convolutional layers including a plurality of filter channels, the machine learning network including a bottleneck layer configured to recognize an image feature based on a shape of an image component, The system also includes an output module configured to output characterization data that includes a classification of the one or more features.

Shape-biased image classification using deep convolutional networks

A vehicle having an imaging sensor that is arranged to monitor a field-of-view (FOV) that includes a travel surface proximal to the vehicle is described. Detecting the travel lane includes capturing a FOV image of a viewable region of the travel surface. The FOV image is converted, via an artificial neural network, to a plurality of feature maps. The feature maps are projected, via an inverse perspective mapping algorithm, onto a BEV orthographic grid. The feature maps include travel lane segments and feature embeddings, and the travel lane segments are represented as line segments. The line segments are concatenated for the plurality of grid sections based upon the feature embeddings to form a predicted lane. The concatenation, or clustering is accomplished via the feature embeddings.

Method and apparatus for lane detection on a vehicle travel surface

A method of monitoring a driver in an autonomous vehicle includes monitoring, with a driver monitoring system, a driver of a vehicle, collecting, with a data processor, data from the driver monitoring system related to gaze behavior of the driver, classifying, with the data processor, the driver as one of a plurality of driver statuses based on the data from the driver monitoring system, and sending, with the data processor, instructions to at least one vehicle system based on the classification of the driver.

Predicting driver status using glance behavior

A method of designing a radar system includes implementing a supervised learning process of a neural network to determine a weight corresponding with each of a plurality of patch antennas of a radar system. Each of the plurality of patch antennas is sized in accordance with the weight.

Neural network-based radio frequency network design in a radar system of a vehicle

Systems and methods to perform image-based three-dimensional (3D) lane detection involve obtaining known 3D points of one or more lane markings in an image including the one or more lane markings. The method includes overlaying a grid of anchor points on the image. Each of the anchor points is a center of i concentric circles. The method also includes generating an i-length vector and setting an indicator value for each of the anchor points based on the known 3D points as part of a training process of a neural network, and using the neural network to obtain 3D points of one or more lane markings in a second image.

Image-based three-dimensional lane detection

A vehicle, system for operating a vehicle and method of navigating a vehicle. The system includes a sensor and a multi-layer convolutional neural network. The sensor generates an image indicative of a road scene of the vehicle. The multi-layer convolutional neural network generates a plurality of feature maps from the image via a first processing pathway, projects at least one of the plurality of feature maps onto a defined plane relative to a defined coordinate system of the road scene to obtain at least one projected feature map, applies a convolution to the at least one projected feature map in a second processing pathway to obtain a final feature map, and determines lane information from the final feature map. A control system adjusts operation of the vehicle using the lane information.

Detection and planar representation of three dimensional lanes in a road scene

A method in a vehicle for performing multiple on-board sensing tasks concurrently in the same network using deep learning algorithms is provided. The method includes receiving vision sensor data from a sensor on the vehicle, determining a set of features from the vision sensor data using a plurality of feature layers in a convolutional neural network, and concurrently estimating, using the convolutional neural network, bounding boxes for detected objects, free-space boundaries, and object poses for detected objects from the set of features determined by the plurality of feature layers. The neural network may include a plurality of free-space estimation layers configured to determine the boundaries of free-space in the vision sensor data, a plurality of object detection layers configured to detect objects in the image and to estimate bounding boxes that surround the detected objects, and a plurality of object pose detection layers configured to estimate the direction of each object.

Growing community of inventors

Herzliya, Israel

Noa Garnett