Gm Global Technolgoy Operations, Inc.

Gershon Celniker

Omer Tsimhoni

Ron M Hecht

Ariel Telpaz

Shaul Oron

Andrea Forgacs

Ohad Rahamim

A method of training a disparity estimation network. The method includes obtaining an eye-gaze dataset having first images with at least one gaze direction associated with each of the first images. A gaze prediction neural network is trained based on the eye-gaze dataset to develop a model trained to provide a gaze prediction for an external image. A depth database is obtained that includes second images having depth information associated with each of the second images. A disparity estimation neural network for object detection is trained based on an output from the gaze prediction neural network and an output from the depth database.

System and method for eye-gaze direction-based pre-training of neural networks

A computer-implemented method when executed by data processing hardware causes the data processing hardware to perform operations. The operations include generating, at an occupancy estimation network, an occupancy probability at one or more voxels, predicting, via a gaze prediction model, a gaze direction of a gaze prediction, and identifying, based on the predicted gaze direction, an object of interest. The operations also include generating, via an occupancy estimation application, a gaze saliency map based on the gaze direction and identified object of interest, and updating, based on the determined gaze direction and the gaze saliency map, the occupancy probability of the one or more voxels.

Occupancy estimation system for a vehicle

Growing community of inventors

Netanya, Israel

Gershon Celniker