Gm Global Technolgoy Operations, Inc.

Silantrix Ltd.

Gilat Satellite Networks Ltd.

Oded Bialer

Amnon Jonas

Igal Bilik

Inna Stainvas Olshansky

Tom Tirer

Ariel Lipson

Dani Raphaeli

David Shapiro

Dan Levi

Kobi Jacob Scheim

Ran Yehoshua Gazit

Uzi Ram

Yuval Haitman

Oren Longman

Alexander Pokrass

Yaron Eshet

Roy Uziel

Michael Levitsky

Michael Slutsky

Igal Kotzer

Noa Garnett

Ofer Givati

Siddhartha Gupta

Joseph Tabrikian

Guy Levitas

Sammy Kolpinizki

Herein, a technology that facilitates the optimization of vision-language (VL) based classifiers with text embeddings is discussed. The technology includes tuning the VL-based classifier employing a pre-trained image encoder of a visual-language model (VLM) for imaging embedding of pre-classified images and a pre-trained textual encoder of the VLM for textual embedding of a set of differing textual sentences. The technology further includes determining an optimized set of differing textual sentences of a superset of textual sentences. The optimized set of differing textual sentences has a minimal classification loss of the VL-based classifier when classifying the pre-classified images.

Classification by vision-language model with optimized text embeddings

A system for classifying a road crossing intention of a pedestrian includes a processor including a pretrained image encoder generating an image embedding based upon an input image. The system further includes a remote server receiving the image embedding. The remote server device further references a plurality of pretrained image and text embeddings each corresponding to either a positive road crossing intention or a negative road crossing intention. The remote server device further determines a plurality of proximity values evaluating whether the input image is closer to the positive road crossing intention or the negative road crossing intention, evaluating the image embedding against each of the pretrained embeddings. The remote server device further classifies a road crossing intention of the pedestrian based upon the plurality of proximity values. The system further includes generates a road crossing intention output based upon the road crossing intention of the pedestrian.

System and method for pedestrian road crossing intention detection

A system of controlling operation of a vehicle includes a lidar unit and a radar unit configured to obtain measured lidar datapoints and a measured radar signal, respectively. A command unit is adapted to receive the measured lidar datapoints and the measured radar signal, the command unit including a processor and tangible, non-transitory memory on which instructions are recorded. The command unit is configured to identify respective objects in the measured lidar datapoints and assign a respective radar reflection intensity to the measured lidar datapoints in the respective objects. A synthetic radar signal is generated based in part on the radar reflection intensity. The command unit is configured to obtain an enhanced radar signal by adjusting the measured radar signal based on the synthetic radar reference signal.

Enhancement of radar signal with synthetic radar signal generated from vehicle lidar unit

A method includes performing object detection by a radar sensor system. The object detection includes generating and transmitting object-detection (OD) chirps on an OD channel of a plurality of radar channels employed by the radar sensor system. The method further includes monitoring unused radar channels for interference and determining that at least one of the unused radar channels is free of interference. The method still further includes performing object detection by generating and transmitting one or more OD chirps on the determined interference-free channel.

Radar interference mitigation by monitoring of channels and switching to interference-free channel

A system in a vehicle includes a transmitter of a radar system to transmit energy and a receiver of the radar system to receive reflections based on reflection of the energy transmitted by the transmitter by one or more objects. The system also includes a controller to process the reflections obtained during a predefined duration to estimate a range, azimuth angle, and relative velocity for each of the one or more objects by obtaining acceleration information from an inertial measurement unit (IMU) of the vehicle. An operation of the vehicle is controlled based on information about the one or more objects from the radar system.

Doppler radar resolution based on inertial measurement unit of vehicle

A method that includes obtaining reflective radar signals regarding a scene monitored by a radar sensor system having an antenna array that is characterized by effecting a reflection-ghost offset in one or more domains, determining a reflective-intensity (RI) spectrum in three domains based on the reflective radar signals, producing a filtered RI spectrum by applying a trained convolutional neural network (CNN) to the RI spectrum by, at least in part, filtering the RI spectrum using one or more CNN kernels that incorporate the reflection-ghost offset; and detecting objects in the monitored scene based, at least in part, on the filtered RI spectrum.

Radar reflection detection with convolutional neural network kernels matched to reflection-ghost offset

A method, system and vehicle that repetitively correct angle offsets in a synthetic aperture radar image of a vehicle while the vehicle is in motion by utilizing a radar system and a camera to determine accurate velocity of a measured object by matching angles of the object in the SAR image with angles of the object in the camera image, thereby reducing angle offsets of objects in the SAR image. The method includes obtaining an SAR image of another vehicle via a radar unit of the vehicle, obtaining a camera image of the other vehicle via a camera unit of the vehicle, determining an association between at least one object in the SAR image and a corresponding at least one object in the camera image, correcting a velocity estimation of the vehicle based on the determined association, and adjusting the SAR image based on the corrected velocity estimation.

Velocity estimation and angle offset correction in SAR images by performing image matching

A system for interpolating wireless spectrum. The system may include an antenna system operable for transmitting wireless signals and responsively receiving reflected signals. The system may additionally include an interpolation controller configured for collecting a plurality of reflection radar spectrum samples from the reflected signals, identifying an interpolation point between two or more interpolation samples of the samples, calculating an interpolation weight for the each of the interpolation samples, and determining an interpolated spectrum at the interpolation point as a summation of a product of the interpolation weights and the interpolation samples.

Radar spectrum interpolation for vehicle navigation

A system includes a transmitter of a radar system to transmit transmitted signals, and a receiver of the radar system to receive received signals based on reflection of one or more of the transmitted signals by one or more objects. The system also includes a processor to train a neural network with reference data obtained by simulating a higher resolution radar system than the radar system to obtain a trained neural network. The trained neural network enhances detection of the one or more objects based on obtaining and processing the received signals in a vehicle. One or more operations of the vehicle are controlled based on the detection of the one or more objects.

High resolution radar simulation to train vehicle radar system neural network

A system of controlling operation of a vehicle includes one or more sensors operatively connected to the vehicle. The sensors are configured to obtain respective data of a scene and include a radar unit. A command unit is adapted to receive the respective data and includes a processor and tangible, non-transitory memory on which instructions are recorded. The command unit is configured to determine an orientation angle of a pedestrian in the scene, a Doppler frequency of the pedestrian and a distance of the pedestrian from a border of a road, based in part on the respective data. The orientation angle is based on a heading of the pedestrian relative to a direction of a road. The command unit is configured to designate a status of the pedestrian as either crossing or not crossing based on the distance, the orientation angle and the Doppler frequency of the pedestrian.

Prediction of pedestrian road crossing with vehicle sensor

A vehicle, and a system and method for operating the vehicle. The system includes a sensor and a processor. The sensor obtains a detection set related to an object at a range from the vehicle. The processor is configured to select a convolution path for the detection set based on a range of the object, wherein the convolution path includes one or more convolutional layers and a number of the one or more convolutional layers is dependent on the range of the object, apply the one or more convolutional layers of the selected convolution path to the detection set to generate a filtered data set, and operate the vehicle with respect to the object using the filtered data set.

Spatially invariant 3D convolutional network over spherical coordinate input

A radar system and method include and employ a plurality of substantially identical transceiver sets establishing respective substantially identical, overlapping virtual antenna arrays. A first sub-array of widely spaced virtual antennas provides high angular resolution but high angular ambiguity. A second sub-array of narrowly spaced virtual antennas provides low angular ambiguity but low angular resolution.

High resolution unambiguous radar

A system for detecting and estimating a property of an object based on radar includes a signal generator configured to generate a code sequence for a plurality of transmitters configured to emit radar signals over a selected time frame, the code sequence including a plurality of codes, each code of the plurality of codes having a different code length, each code repeated in the code sequence according to a repetition frequency, and each transmitter configured to emit a radar signal based on the code sequence. The system also includes a receiver configured to detect return signals from reflections of the emitted radar signal, and a processing device configured to estimate a property of an object based on the detected return signals.

Variable code sequences for radar transmission

A vehicle, system, and method of determining a velocity of an object. The system includes a radar system and a processor. The radar system is configured to obtain a radar signal with respect to the object over an integration interval, the radar signal including a plurality of velocity samples. The processor is configured to partition the integration interval into a plurality of time segments, each time segment including a subset of the velocity samples, perform a first integration of the subset of the velocity samples within a selected time segment using a first set of velocity of hypotheses to obtain a first stage integration value for the time segment, perform a second integration using the first stage integration value using a second set of velocity hypotheses to obtain a second stage integration value over the integration interval, and determine the velocity of the object from the second stage integration value.

Long signal integration of multiple velocity hypotheses

A vehicle includes a plurality of transmitters of a code division multiple access (CDMA) radar system to simultaneously transmit a frame of transmit signals. A first time duration between transmissions of a first pair of sequential ones of the transmit signals is linearly increased to a second time duration between transmissions of a second pair of sequential ones of the transmit signals. The vehicle also includes a receiver of the CDMA radar system to receive reflected energy resulting from reflection of one of more of the transmit signals of one or more of the plurality of transmitters by an object. A controller processes the reflected energy to obtain information about the object and to control an operation of the vehicle based on the information.

Growing community of inventors

Petah Tivak, Israel

Oded Bialer