Massachusetts Institute of Technology

Toyota Research Institute, Inc.

Alexander Amini

Daniela Rus

Sertac Karaman

Guy Rosman

Igor Gilitschenski

Felix Maximilian Naser

William T Freeman

Gregory W Wornell

Fredo Durand

Antonio Torralba

Christina Liao

Julia Moseyko

Jacob Phillips

A controller for an autonomous vehicle is trained using simulated paths on a roadway and simulated observations that are formed by transforming images previously acquired on similar paths on that roadway. Essentially an unlimited number of paths may be simulated, enabling optimization approaches including reinforcement learning to be applied to optimize the controller.

Simulation-based training of an autonomous vehicle

The present disclosure provides systems and methods to detect occluded objects using shadow information to anticipate moving obstacles that are occluded behind a corner or other obstacle. The system may perform a dynamic threshold analysis on enhanced images allowing the detection of even weakly visible shadows. The system may classify an image sequence as either 'dynamic' or 'static', enabling an autonomous vehicle, or other moving platform, to react and respond to a moving, yet occluded object by slowing down or stopping.

Systems and methods of detecting moving obstacles

Systems and methods described herein relate to vehicular navigation and localization. One embodiment extracts perceptual features from sensor data; extracts unrouted-map features from unrouted map data; combines the perceptual features and the unrouted-map features to produce first combined features data; outputs, based at least in part on the first combined features data, parameters of a probability distribution for one or more steering trajectories that are available to a vehicle; and performs a localization of the vehicle based, at least in part, on the parameters of the probability distribution.

Systems and methods for vehicular navigation and localization

A method of non-line-of-sight (NLoS) obstacle detection for an ego vehicle is described. The method includes capturing a sequence of images over a period with an image capture device. The method also includes storing the sequence of images in a cyclic buffer. The method further includes registering each image in the cyclic buffer to a projected image. The method includes performing the registering by estimating a homography H for each frame of the sequence of images to project to a view point of a first frame in the sequence of images and remove motion of the ego vehicle in the projected image. The method also includes enhancing the projected image. The method further includes classifying the projected image based on a scene determination. The method also includes issuing a control signal to the vehicle upon classifying the projected image.

Infrastructure-free NLoS obstacle detection for autonomous cars

Growing community of inventors

Cambridge, MA, United States of America

Alexander Amini