University of Michigan

Denso International America, Inc.

Ethan Zhang

Neda Masoud

Rajesh Kumar Malhan

Joseph Lull

Wei Zhang

Mahdi Bandegi

A pedestrian tracking system includes: a buffer or a memory configured to store a trajectory sequence of a pedestrian; a step attention module and a control module. The step attention module iteratively performs a step attention process to predict states of the pedestrian. Each iteration of the step attention process includes the step attention module: learning the stored trajectory sequence to provide time-dependent hidden states, reshaping each of the time-dependent hidden states to provide two-dimensional tensors; condensing the two-dimensional tensors via convolutional networks to provide convolutional sequences; capturing global information of the convolutional sequences to output a set of trajectory patterns represented by a new sequence of tensors; learning time-related patterns in the new sequence and decoding the new sequence to provide one or more of the states of the pedestrian; and modifying the stored trajectory sequence to include the predicted one or more of the states of the pedestrian.

Sequential pedestrian trajectory prediction using step attention for collision avoidance

A system for predicting aggressive driving behavior for a driver of a vehicle includes a first edge computing device that can acquire spatial-temporal data for the vehicle from one or more sensors that are part of traffic infrastructure. The first edge computing device includes a processor and instructions executable by the processor that execute deep learning methods on the data from the sensors to cluster the data as a driving score. A trained model is applied to the driving score to determine an aggressive driving behavior risk level, and the first edge computing device is configured to predict the aggressive driving behavior based on the aggressive driving behavior risk level.

System for predicting aggressive driving

Growing community of inventors

Ann Arbor, MI, United States of America

Ethan Zhang