Toyota Research Institute, Inc.

Leland Stanford Junior University

Kuan-hui Lee

Adrien David Gaidon

Sudeep Pillai

Kun-Hsin Chen

Arjun Bhargava

Shunsho Kaku

Hai Jin

Peiyan Gong

Juan Carlos Niebles

Nishant Rai

Ehsan Adeli Mosabbeb

Systems, methods, computer-readable media, techniques, and methodologies are disclosed for performing end-to-end, learning-based keypoint detection and association. A scene graph of a signalized intersection is constructed from an input image of the intersection. The scene graph includes detected keypoints and linkages identified between the keypoints. The scene graph can be used along with a vehicle's localization information to identify which keypoint that represents a traffic signal is associated with the vehicle's current travel lane. An appropriate vehicle action may then be determined based on a transition state of the traffic signal keypoint and trajectory information for the vehicle. A control signal indicative of this vehicle action may then be output to cause an autonomous vehicle, for example, to implement the appropriate vehicle action.

End-to-end signalized intersection transition state estimator with scene graphs over semantic keypoints

Systems and methods for multi-view cooperative contrastive self-supervised learning, may include receiving a plurality of video sequences, the video sequences comprising a plurality of image frames; applying selected images of a first and second video sequence of the plurality of video sequences to a plurality of different encoders to derive a plurality of embeddings for different views of the selected images of the first and second video sequences; determining distances of the derived plurality of embeddings for the selected images of the first and second video sequences; detecting inconsistencies in the determined distances; and predicting semantics of a future image based on the determined distances.

Cooperative-contrastive learning systems and methods

Growing community of inventors

LOS ALTOS, CA, United States of America

Kuan-hui Lee