Gm Global Technolgoy Operations, Inc.

Darren Michael Chan

Michael J Daily

Hyukseong Kwon

Jiejun Xu

Alireza Esna Ashari Esfahani

Kenji Yamada

Joshua Lampkins

Alan Perry

A road sign interpretation system includes a front-facing camera mounted on or in a vehicle collecting image data of multiple road signs. A first convolutional neural network (CNN) receives the image data from the front-facing camera and yields a set of sign predictions including one or more sign text instances. A second CNN defining a text extractor receives the image data from the front-facing camera and extracts text candidates including the multiple sign text instances. Sign and sign data localization is provided in the second CNN to compute a text order from the multiple sign text instances. A sign text synthesizer module receives individual sign text instances from the first CNN and individual ones of the sign text instances in digitized forms from an optical character recognizer (OCR). A semantic encoding and interpretation module receives the sign text instances and identifies semantics of the multiple road signs.

Scalable road sign interpretation system for autonomous driving

Growing community of inventors

Thousand Oaks, CA, United States of America

Darren Michael Chan