Techniques for precisely locating landmarks in monocular camera images with deep learning

Abstract

Advanced driver assistance (ADAS) systems and methods for a vehicle comprise capturing an image using a monocular camera system of the vehicle and detecting a landmark in the image using a deep neural network (DNN) trained with labeled training data including generating a bounding box for the detected landmark, predicting a depth of pixels in the image using a convolutional neural network (CNN) trained with unlabeled training data captured by a stereo camera system, filtering noise by averaging predicted pixel depths for pixels in the region of the bounding box to obtain an average depth value for the detected landmark, determining a coordinate position of the detected landmark using its average depth value, and performing at least one ADAS feature using the determined coordinate position of the detected landmark.