Low power consumption deep neural network for simultaneous object detection and semantic segmentation in images on a mobile computing device

Abstract

A mobile computing device receives an image from a camera physically located within a vehicle. The mobile computing device inputs the image into a convolutional model that generates a set of object detections and a set of segmented environment blocks in the image. The convolutional model includes subsets of encoding and decoding layers, as well as parameters associated with the layers. The convolutional model relates the image and parameters to the sets of object detections and segmented environment blocks. A server that stores object detections and segmented environment blocks is updated with the sets of object detections and segmented environment blocks detected in the image.