Fast one-shot open vocabulary image-conditioned detection and search method for utility assets

Abstract

This disclosure describes a system, method, and non-transitory computer-readable medium for image search-based object detection of utility assets in image databases. The method includes receiving an input image of a utility asset and a query bounding box representing an image-based object query. Bounding boxes of objects represented in the input image are generated based on the input image and the query bounding box, in which anchoring boxes corresponding to object classifications are identified from the bounding boxes. A textual label is determined for a selected subset of anchoring boxes. An image embedding representing the region is encoded, and image tokens are generated based on the encoded image embedding. Output images of other utility assets relevant to the image-based object query are identified from images in an image database, based on at least one of (i) the encoded image embedding, (ii) the image tokens, or (iii) the textual label. The output images are provided for output.