The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 15, 2022

Filed:

Apr. 08, 2020
Applicant:

Toyota Research Institute, Inc., Los Altos, CA (US);

Inventors:

Rui Hou, Issaquah, WA (US);

Jie Li, Los Altos, CA (US);

Vitor Guizilini, Santa Clara, CA (US);

Adrien David Gaidon, Mountain View, CA (US);

Dennis Park, Fremont, CA (US);

Arjun Bhargava, San Francisco, CA (US);

Assignee:

Toyota Research Institute, Inc., Los Altos, CA (US);

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
G06V 20/10 (2022.01); G06T 7/10 (2017.01); G06K 9/62 (2022.01); G06V 10/94 (2022.01);
U.S. Cl.
CPC ...
G06V 20/10 (2022.01); G06K 9/6256 (2013.01); G06T 7/10 (2017.01); G06V 10/955 (2022.01);
Abstract

Systems and methods for panoptic image segmentation are disclosed herein. One embodiment performs semantic segmentation and object detection on an input image, wherein the object detection generates a plurality of bounding boxes associated with an object in the input image; selects a query bounding box from among the plurality of bounding boxes; maps at least one of the bounding boxes in the plurality of bounding boxes other than the query bounding box to the query bounding box based on similarity between the at least one of the bounding boxes and the query bounding box to generate a mask assignment for the object, the mask assignment defining a contour of the object; compares the mask assignment with results of the semantic segmentation to produce a refined mask assignment for the object; and outputs a panoptic segmentation of the input image that includes the refined mask assignment for the object.


Find Patent Forward Citations

Loading…