The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 20, 2024
Filed:
Sep. 24, 2021
Applicant:
Kwai Inc., Palo Alto, CA (US);
Inventors:
Assignee:
KWAI INC., Palo Alto, CA (US);
Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06N 3/02 (2006.01); G06F 18/21 (2023.01); G06F 18/2132 (2023.01); G06F 18/214 (2023.01); G06N 3/094 (2023.01); G06N 3/096 (2023.01); G06V 10/44 (2022.01); G06V 10/82 (2022.01);
U.S. Cl.
CPC ...
G06F 18/2148 (2023.01); G06F 18/2132 (2023.01); G06F 18/2155 (2023.01); G06F 18/2178 (2023.01); G06N 3/02 (2013.01); G06N 3/094 (2023.01); G06N 3/096 (2023.01); G06V 10/454 (2022.01); G06V 10/82 (2022.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01);
Abstract
A method and an apparatus for training a transferable vision transformer (TVT) for unsupervised domain adaption (UDA) in heterogeneous devices are provided. The method includes that a heterogeneous device including one or more graphic processing units (GPUs) loads multiple patches into the TVT which includes a transferability adaption module (TAM). Furthermore, a patch-level domain discriminator in the TAM assigns weights to the multiple patches and determines one or more transferable patches based on the weights. Moreover, the heterogeneous device generates a transferable attention output for an attention module in the TAM based on the one or more transferable patches.