The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Feb. 25, 2025
Filed:
Jul. 14, 2022
Jian Ren, Hermosa Beach, CA (US);
Yang Wen, San Jose, CA (US);
Ju HU, Los Angeles, CA (US);
Georgios Evangelidis, Vienna, AT;
Sergey Tulyakov, Santa Monica, CA (US);
Yanyu LI, Malden, MA (US);
Geng Yuan, Medford, MA (US);
Jian Ren, Hermosa Beach, CA (US);
Yang Wen, San Jose, CA (US);
Ju Hu, Los Angeles, CA (US);
Georgios Evangelidis, Vienna, AT;
Sergey Tulyakov, Santa Monica, CA (US);
Yanyu Li, Malden, MA (US);
Geng Yuan, Medford, MA (US);
Snap Inc., Santa Monica, CA (US);
Abstract
A vision transformer network having extremely low latency and usable on mobile devices, such as smart eyewear devices and other augmented reality (AR) and virtual reality (VR) devices. The transformer network processes an input image, and the network includes a convolution stem configured to patch embed the image. A first stack of stages including at least two stages of 4-Dimension (4D) metablocks (MBs) (MB) follow the convolution stem. A second stack of stages including at least two stages of 3-Dimension MBs (MB) follow the MBstages. Each of the MBstages and each of the MBstages include different layer configurations, and each of the MBstages and each of the MBstages include a token mixer. The MBstages each additionally include a multi-head self attention (MHSA) processing block.