The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jun. 23, 2026
Filed:
Sep. 04, 2024
Snap Inc., Santa Monica, CA (US);
Viktoria Hwang, Monrovia, CA (US);
Mitchell Kuppersmith, Los Angeles, CA (US);
Karen Stolzenberg, Venice, CA (US);
Snap Inc., Santa Monica, CA (US);
Abstract
A device and system for visual reasoning in augmented reality environments employs adaptive multi-frame capture triggered by detection of user speech. Upon detecting speech, the device or system captures image frames at an initial frame capture rate, increasing capture frequency when a hand is detected in a captured image. Timestamped frames and transcribed speech form a prompt for a multimodal large language model, which extracts relevant details with constrained output. A separate language model then generates a final response. This two-stage approach optimizes processing efficiency and accuracy while preserving privacy by limiting continuous visual data collection. The system enables more natural and context-aware interactions in AR settings without complex gesture recognition algorithms.