The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Feb. 13, 2024
Filed:
Oct. 13, 2022
Hrl Laboratories, Llc, Malibu, CA (US);
Steven W. Skorheim, North Hills, CA (US);
Tiffany Hwu, San Diego, CA (US);
HRL LABORATORIES, LLC, Malibu, CA (US);
Abstract
Described is a system for multimodal machine-aided comprehension analysis. The system can be implemented in an augmented reality headset that, in conjunction with a processor, generates an initial scene graph of a scene proximate the user. Items and labels are presented, with the headset tracking eye movements of the user as the user gazes upon the subject labels, item labels, and relationship labels. A resulting scene graph (having relationship triplets) is generated based on the eye movements of the user and an amount of time the user spends gazing upon each of the display components. A comprehension model is generated by estimating a user's comprehension of the relationship triplets, with a knowledge model being generated based on a known knowledge graph and the comprehension model. Cues are then presented to the user based on the comprehension and knowledge models to assist the user in their comprehension of the scene.