The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 11, 2025

Filed:

Jul. 15, 2021
Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Harpreet Singh Sawhney, Kirkland, WA (US);

Bugra Tekin, Zurich, CH;

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G09B 5/06 (2006.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06F 3/16 (2006.01); G06N 3/02 (2006.01); G06T 19/00 (2011.01);
U.S. Cl.
CPC ...
G09B 5/06 (2013.01); G02B 27/0093 (2013.01); G02B 27/017 (2013.01); G06F 3/011 (2013.01); G06F 3/017 (2013.01); G06F 3/167 (2013.01); G06N 3/02 (2013.01); G06T 19/006 (2013.01);
Abstract

Examples are disclosed that relate to computer-based tracking of a process performed by a user. In one example, multi-modal sensor information is received via a plurality of sensors. A world state of a real-world physical environment and a user state in the real-world physical environment are tracked based on the multi-modal sensor information. A process being performed by the user within a working domain is recognized based on the world state and the user state. A current step in the process is detected based on the world state and the user state. Domain-specific instructions directing the user how to perform an expected action are presented via a user interface device. A user action is detected based on the world state and the user state. Based on the user action differing from the expected action, domain-specific guidance to perform the expected action is presented via the user interface device.


Find Patent Forward Citations

Loading…