The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 18, 2023

Filed:

Apr. 20, 2020
Applicant:

Affectiva, Inc., Boston, MA (US);

Inventors:

Rana el Kaliouby, Milton, MA (US);

Seyedmohammad Mavadati, Watertown, MA (US);

Taniya Mishra, New York, NY (US);

Timothy Peacock, Concord, MA (US);

Panu James Turcot, Pacifica, CA (US);

Assignee:

Affectiva, Inc., Boston, MA (US);

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06N 3/08 (2023.01); G06N 3/084 (2023.01); G06N 3/088 (2023.01); B60W 40/08 (2012.01); G06V 20/59 (2022.01); G06V 10/774 (2022.01); G06V 40/16 (2022.01);
U.S. Cl.
CPC ...
G06N 3/084 (2013.01); B60W 40/08 (2013.01); G06N 3/088 (2013.01); G06V 10/774 (2022.01); G06V 20/597 (2022.01); G06V 40/174 (2022.01);
Abstract

Techniques for machine-trained analysis for multimodal machine learning vehicle manipulation are described. A computing device captures a plurality of information channels, wherein the plurality of information channels includes contemporaneous audio information and video information from an individual. A multilayered convolutional computing system learns trained weights using the audio information and the video information from the plurality of information channels. The trained weights cover both the audio information and the video information and are trained simultaneously. The learning facilitates cognitive state analysis of the audio information and the video information. A computing device within a vehicle captures further information and analyzes the further information using trained weights. The further information that is analyzed enables vehicle manipulation. The further information can include only video data or only audio data. The further information can include a cognitive state metric.


Find Patent Forward Citations

Loading…