The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Apr. 21, 2020

Filed:

Sep. 11, 2018
Applicant:

Affectiva, Inc., Boston, MA (US);

Inventors:

Rana el Kaliouby, Milton, MA (US);

Seyedmohammad Mavadati, Watertown, MA (US);

Taniya Mishra, New York, NY (US);

Timothy Peacock, Concord, MA (US);

Panu James Turcot, Pacifica, CA (US);

Assignee:

Affectiva, Inc., Boston, MA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/08 (2006.01); G06K 9/00 (2006.01); G06N 3/04 (2006.01); G06K 9/62 (2006.01); G10L 25/63 (2013.01); G10L 21/0356 (2013.01); G10L 25/30 (2013.01); G06N 20/10 (2019.01);
U.S. Cl.
CPC ...
G06N 3/084 (2013.01); G06K 9/00302 (2013.01); G06K 9/6288 (2013.01); G06N 3/04 (2013.01); G06N 3/0454 (2013.01); G06N 3/0472 (2013.01); G06N 3/0481 (2013.01); G06N 20/10 (2019.01); G10L 21/0356 (2013.01); G10L 25/30 (2013.01); G10L 25/63 (2013.01);
Abstract

Techniques are described for machine-trained analysis for multimodal machine learning. A computing device captures a plurality of information channels, wherein the plurality of information channels includes contemporaneous audio information and video information from an individual. A multilayered convolutional computing system learns trained weights using the audio information and the video information from the plurality of information channels, wherein the trained weights cover both the audio information and the video information and are trained simultaneously, and wherein the learning facilitates emotional analysis of the audio information and the video information. A second computing device captures further information and analyzes the further information using trained weights to provide an emotion metric based on the further information. Additional information is collected with the plurality of information channels from a second individual and learning the trained weights factors in the additional information. The further information can include only video data or audio data.


Find Patent Forward Citations

Loading…