The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 15, 2022

Filed:

May. 15, 2020
Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventors:

Yelin Kim, Sunnyvale, CA (US);

Yang Liu, Los Altos, CA (US);

Dilek Hakkani-tur, Los Altos, CA (US);

Thomas Nelson, San Francisco, CA (US);

Anna Chen Santos, Mountain View, CA (US);

Joshua Levy, Cambridge, MA (US);

Saurabh Gupta, Sunnyvale, CA (US);

Assignee:

Amazon Technologies, Inc., Seattle, WA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G10L 25/63 (2013.01); G10L 15/26 (2006.01); G10L 15/18 (2013.01); H04N 5/247 (2006.01); H04N 5/232 (2006.01); G05D 1/00 (2006.01); G05D 1/02 (2020.01); G06T 7/70 (2017.01); G06V 20/10 (2022.01); G06V 40/10 (2022.01); G06V 40/16 (2022.01);
U.S. Cl.
CPC ...
G10L 25/63 (2013.01); G05D 1/0088 (2013.01); G05D 1/0251 (2013.01); G06T 7/70 (2017.01); G06V 20/10 (2022.01); G06V 40/10 (2022.01); G06V 40/161 (2022.01); G10L 15/1815 (2013.01); G10L 15/26 (2013.01); H04N 5/23299 (2018.08); H04N 5/247 (2013.01); G06T 2207/30201 (2013.01); G06T 2207/30244 (2013.01);
Abstract

Described herein is a system for improving sentiment detection and/or recognition using multiple inputs. For example, an autonomously motile device is configured to generate audio data and/or image data and perform sentiment detection processing. The device may process the audio data and the image data using a multimodal temporal attention model to generate sentiment data that estimates a sentiment score and/or a sentiment category. In some examples, the device may also process language data (e.g., lexical information) using the multimodal temporal attention model. The device can adjust its operations based on the sentiment data. For example, the device may improve an interaction with the user by estimating the user's current emotional state, or can change a position of the device and/or sensor(s) of the device relative to the user to improve an accuracy of the sentiment data.


Find Patent Forward Citations

Loading…