The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 26, 2024

Filed:

May. 18, 2023
Applicant:

Sony Interactive Entertainment Inc., Tokyo, JP;

Inventor:

Jorge Arroyo Palacios, San Mateo, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 3/01 (2006.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 3/16 (2006.01); G06T 13/40 (2011.01); G06T 17/20 (2006.01); G06V 40/16 (2022.01); G06V 40/20 (2022.01);
U.S. Cl.
CPC ...
G06F 3/16 (2013.01); G02B 27/0093 (2013.01); G02B 27/0101 (2013.01); G02B 27/017 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06T 13/40 (2013.01); G06T 17/20 (2013.01); G06V 40/166 (2022.01); G06V 40/174 (2022.01); G06V 40/176 (2022.01); G06V 40/20 (2022.01); G06V 40/28 (2022.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01);
Abstract

A method for communicating with users in a virtual reality space includes capturing images of a user during a session of interaction in the virtual reality space, with the captured images including hand gestures and facial expressions made by the user during a communication act. The method also includes processing state data generated during the session, to identify a context associated with the virtual reality space during the communication act. The method further includes generating an audio output representing an interpretation of the hand gestures and facial expressions. The audio output includes sound modifications that are dynamically applied based on the context of virtual reality space. Still further, the method includes presenting the audio output in the virtual reality space via an avatar of the user. The face of the avatar is correspondingly modified with a video overlay associated with the sound modifications, which update during the communication act.


Find Patent Forward Citations

Loading…