Magic Leap, Inc.

Sony Corporation

Sony Pictures Technologies Inc.

John Monos

Thomas Marshall Miller, Iv

Takashi Kuribayashi

Andrew Rabinovich

Eric C Browy

Jason A Schaefer

Zhiheng Jia

Etienne Gregoire Grossmann

Miller Harry Schuck, Iii

Marshall Charles Capps

Lei Zhang

Kazunori Tanaka

Nukul Sanjay Shah

Grace Vesom

Daniel Paul Sheerin

Nicholas Ihle Morley

Joelle Zimmermann

Ohad Zohar

Robert Zito

A user may interact and view virtual elements such as avatars and objects and/or real world elements in three-dimensional space in an augmented reality (AR) session. The system may allow one or more spectators to view from a stationary or dynamic camera a third person view of the users AR session. The third person view may be synchronized with the user view and the virtual elements of the user view may be composited onto the third person view.

Spectator view of virtual and physical objects

Examples of the disclosure describe systems and methods for generating and displaying a virtual companion. In an example method, a first input from an environment of a user is received at a first time via a first sensor. An occurrence of an event in the environment is determined based on the first input. A second input from the user is received via a second sensor, and an emotional reaction of the user is identified based on the second input. An association is determined between the emotional reaction and the event. A view of the environment is presented at a second time later than the first time via a display. A stimulus is presented at the second time via a virtual companion displayed via the display, wherein the stimulus is determined based on the determined association between the emotional reaction and the event.

Systems and methods for artificial intelligence-based virtual and augmented reality

A method for characterizing a digital color camera includes, for each of three primary colors used in a field sequential color virtual image, determining a conversion model for each color using RGB values and the color-measurement values. For each primary color, the method includes illuminating a display device using an input light beam of a primary color having spectral properties representative of a light beam in a virtual image in a wearable device. The method includes capturing, with the digital color camera, an image of the display device, and determining, from the image, RGB values for each primary color. The method includes capturing, with a color-measurement device, a color-measurement value associated with each corresponding primary color at the display device, thereby acquiring a color-measurement value in an absolute color space. A conversion model for each color is determined using RGB values and the color-measurement values.

Method and system for color calibration of an imaging device

Examples of the disclosure describe systems and methods for generating and displaying a virtual companion. In an example method, a first input from an environment of a user is received at a first time via a first sensor on a head-wearable device. An occurrence of an event in the environment is determined based on the first input. A second input from the user is received via a second sensor on the head-wearable device, and an emotional reaction of the user is identified based on the second input. An association is determined between the emotional reaction and the event. A view of the environment is presented at a second time later than the first time via a see-through display of the head-wearable device. A stimulus is presented at the second time via a virtual companion displayed via the see-through display, wherein the stimulus is determined based on the determined association between the emotional reaction and the event.

Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically select avatar characteristics that optimize gaze perception by the user, based on context parameters associated with the virtual environment.

Avatar customization for optimal gaze discrimination

Systems and methods are disclosed to provide a highly convenient and practically automated system for creation of highly-realistic menisci for CG characters. Creating the meniscus in the correct place and maintaining its correlation with moving eyes and eyelids was in the past difficult. The systems and methods disclosed provide a highly-realistic way to create and control such features. The systems and methods may create the meniscus in a procedural fashion, allowing the meniscus to properly track movements of character eyes and eyelids and to be animated in a highly-realistic fashion.

System and method for procedural CG eye meniscus

Growing community of inventors

Venice, CA, United States of America

John Monos