Magic Leap, Inc.

Richmond B Chan

Samuel A Miller

Wenyi Zhao

Randall E Hand

Bing Wu

Paul M Greco

Philip O'Connor

A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system possibly comprising a plurality of cameras that image the user's eye and glints thereon and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of cornea of the user's eye using data derived from the glint images. The display system may use spherical and aspheric cornea models to estimate a location of the corneal center of the user's eye.

Eye tracking using aspheric cornea model

Head-mounted augmented reality (AR) devices can track pose of a wearer's head to provide a three-dimensional virtual representation of objects in the wearer's environment. An electromagnetic (EM) tracking system can track head or body pose. A handheld user input device can include an EM emitter that generates an EM field, and the head-mounted AR device can include an EM sensor that senses the EM field (e.g., for determining head pose). The generated EM field may be distorted due to nearby electrical conductors or ferromagnetic materials, which may lead to error in the determined pose. Systems and methods are disclosed that measure the degree of EM distortion, as well as correct for the EM distortion. The EM distortion correction may be performed in real time by the EM tracking system without the need for additional data from imaging cameras or other sensors.

Ambient electromagnetic distortion correction for electromagnetic tracking

A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system possibly comprising a plurality of cameras that image the user's eye and glints thereon, and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of cornea of the user's eye using data derived from the glint images. The display system may use spherical and aspheric cornea models to estimate a location of the corneal center of the user's eye.

A method of operating a head mounted augmented reality display system includes producing an electromagnetic field using an electromagnetic emitter, positioned in a handheld controller and reflecting the electromagnetic field using a first electromagnetic reflector, positioned adjacent to the electromagnetic emitter, to form a modified electromagnetic field. The method also includes reflecting a portion of the modified electromagnetic field using a second electromagnetic reflector positioned in a headset and detecting the reflected portion of the modified electromagnetic field by an electromagnetic sensor positioned adjacent to the second electromagnetic reflector.

Method of operating a directed emitter/sensor for electromagnetic tracking in augmented reality systems

An electromagnetic tracking system includes a hand held controller including an electromagnetic emitter configured to generate an electromagnetic field characterized by an electromagnetic field pattern and a first electromagnetic reflector positioned adjacent the electromagnetic emitter and configured to form a modified electromagnetic field pattern. The electromagnetic tracking system also includes a head mounted augmented reality display including an electromagnetic sensor configured to sense the electromagnetic field and a second electromagnetic reflector adjacent to sensor configured to optimally sense electromagnetic field pattern in a region of interest.

Directed emitter/sensor for electromagnetic tracking in augmented reality systems

An augmented reality system comprises one or more sensors configured for capturing a set of data indicative of an emotional state of a user of the augmented reality system, and a processor configured for discerning the emotional state of the user based at least in part on the captured set of data, and rendering the discerned emotional state on an avatar of the user. The avatar can be displayed as a virtual object when viewed through one or more augmented reality display systems.

Creating a topological map for localization in augmented or virtual reality systems

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

Growing community of inventors

Arlington Heights, IL, United States of America

Richmond B Chan