International Business Machines Corporation

Magic Leap, Inc.

Amazon Technologies, Inc.

Massachusetts Institute of Technology

Other

Lexmark International, Inc.

Edwin Joseph Selker

Joseph D Rutledge

Samuel A Miller

Lionel Ernest Edwin

Ivan Li Chuen Yeoh

Ronald Jason Barber

Paul M Greco

Barton Allen Smith

Jeffrey Scott Sommers

Bradley Vincent Stuart

Daniel Farmer

Lomesh Agarwal

Yonatan Munk

Sergey Fyodorovich Prokushkin

Ivan L Yeoh

Kenneth Mark Karakotsios

Isaac Scott Noble

Daniel Alexander Ford

Adam Charles Carlson

William Marvin Dyer

Paul Philip Maglio

Bjorn Nicolaas Servatius Vlaskamp

Christopher Karl Eisbach

Todd Clossen Wyant

Michio Suzuki

Robert Carl Barrett

Erik Fonseka

Steven Ka Cheung Moy

Winslow Scott Burleson

Shiuli Das

Suraj Manjunath Shanbhag

Kim Wesley May

Derek Solomon Pai

Jonathan Noble Betts

Shumin Zhai

Christopher D Coley

Leo Benedict Baldwin

Myron Dale Flickner

Jerome J Cuomo

William Spencer Worley, Iii

Qi Lu

Lawrence H Koved

Charles Albert Rudisill

William Thomas Weatherford

Eric Andrew Knopf

Yoshiharu Uchiyama

Dragutin Petkovic

John Haggis

John Daniel Upton

Kenshin Yonemochi

Boris Kamentser

Ronald Franklin Marks

David Bruce Koons

Matthew F Cali

Carlos Hitoshi Morimoto

Donald J Mikalsen

Rowan L Dordick

Ramiro Ramirez

Daniel Clark Kellem

Julius Akinyemi

Jeffrey Daniel Allison

Kazunori Seki

Tomoyuki Takahaski

Liam P Corballis

Robert J Kelley

Jason M Jacobs

Connor Dickie

Matthew Hockenberry

Jon Wetzel

Ivan Li Yeoh

A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content may have an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.

Depth plane selection for multi-depth plane display systems by user categorization

Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.

Systems and methods for operating a display system based on user perceptibility

A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system that images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at a determined position relative to the determined position of the center of rotation of said eye.

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.

A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.

A method is disclosed, the method comprising the steps of receiving, at a first time interval from a first sensor configured to output data indicative of a first position of an eye, first data; receiving, at a second time interval from a second sensor configured to output data indicative of a delta position of the eye, second data; determining, based on the first data, a first position of the eye; determining, based on the second data, a delta position of the eye; determining, using the first position of the eye and the delta position of the eye, a second absolute position of the eye; and in response to determining the second position of the eye, generating an output signal indicative of the second position of the eye.

Multimodal eye tracking

A low distraction interface can be provided for an electronic device by monitoring information such as a gaze direction of a user. A device can be configured to only display information to a user when the user is looking substantially toward the device, and can be configured to present that information in a way that is of minimal distraction to others nearby. The user can control aspects of the display by looking away from the device, continuing to look at the device for a period of time, or otherwise providing input without physically interacting with the device. Such an approach can be beneficial for settings such as business meetings where a user might want to obtain information from the device but does not want to appear inconsiderate by picking up and checking information on the device.

Low distraction interfaces

An architecture includes a system to create an augmented reality environment in which images are projected onto a scene and user movement within the scene is captured. In addition to primary visual stimuli, the architecture further includes introduction of a secondary form of sensory feedback into the environment to enhance user experience. The secondary sensory feedback may be tactile feedback and/or olfactory feedback. The secondary sensory feedback is provided to the user in coordination with the visual based activity occurring within the scene.

Augmented reality environment with secondary sensory feedback

Growing community of inventors

Palo Alto, CA, United States of America

Edwin Joseph Selker