Apple Inc.

William W Sprague

Paul V Johnson

Qiong Huang

Victoria C Chan

Nan Zhu

Elijah H Kleeman

Brandon E Clarke

Milad Akhlaghi Bouzan

Cheng Kai Chen

Jeremy C Franklin

Jim Chen Chou

Zhibing Ge

Moinul H Khan

Hao Pan

Aidan N Zimmerman

Phil M Hobson

Andreas G Weber

Jiaying Wu

Aleksandr M Movshovich

Sorin Constantin Cismas

Arthur Yasheng Zhang

Wey-Jiun Lin

Shih-Chyuan Fan Jiang

Hyungryul J Choi

Graham Butler Myhre

Nicolas P Bonnier

David W Lum

Forrest C Wang

Kristina A Babiarz

Sreeraman Anantharaman

Jia Tao

Giovanni Carbone

Branko Petljanski

Harsha Shirahatti

Holly Gerhard

Mehmet N Agaoglu

Thomas R Matzinger

Yashas Rai Kurlethimar

Anna V Mirabella

Christina G Gambacorta

Edward Allen Valko

Nischay Goel

Shubham A Gandhi

Blake N Trekell

Matin Seadat Beheshti

Duncan A K Mcroberts

Pretesh A Mascarenhas

Luke A Pillans

Lionel E Edwin

Anup Rathi

Shannon Pomeroy

Tahereh Majdi

Tyler B Milhem

Edward A Valko

Hyungryul Choi

Graham B Myhre

A scene depicted using a binocular display device may be mis-calibrated in the vertical axis and generate vertical alignment error. A free-fusion state inducing scene may be first displayed that presents a user of the device with a contrasting scene that allows the user to recognize effects of vertical alignment error. Once accustomed to the free-fusion inducing scene, a vertical alignment error measurement scene may be displayed to the user to determine the vertical alignment error generated due to the miscalibration of the device. Based on the observed vertical alignment error, user input may be obtained to align the two patterns. A correction factor may be determined based on the user input and the device may be calibrated based on the correction factor.

Perceptual measure of end-to-end splay

A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.

Head-mounted display device with vision correction

An electronic device may have a display panel with an array of display pixels. Light from the display panel may be focused by a lens assembly towards a viewer. The presence of the lens assembly may cause geometric distortion for a viewer viewing images on the display through the lens assembly. To mitigate geometric distortion, geometric distortion compensation may be performed in the electronic device. The electronic device may include both a fixed lens element and a removable lens element in the lens assembly. The removable lens element may be changed, allowing the distortion function associated with the lens assembly to change over time. To dynamically compensate for geometric distortion caused by a lens assembly with a removable lens, ray tracing may be used to determine the geometric distortion caused by the lens assembly depending upon the particular removable lens that is present in the lens assembly.

Electronic device display having distortion compensation

An electronic device such as a head-mounted device may have a display that is viewable by a user from eye boxes. The electronic device may have a gaze tracking system that monitors a user's eyes in the eye boxes to gather gaze direction information. The display may have a central portion and a peripheral portion. The peripheral portion may have a lower resolution than the central portion and may be used in displaying content that is viewable in a user's peripheral vision. During operation, control circuitry in the electronic device may adjust peripheral content on the peripheral portion to correct for parallax-induced mismatch between the peripheral content and central content on the central portion of the display. The control circuitry may also depower peripheral pixels that are determined to be unviewable based on the gaze direction. Diffusers may be used to hide seams between the central and peripheral display portions.

Electronic device with central and peripheral displays

A head-mounted display may display images in eye boxes. Right and left gaze tracking sensors may gather left eye gaze information from a left eye box and right eye gaze information from a right eye box. During operation in a first mode in which the right and left gaze tracking sensors are not impaired, gaze information from the right and left gaze tracking sensors may be used in presenting foveated and distortion-corrected image content on the displays and/or in otherwise operating the left and right displays. During operation in a second mode in which one of the gaze tracking sensors is impaired, gaze information for the impaired sensor may be estimated from gaze information for the unimpaired sensor in combination with an object depth estimate based on depth buffer information, vestibulo-ocular-reflex gain information, and historical information.

Electronic devices with monocular gaze estimation capabilities

An electronic device such as a head mounted device may have a display that displays an image for a user. Head-mounted support structures may be used to support the display and to support lenses. The image on the display is visible through the lenses from eye boxes. The presence of the user's nose and the presence of opaque lens holder structures presents a risk that some of the image will be obscured by undesired black regions. To reduce or eliminate these black regions, facial illumination may be generated using a light source in the electronic device. The facial illumination may be provided by a light source such as a light-emitting diode die or laser or may be provided by a corner region of the display that contains pixels that do not supply any part of the image.

Display system with facial illumination

One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of left eye frame transmissions and right eye frame transmissions. The device switches data transmissions schemes according to wireless commination link quality or eye gaze tracking. Adjusting transmission format based on transmission quality of the wireless communication link allows the devices to take advantage of greater bandwidth when available to save power. An additional transmission format is based on alternately transmitting left eye and right eye frames for very low bandwidth.

Adaptive wireless transmission schemes

Aspects of the subject technology relate to gaze-dependent visual encryption of electronic device displays. Each display frame that is displayed on the electronic device display may include a clear-display region around the user's gaze location and an obscured region outside the clear-display region. In this way, only the display content that the user is actively viewing is recognizable and understandable and an onlooker such as an unwanted observer looking over the user's shoulder is unable to understand what is displayed. The obscured region of each display frame may be generated such that the overall look and structure of that region is unchanged, but the content is unintelligible. In this way, the visual experience of the user is not disrupted or distracted by the visual encryption and the eye of the onlooker is not guided to the clear-display region by the visual encryption.

Gaze-dependent display encryption

Growing community of inventors

Berkeley, CA, United States of America

William W Sprague