Apple Inc.

Guolin Peng

Hyungryul J Choi

Scott M DeLapp

Vikrant Bhakta

Eric J Hansotte

Se Baek Oh

Graham Butler Myhre

Paul J Gelsinger-Austin

Tyler G Anderson

David A Kalinowski

Brian S Lau

Francesco Aieta

Cameron A Harder

Bradley Charles Steele

Nan Zhu

Byron R Cocilovo

Kevin A Keilbach

Jonathan C Moisant-Thompson

Scott M Delapp

Bradley C Steele

A display system may include a waveguide and an input coupling prism. The waveguide may have a lateral surface with a deformed region. The prism may couple the light into the waveguide at an angle whereby the light first reflects off the deformed region. The display module may include a display panel that provides the light with planar wavefronts. The display module may include a deformation mitigation structure that distorts the planar wavefronts to produce non-planar wavefronts. The shape of the non-planar wavefronts may be selected to reverse distortion to the wavefronts of the light produced by the first reflection of the light off the deformed region of the lateral surface. This may serve to mitigate distortion in the light produced by the deformed region of the lateral surface and may serve to maximize the sharpness images in the image light provided to an eye box.

Optical systems with waveguide deformation mitigation structures

An electronic device may include an emissive display panel that emits light. The light may propagate along an optical path extending to an eye box. A waveguide with an input coupler and an output coupler may be interposed on the optical path. An angle-selective transmission filter (ASTF) may be interposed on the optical path and may filter the emitted light as a function of angle to remove high-angle light from the optical path before the light is provided to the output coupler. The ASTF may include diffractive grating structures such as thin-film holograms, volume holograms, or surface relief gratings, louvered mirrors, multi-layer coatings, or a pinhole array. This ASTF may serve to minimize stray light within the display, thereby optimizing the contrast and the modulation transfer function (MTF) of the display.

Optical systems having angle-selective transmission filters

An electronic device may include an optical combiner with a waveguide. The waveguide may have an output coupler that directs high resolution light towards an eye box within a field of view. Peripheral light sources may provide low resolution peripheral light to the eye box about a periphery of the field of view. The peripheral light sources may be mounted to a frame for the waveguide, to an additional substrate mounted to the frame and overlapping the waveguide, in a low resolution projector that projects the peripheral light towards reflective structures in the additional substrate, or in a display module that produces the high resolution light. The optical combiner may overlay real world light with the high resolution light and the low resolution peripheral light.

Optical systems with low resolution peripheral displays

An electronic device may have a spatial light modulator. Control circuitry in the electronic device may use the spatial light modulator to generate images. A light source may be used to produce illumination for the spatial light modulator. An optical system may direct the illumination onto the spatial light modulator and may direct corresponding reflected image light towards eye boxes for viewing by a user. Head-mounted support structures may be used to support the spatial light modulator, light source, and optical system. The light source may include light-emitting elements such as light-emitting diodes or lasers. Multiple light-emitting elements may be provided in the light source in a one-dimensional or two-dimensional array. During operation, the control circuitry can individually adjust the light-emitting elements.

Electronic device with multi-element display illumination system

A display having a reflective display panel may provide image light to an eye box. The panel may include mirrors rotatable between first and second angles. The mirrors may take a non-zero time period to transition between the first and second angles. During the non-zero time period, the light source may emit pulses of illumination. The mirrors may reflect the pulses of illumination as offset pupils of image light. The mirrors may be at respective intermediate angles while reflecting each of the pulses of illumination. The mirrors may toggle between the first and second angles at a sufficiently fast rate such that the offset pupils form an effective pupil that is expanded in at least one dimension. If desired, the offset pupils may be used to display virtual objects in different focal planes at the eye box.

Optical systems for leveraging the non-zero transition time of display panel mirrors

An electronic device may provide foveated images at an eye box. The device may have a first display module that produces a low resolution portion of the image and a second display module that produces a high resolution portion of the image. A reflective input coupling prism may be mounted to a waveguide. A steering mirror may overlap the prism. The mirror may receive the high resolution portion through the waveguide and the prism. The mirror may reflect the high resolution portion back into the waveguide and may be adjusted to shift a location of the high resolution portion within the image. For example, the steering mirror may adjust the position of the high resolution portion to align with the gaze direction at the eye box. A reflective surface of the prism may reflect the low resolution portion of the image into the waveguide.

Optical systems with multiple light engines for foveation

An electronic device may include a display system for presenting images close to a user's eyes. The display system may include a display unit that directs light and an optical system that redirects the light from the display unit towards a user's eyes. The optical system may include an input coupler and an output coupler formed on a waveguide. The input coupler may redirect light from the display unit so that it propagates in the waveguide towards the output coupler. The output coupler may redirect the light from the input coupler so that it exits the waveguide towards the user's eyes. A light-redirecting element may be used to redirect edge light that would otherwise be outside of the user's field of view towards the user's eyes.

Optical systems for displays

An electronic device may include a display module that generates light and an optical system that redirects the light towards an eye box. The system may include an input coupler on a waveguide and a lens that directs the light towards the input coupler. The input coupler may include a prism having a reflective surface that reflects the light into the waveguide. The reflective surface may be curved to provide the light with an optical power. The prism may be configured to expand a field of view of the light. A birefringent beam displacer may expand the effective pupil size of the light. The lens may include lens elements that converge the light at a location between the lens elements and the waveguide. A switchable panel may be placed at the location and toggled between first and second orientations to increase the effective resolution of the light.

Optical systems with reflective prism input couplers

An electronic device may include a display module that produces foveated images having high and low resolution regions. The module may include a reflective display panel that produces first reflected light during first time periods and second reflected light during second time periods. The first reflected light may reflect off of a beam splitter to form the low resolution region of the foveated image. The second reflected light may be transmitted by the beam splitter, de-magnified by a lens, and redirected by an optical steering element to produce the high resolution region at a desired, adjustable, location in the foveated image. The reflective display panel may be replaced by sets of emissive display panels that concurrently display the high and low resolution regions in the foveated image. The sets of emissive display panels may be replaced by front-lit reflective display panels.

Optical systems having multiple light paths for performing foveation

The display may include a display module and a waveguide. The module may produce first light of first wavelengths during first time periods and may produce second light of second wavelengths during second time periods interleaved with the first time periods. Diffractive gratings or a dichroic wedge may redirect the first light into the waveguide at a first angle and may redirect the second light into the waveguide at a second angle separated from the first angle by a separation angle. The separation angle may be equal to half the angle subtended by the projection of a pixel in the module. The first and second time periods may alternate faster than the response of the human eye. This may configure the first and second image light to collectively provide images at an eye box with an increased effective resolution without increasing the space or power consumed by the display module.

Optical systems with resolution-enhancing spectral shifting

An electronic device such as a head-mounted display may have a display system that produces images. The display system may have one or more pixel arrays (--) such as liquid-crystal-on-silicon pixel arrays. Images from the display system may be coupled into a waveguide () by an input coupler system (X,Y) and may be coupled out of the waveguide in multiple image planes using an output coupler system (X,Y). The input and output coupler systems may include single couplers, stacks of couplers, and tiled arrays of couplers. Multiplexing techniques such as wavelength multiplexing, polarization multiplexing, time-division multiplexing, multiplexing with image light having different ranges of angular orientations, and/or tunable lens techniques may be used to present images to a user in multiple image planes.

Head-mounted display system

An electronic device may have a display that emits image light, a waveguide, and an input coupler that couples the image light into the waveguide. Beam splitter structures may be embedded within the waveguide. The beam splitter structures may partially reflect the image light multiple times and may serve to generate replicated beams of light that are coupled out of the waveguide by an output coupler. The beam splitter structures may replicate the beams across two dimensions to provide an eye box with uniform-intensity light from the display across its area. The beam splitter structures may include stacked partially reflective beam splitter layers, sandwiched transparent substrate layers having different indices of refraction, a thick volume hologram interposed between substrate layers, or combinations of these or other structures. The reflectivity of the beam splitter structures may vary discretely or continuously across the lateral area of the waveguide.

Waveguided display systems

An electronic device may have a pixel array. A light source may illuminate the pixel array to produce image light. The image light may pass through a multi-element lens and may be coupled into a waveguide using an input coupler such as a prism. An output coupler such as a diffraction grating may couple the image light out of the waveguide and towards a user. The user may view the image light and may observe real-world objects through the waveguide. The waveguide may have locally modified portions that define an aperture stop at a distance from an exit surface of the multi-element lens. The multi-element lens may have first and second achromatic doublets and first and second singlets between the first and second achromatic doublets. The lens elements of the multi-element lens may include lens elements with aspheric surfaces.

Optical systems for electronic devices with displays

An electronic device may include a display module that generates light and an optical system that redirects the light towards an eye box. The system may include an input coupler that couples the light into the waveguide. The input coupler may include a prism on the waveguide and a scanning mirror. The scanning mirror may receive the light through the waveguide and the prism and may reflect the light into the waveguide through the prism while being rotated over a set of orientations. The scanning mirror may fill a relatively large field of view eye box with a corresponding image frame despite the limited field of view of the image light produced by the display module. The orientation of the scanning mirror may be adjusted based on gaze tracking data.

Optical systems with scanning mirror input couplers

An electronic device may have a reflective display with a pixel array that generates images. The reflective display may be illuminated by an illumination system. Light from the illumination system may be reflected by the pixel array as image light. The image light may be provided to a viewer using a waveguide with diffractive input and output couplers. The illumination system may have a waveguide. The illumination system may also have a light source such as one or more light-emitting diodes. Light from the light source may be coupled into the waveguide of the illumination system by a diffractive coupler such as volume hologram that serves as an input coupler. Light from the light source may be routed to the display to illuminate the display using the waveguide in the illumination system and a diffractive coupler such as a volume hologram that serves as an output coupler.

Growing community of inventors

Santa Clara, CA, United States of America

Guolin Peng