The University of Arizona

Leland Stanford Junior University

Hitachi, Ltd.

Yuzuru Takashima

Brandon Hellman

Lambertus Hesselink

Yao-Te Cheng

Braden Smith

Max Yuen

Kenichi Shimada

Toshiteru Nakamura

Toshiki Ishii

Paul Christopher Hansen

Matthew Salem

Yin Yuen

Sunglin Wang

Alex J Erstad

Joshua Rodriguez

Young-Sik Kim

Guanghao Chen

Christopher R Summitt

A design and implementation of a new optical architecture: space, time, and angular division multiplexed image transfer by Digital Micromirror Device. The method, like various multiplexing methods employed in communication engineering, enables image transfer via an angular band-limited data channel such as an optical image guide by dynamically redistributing a signal into multiple domains such as space, time, angle, wavelength, and polarization.

Space, time and angular multiplexed dynamic image transfer for augmented reality display

A light projection system includes an angle-dependent pattern projection device projecting light of multiple patterns into corresponding multiple directions, and a waveguide comprising an input and an output, configured to accept the light from the angle-dependent pattern projection device and emit the light through the output, whereby the light from each of the multiple patterns takes a unique path through the waveguide. The waveguide is built into a headset display device, and the output of the waveguide couples light emitted through the output to an eye.

Waveguide for angular space light modulator display

A mobile augmented reality near to eye display having one of a single chip programmed, configured, or adapted to permit user selective field of view and a variable resolution image projection, or a single image guide adapted to multiplexed full color image transfer to achieve full color, 90 degrees FOV, and retinal image resolution.

Augmented near to eye display

A LIDAR system architecture which transmits light via an optical phased array and receives the reflected signal with a spherically shift invariant sensor. Phased arrays offer the ability to quickly scan a desired area by manipulating the electrical, or in this case-thermal, properties of an array of sensors. Similarly spherically shift invariant systems offer the ability to bring light into focus at the same location regardless of its angle of arrival.

Optical phased arrays and spherical shift invariant sensors for use in advanced LIDAR systems

A rotationally shift invariant and multi-layered array system for full-field of view and/or photon collection by 4 pi steradian field of view. In the system, all of the incoming light (i.e., light from all directions), in a solid angle of 4 pi steradians, is focused inside the optics. The optics have a spherically shift invariant structure, providing rotational shift invariance. The system comprises a nontraditional use of the Gabor Superlen and is a configuration of multiple microlens array shell structures with concentrically arranged bulk optical components. Examples of such bulk optical components include Luneburg lenses, micro-structured surfaces, a single lens, a plurality of single lenses, ball lenses, metalenses, diffractive optical elements, and magnetic lenses. In an embodiment, the Gabor Superlens (i.e., microlens array) is planar. In an embodiment, no moving parts are required for the system to achieve truly full-field of view imaging and/or photon collection by 4 pi steradian field of view.

Rotationally shift invariant and multi-layered microlens array

A gaze tracking platform for human-machine interface device, such as a wearable Augmented Reality Near-to-Eye Display. The gaze tracking method, digital illumination assisted analog feedback tracking employs neither auxiliary camera nor digital image processing of human eye image that confronts challenges in gaze tracking speed, power, cost and space. Instead, an analog-digital hybrid method to track the gaze inspired by the groove tracking method that is widely adopted for optical data storage systems. In the method, a digital micromirror device generates angular modulated and infrared illuminating beam. The cornea reflects the infrared light and a segmented photodiode detects the reflection while providing a feedback servo signal to the digital micromirror device controller. The feedback signal is integrated over a time provides the variation gaze. Moreover, infrared and angularly modulated illumination is time-multiplexed with information displayed in visible wavelength. In this manner, single display device is dual used for information display and gaze tracking that benefits especially augmented reality devices in terms of achieving small device form factor.

Digital illumination assisted gaze tracking for augmented reality near to eye displays

A light projection system including a light source and a light controller to generate modulatable beams of light and an angular light modulator (ALM) positioned to selectively direct the light from each beam. The light controller can be a spatial light modulator or a processor programmed to control light output. The angular light modulator may be a digital micromirror device (DMD). The ALM may be configured to direct the images into diffraction orders or using scanning the images. A LIDAR system to detect a position of an object including a first source of a two-dimensional array of beams of light and ALM to project light into a selected one of a plurality of directions. An illumination system, comprising a first angular-spatial light modulator (ASLM) and a second ASLM system configured such a first beam and a second beam of light intersect.

Methods and apparatus employing angular and spatial modulation of light

A light projection system for projecting full-resolution, high quality images into different directions. The system includes a light source configured to provide a homogenous output beam of light and an illumination shaping optic elements configured with at least one of a predetermined cone angle, numerical aperture, and F-number. The system also includes a spatially-dependent, angular light modulator (ALM) with a plurality of pixels, each having an ON state, an OFF state, one input pupil, and N diffraction order pupils. The ALM is positioned such that the output beam is incident on the plurality of pixels. The at least one of the predetermined cone angle, numerical aperture, and F-number of the illumination shaping optic elements prevents contaminating light from entering an incorrect pupil. The system additionally includes a processor coupled to the ALM to provide discrete diffraction-based beam steering, whereby the ALM will project into one diffraction order at one time.

Angular spatial light modulator multi-display

A beam steering apparatus including a first actuatable micromirror array (AMA) having a pitch, p, adapted to impart a modulation to a wavefront incident on the first AMA by a transition between a first state and a second state, wherein the first AMA has a transition time (T) between the first state and the second state, and at least one light source adapted to provide the incident wavefront having a duration, t, to the first AMA, where t&#x2264;T. The AMA may be a MEMS device such as a digital micromirror array. The beam steering apparatus may constitute a portion of LIDAR system.

Systems and methods for beam steering using a micromirror device

A lithographic method for making an out-of-plane optical coupler includes forming a photoresist layer of positive photoresist material over a substrate. The positive photoresist layer undergoes a flood exposure to light through a binary mask to pattern a latent image of a mirror blank in the photoresist layer. A laser beam is scanned over the latent image of the mirror blank to apply controlled dosages of light at specified locations to form a latent image of a planar mirror surface that is oriented at a prescribed non-zero angle to a plane in which the substrate extends. The positive photoresist material is developed so that a remaining portion of the developed positive photoresist material forms an out-of-plane optical coupler having a planar mirror surface that is oriented at the prescribed angle.

Fast fabrication of polymer out-of-plane optical coupler by gray-scale lithography

A light projection system comprising a light modulator that comprises a plurality of pixels each capable of selectively directing a corresponding modulatable amount of light, and a processor coupled to the light modulator to control the amount of light output from each of the plurality of pixels. The processor is configured to control the light modulator to form a computer generated hologram (CGH) wavefront from the light modulator corresponding to an image to be produced in the far field. The processor is also configured to control the light modulator to selectively direct the CGH wavefront. The light modulator may comprise an angular light modulator (ALM) comprising the plurality of pixels, each of the plurality of pixels having an OFF state and an ON state, the ALM arranged to direct the amounts of light in the direction as the pixels transition between the ON state and the OFF state.

Methods and apparatus for angular and spatial modulation of light

A light projection system, including a light source to provide an output beam of light, an angular light modulator (ALM) comprising a plurality of pixels, each pixel having an ON state and an OFF state, the ALM positioned to receive output beam on the plurality of pixels, and a processor coupled to the ALM. The processor is programmed to control a first set of the pixels to transition between the OFF state and the ON state while the beam is incident on the pixels. An amount of light is selectively directed in a direction by the first set. The processor is also programmed to control a second set of the plurality of pixels to remain in the OFF state while the beam is incident on the plurality of pixels. As a result, the ALM operates as a spatial light modulator and an angular light modulator of the beam of light.

A light projection system including a light source, a light controller optically and/or electrically coupled to the light source to generate a plurality of spatially-separated and independently-modulatable beams of light, and an angular light modulator (ALM) positioned to receive the beams of light and selectively direct the light from each beam into one of a plurality of directions. The light source can include a laser diode array. The light controller can be a spatial light modulator or a processor programmed to control an output of each of the lasers of the laser diode array. The angular light modulator may be a digital micromirror device (DMD). The ALM may be configured to project the images into corresponding diffraction orders of the ALM or the ALM may be configured to continuously scan the images.

An image guide comprising glass or plastic planar substrate, a first hologram area, a second hologram area, and a third hologram area which are formed on the substrate as surface relief grating, period and direction of diffraction structure of the first, second, and third hologram areas have a relationship which is a sum of grating vectors of the first, second, and third hologram areas becomes zero, depth of diffraction structure on the first hologram area is a uniform in the own hologram area, and depth of diffraction structure on the second or third hologram area is chirped in the own hologram area increases luminance and uniformity of virtual image.

Imageguide for head mounted display

Single X-ray grating differential phase contrast (DPC) X-ray imaging is provided by replacing the conventional X-ray source with a photo-emitter X-ray source array (PeXSA), and by replacing the conventional X-ray detector with a photonic-channeled X-ray detector array (PcXDA). These substitutions allow for the elimination of the G0 and G2 amplitude X-ray gratings used in conventional DPC X-ray imaging. Equivalent spatial patterns are formed optically in the PeXSA and the PcXDA. The result is DPC imaging that only has a single X-ray grating (i.e., the G1 X-ray phase grating).

Growing community of inventors

Tucson, AZ, United States of America

Yuzuru Takashima