The Schepens Eye Research Institute, Inc.

Google Inc.

University of Murcia

Eliezer Peli

Alexander James Faaborg

Joshua L Weaver

Clayton Woodward Bavor, Jr

Gang Luo

Shrinivas Pundlik

Daejoon Alex Hwang

Fernando Vargas-Martin

Jae-Hyun Jung

Mark B Spitzer

Anurag Gupta

Behnam Bastani

Benjamin McLaughlin Gallant

JaeHyun Jung

Cheng Qiu

Jr Clayton Woodward Bavor

An implementation of an optical system for expanding the field of view can include a first optical element and a second optical element. The first optical element can include a first surface and a second surface. The first surface can be configured to reflect a first light beam incident on the first surface at a first incident angle greater than a first predetermined angle, and the second surface can be configured to reflect the reflected first light beam towards a location. The second optical element can include a third surface and a fourth surface. The third surface can be configured to reflect a second light beam incident on the third surface at a second incident angle greater than a second predetermined angle, and the fourth surface can be configured to reflect the reflected second light beam towards the location. Related apparatus, systems, techniques and articles are also described.

Expansion of field of view

A system for providing information about an environment to a user within the environment is featured. An electronic processor is configured to receive input including a user selection of an object of interest from among potential objects of interest. The electronic processor is further configured to provide output to guide the user to move the detection apparatus to position the object of interest near a reference point on a field of view of the detection apparatus, obtain multiple images of the object of interest during the user's movement of the detection apparatus, and crop each of the images to keep the object of interest near a reference point on each of the images.

Motion parallax in object recognition

An example technique may include performing, by a virtual reality application provided on a computing device, video rendering at a first video rendering rate based on updating an entire image on a screen of the computing device at a first update rate, determining that a performance of the video rendering is less than a threshold, performing, based on the determining, video rendering at a second video rendering rate by updating a first portion of the image at the first update rate, and by updating a second portion of the image at a second update rate that is less than the first update rate. Another example technique may include shifting, during an eye blinking period, one or both of a left eye image and a right eye image to reduce a disparity between a left viewed object and a right viewed object.

Adjusting video rendering rate of virtual reality content and processing of a stereoscopic image

The disclosure features systems and methods for providing information to a user about the user's environment. The systems feature a detection apparatus configured to obtain image information about the environment, where the image information corresponds to information at multiple distances relative to a position of the user within the environment, and an electronic processor configured to obtain focal plane distance information defining a set of one or more distance values relative to the position of the user within the environment, construct one or more confocal images of the environment from the image information and the set of one or more distance values, wherein each of the one or more confocal images corresponds to a different distance value and includes a set of pixels, and transform the one or more confocal images to form one or more representative images having fewer pixels and a lower dynamic range.

Active confocal imaging systems and methods for visual prostheses

The disclosure features information display systems that include a display device, at least one sensor, and an electronic processor connected to the display device and to the at least one sensor. During operation of the system, for a set of pixels of the display device that are used to display visual information, the electronic processor is configured to determine a range of target luminance values for a subset of the pixels for which a Weber contrast value is less than the contrast threshold value, adjust luminance values for the set of pixels so that at least some members of the subset of pixels have Weber contrast values, based on their adjusted luminance values, that exceed the contrast threshold value, and display the visual information on the display device using the members of the set of pixels with the adjusted pixel luminance values.

Methods and systems for adjusting contrast in devices

A head mounted display (HMD) for displaying images to a user includes a sensor unit configured to detect motion of a head of the user of the HMD. The HMD also includes one or more processors configured to, in response to the motion, reduce contrast in a peripheral area of an image displayed to the user from an original contrast of the image, the image having a foveal area and the peripheral area relative to the optical axis of the eye of the user, the contrast being least reduced in a first portion of the peripheral area closest the foveal area and being most reduced in a second portion of the peripheral area farthest from the foveal area.

Reducing visually induced motion sickness in head mounted display systems

Displaying video in an HMD may include introducing unperceived noise to the video frame signal in order to enhance dynamic range. For example, each of a viewer's left and right eyes have a field of view (FOV) corresponding to a portion of pixels shown on the HMD. For each of these portions of pixels, the VR system may combine a noise signal (e.g., zero-mean Gaussian white noise) with the video signals corresponding to each of the portions of pixels. The introduction of such noise may improve the dynamic range of the viewer. Further, in some implementations, the noise signal that is combined with the left video signal may be slightly different from the noise signal that is combined with the right video signal. Such slightly different noise signals may provide further improvement to the image seen by the viewer due to binocular summation.

Virtual reality system using super-resolution

In some implementations, there is provided a method. The method may include receiving data characterizing a plurality of digital video frames; detecting a plurality of features in each of the plurality of digital video frames; determining, from the detected features, a local scale change and a translational motion of one or more groups of features between at least a pair of the plurality of digital video frames; and calculating a likelihood of collision. Related apparatus, systems, techniques, and articles are also described.

Collision prediction

The disclosure features three-dimensional stereoscopic imaging systems and methods that include two image capture devices configured to obtain images of a scene, at least one display screen, and an electronic processor configured to: receive one or more images of the scene from the capture devices, where each of the one or more images includes a lateral dimension and a height; warp the one or more images along their respective lateral dimensions to at least partially correct for disparity distortions associated with displaying the one or more images on the at least one display screen; correct the one or more images by scaling the respective heights of the images along the lateral dimensions of the images so that the height of each image is the same along the images lateral dimension; and display the warped and corrected one or more images on the at least one display screen.

Compensating 3D stereoscopic imagery

A head mounted display (HMD) device may include a housing coupled to a frame, and a display device disposed in the housing. A first lens may be disposed along a first optical axis in the housing, and a second lens may be disposed along a second optical axis in the housing. A divider may be positioned between the first lens and the second lens, with a front end portion of the divider positioned adjacent to the display device. The divider may include display capability so that images displayed on the display device may extend onto the divider. The divider may emit diffused light having chrominance and/or luminance levels corresponding to images displayed on the display device. The divider may reflect diffused light from images displayed on the display device. The divider may transmit diffused light from images displayed on the display device.

Display of binocular overlapping images in a head mounted display

The disclosure features systems for providing information to a user about the user's environment, the system featuring a detection apparatus configured to obtain image information about the environment, where the image information corresponds to information at multiple distances relative to a position of the user within the environment, and an electronic processor configured to obtain focal plane distance information defining a set of one or more distance values relative to the position of the user within the environment, construct one or more confocal images of the environment, from the image information and the set of one or more distance values, wherein each of the one or more confocal images corresponds to a different distance value and comprises a set of pixels, and transform the one or more confocal images to form one or more representative images comprising fewer pixels and a lower dynamic range.

In some example implementations, there is provided an apparatus. The apparatus may include a plurality of prism portions configured to shift light passing through the apparatus including the plurality of prisms portions, and a plurality of portions configured to pass light unshifted through the apparatus, wherein the apparatus combines the shifted light and the unshifted light passing through the apparatus. Related apparatus are also disclosed.

Vision modification based on a multiplexing prism

A head mounted display ('HMD') includes a display module that displays a primary viewing image at a focus distance. The display module also displays a focusing cue image at the focus distance to aid a user of the HMD in focusing on the primary viewing image at the focus distance.

Growing community of inventors

Boston, MA, United States of America

Eliezer Peli