Google Inc.

Hendrik Wagenaar

Alex Olwal

John Paul Bates

Ruofei Du

A method including receiving, by a companion device from an optical display, a distortion information associated with a geometric distortion associated with rendering an image on a display of the optical display, distorting, by the companion device, the image using the distortion information, preprocessing, by the companion device, the distorted image based on compression artifacts, compressing, by the companion device, the distorted image, and communicating, by the companion device, the compressed image to the optical display

Compression-aware pre-distortion of geometry and color in distributed graphics display systems

An augmented reality (AR) device, such as AR glasses, may include a microphone array. The sensitivity of the microphone array can be directed to a target by beamforming, which includes combining the audio of each microphone of the array in a particular way based on a location of the target. The present disclosure describes systems and methods to determine the location of the target based on a gaze of a user and beamform the audio accordingly. This eye-tracked beamforming (i.e., foveated beamforming) can be used by AR applications to enhance sounds from a gaze direction and to suppress sounds from other directions. Additionally, the gaze information can be used to help visualize the results of an AR application, such as speech-to-text.

Foveated beamforming for augmented reality devices and wearables

Display pre-distortion methods and apparatus for HMDs are disclosed. A disclosed example method includes determining a position of a pupil relative to a lens of the head-mounted display (HMD), determining, based on the determined position, a pre-distortion map for an image to be displayed on a display screen of the HMD, and displaying the image on the display screen of the HMD, wherein the image is modified by the pre-distortion map.

Growing community of inventors

Mountain View, CA, United States of America

Hendrik Wagenaar