Google Inc.

Christie Digital Systems Usa, Inc.

Stuart James Myron Nicholson

Timothy Paul Bodiya

Jerrold Richard Randell

Daniel Robert Adema

Isaac James Deroche

Shreyas Potnis

Lai Pong Wong

Stefan Alexander

Dustin Griesdorf

Steven Benjamin Goldberg

Bergen Fletcher

Ido Raveh

Ian Andrews

Andrew S Logan

Lawrence Goerzen

Chris Brown

Systems and techniques are described for generating a color image by computationally combining chromatically undersampled and shifted information present in multiple component image frames captured via a sparse color filter array that includes a minority of wavelength-filtered picture elements and a remaining majority of panchromatic picture elements. A burst capture is initiated of multiple image frames via a color filter array comprising a plurality of subunits, each subunit including a minority of one or more wavelength-filtered adjacent pixels and a majority of remaining panchromatic pixels. Each of the multiple image frames is processed to generate a resulting color image.

Sparse color image sensor system

A method including generating at least one of a key frame and an inter-predicted frame based on a received video stream including at least one video frame, the inter-predicted frame being generated using information from the key frame, determining whether the key frame is stored at a receiving device, selecting video data as one of the key frame or a key frame identifier representing the key frame based on whether the key frame is stored at the receiving device, and communicating at least one of the video data and the inter-predicted frame.

Advanced video coding using a key-frame library

A non-transitory computer-readable storage medium can comprise instructions stored thereon. When executed by at least one processor, the instructions can be configured to cause a mobile computing device to receive, from a companion device, multiple files, each of the multiple files including at least media content, a trigger condition, and an action to be performed upon satisfaction of the trigger condition. The action included in at least one of the files can include playing media content from another one of the multiple files. The instructions can be further configured to cause the mobile computing device to play the media content included in at least one of the multiple files, receive at least one additional file from the companion device, erase at least one of the multiple files, and play media content included in the at least one additional file.

Playing media content in response to triggers

There is provided a method including receiving an incoming ID at a first wearable heads-up display (WHUD), which incoming ID is associated with a communicant device. The method also includes sending match data from the first WHUD to a match engine. The match data includes a first WHUD ID and the incoming ID. Moreover, the method includes receiving a match indicator at the first WHUD from the match engine. The match indicator is to indicate a match event between the first WHUD and the communicant device based on the match data. Furthermore, the method includes effecting communication between the first WHUD and the communicant device comprising at least one of sending a message from the first WHUD to the communicant device and receiving at the first WHUD a corresponding message from the communicant device. The first WHUD, and a method of operating the match engine are also described.

Communication methods and systems

Systems, devices, and techniques are provided for reducing graphical bandwidth in a projection display system by modifying a modulation frequency used to display one or more portions of content based on an identified content type of such portions. Content is received for display, and types of content associated with one or more portions of the received content are identified. For each respective portion of content, an effective resolution is selected for displaying the respective portion based on the identified content type for the respective portion, and one or more light beams directed to a respective display area of a projection surface are modulated at a respective emitter modulation frequency that corresponds to the selected effective resolution for the respective portion.

Scanning projector dynamic resolution

Systems, devices, and methods for accommodating multiple sets of laser light sources in an optical engine of a display system such as a laser projection system are described. Laser light beams may be combined via wavelength-, polarization-, and/or angular-separation-based techniques. First and second sets of laser light beams may be angularly separated such that different sets of partially overlapping pixels are projected by the system, thereby increasing the display pixel density and/or an expanding the field of view of the display. One or more laser die may be mounted to each submount of the optical engine. For embodiments with two laser dies on each submount, collimating lenses may introduce angular separation between laser light beams output by each pair of commonly mounted laser dies. A retroreflector prism may be disposed at a beam combiner to provide a compact extension of the optical path through the beam combiner.

Beam combining architectures for scanning display systems

Multiple laser light source sets for scanning display systems

A laser projection system utilizes a waveguide having a narrow incoupler for double-bounce mitigation and form factor reduction. An optical scanner includes an optical relay positioned in between two scan mirrors. The first scan mirror scans laser light into the optical relay in a first dimension, and the optical relay and converges the scanned laser light towards a second scan mirror. The second scan mirror scans laser light along a second dimension substantially perpendicular to a path over which the laser light is scanned across the second scan mirror, and the convergence introduced by the optical relay causes the laser light to be scanned as a line or arc path of an exit pupil plane that is coincident with the incoupler. The optical relay may include one or more lenses or may be a monolithic molded structure, which may be an Offner-style relay or a molded reflective relay.

Systems, devices, and methods for inputting light from a scanning laser projector into a waveguide

A display system varies a size of a field of view area of a display for augmented reality (AR) applications based on at least one of ambient light in the environment and content displayed at the display and varying a brightness level of the field of view area such that the brightness level within the field of view area is inversely proportional to the field of view area. Based on an amount of ambient light detected in the environment of the display system, the display system adjusts the size of the area of the field of view of the display in inverse proportion to the amount of detected ambient light. As the size of the field of view area decreases, the display system increases the brightness level of the display within the field of view such that the brightness level is approximately inversely proportional to the field of view area.

Variable brightness and field of view display

A wearable heads-up display includes a power source, laser sources, and a lightguide. A photodetector is positioned to detect an intensity of a test light emitted at a perimeter of the lightguide from an optical path within the lightguide. A laser safety circuit provides a control to reduce or shut off a supply of electrical power from the power source to the laser sources in response to an output signal from the photodetector indicating that the detected intensity is below a threshold.

Wearable heads-up display with optical path fault detection

Systems, devices, and methods for eyebox expansion in wearable heads-up displays ('WHUDs') are described. The WHUDs described herein each include a projector and an optical waveguide positioned in an optical path between the projector and an eye of the user. For any given light signal from the projector, the optical waveguide receives the light signal at an input coupler and outputs multiple instances or copies of the light signal from multiple discrete, spatially-separated output couplers. The multiple instances or copies of the light signal may be converged by the optical waveguide directly to respective exit pupils at the user's eye or may be routed by the optical waveguide to a holographic combiner in the user's field of view from which the light signals may be converged to respective exit pupils at the user's eye. The optical waveguide employs exit pupil replication to expand the eyebox of the WHUD.

Systems, devices, and methods for waveguide-based eyebox expansion in wearable heads-up displays

There is provided a method of operating a wearable heads-up display (WHUD). The WHUD may include a light source, a spatial modulator, and a display optic. The method may include generating, by the light source, an output light to form an image viewable by a user of the WHUD. The method may also include receiving a position of a pupil of the user relative to an eyebox of the WHUD, and obtaining an image correction map based on the position of the pupil. Moreover, the method may include adjusting the output light to form an adjusted output light. The adjusted output light may be adjusted based on the image correction map to reduce at least one of an intensity non-uniformity and a color balance non-uniformity of the image. The method may also include directing, by the display optic, the adjusted output light into a field of view of the user.

Displays and methods of operating thereof

Systems, devices, and methods for generating, processing, assembling, and/or formatting data for display are described. Example display controllers are described in which image data is stored in a framebuffer, and a compositor selectively retrieves portions of the image data. At least one P-operator produces lines of intermediate P-operated data by performing at least one intra-line operation on the image data retrieved by the compositor, such as repeating or reordering pixels of the image data. A Q-operator produces a stream of pixel data by performing inter-line operations on the intermediate P-operated data, such as interpolating between lines of the P-operated data. A display is driven according to the stream of pixel data.

Systems, devices, and methods for assembling image data for display

There is provided a method including obtaining an initial spatial coordinate of a pixel of an image to be projected. The method may also include generating a pre-warped spatial coordinate associated with the initial spatial coordinate. The pre-warped spatial coordinate may be calculated as a sum of a value of a warp path function at the initial spatial coordinate and a delta. Moreover, the method may include outputting the pre-warped spatial coordinate.

Growing community of inventors

Waterloo, Canada

Stuart James Myron Nicholson