Brelyon, Inc.

Massachusetts Institute of Technology

Georgia Tech Research Corporation

Barmak Heshmat Dehkordi

Christopher Barsi

Albert Redo Sanchez

Ramesh Raskar

Alok Ajay Mehta

I-Hung Ting

Albert Redo-Sanchez

Hisham Bedri

Matthew Tancik

Tarushree Gandhi

Gordon Moseley Andrews

Ik Hyun Lee

Achuta Kadambi

Ayush Bhandari

Justin Romberg

Mohammadreza Khorasaninejad

Alireza Aghasi

Ahmed Othman

Tomohiro Maeda

Systems and methods are described for immersive teleconferencing applications using a display system and a camera or camera system. In some embodiments, a display and optical system produces a virtual image for a viewer to view, ambient light (reflected) from the viewer entering the optical system is captured by a camera. A reflection removal module optically or computationally removes stray light from the camera image. In some embodiments, a plurality of cameras computationally produces a fused image of a viewer or viewer's environment.

Apparatus, systems, and methods for immersive teleconferencing and video experiences using optical displays and computational optics

A display system that is configured for integration into a vehicle comprises a light source and an optical subsystem optically coupled to the light source. The optical subsystem includes a reflector and at least one semi-reflective optic, wherein the optical subsystem is configured to direct light rays to provide a plurality of virtual images that appear to a viewer concurrently at a respective plurality of different optical depths, by causing light of each of the virtual images to travel a different distance within the optical subsystem before exiting the optical subsystem on a path toward eyes of the viewer.

In-vehicle display with stereoscopic and monocular depth programming

An optical subsystem for use in a display system or an imaging system comprises a plurality of reflective surfaces collectively arranged to provide variable control of device-internal path lengths of light coming to an imaging sensor or traveling a path to an eye of a viewer. The optical subsystem can be used to provide multiple images concurrently at different apparent depths as perceived by the user.

Wearable device with 1D-1D optical surfaces for stereoscopic and monocular depth programming

In some embodiments, a display system comprises a set of reflective or semi-reflective elements. A display emits light such that one portion of the light travels a first path through the display system, and another portion travels a second path, which includes a reflection from a windshield. The two portions form virtual images that are simultaneously viewable in a headbox. In some embodiments, the source of light that forms the image is an ambient source, and the display system is at least in part a sunlight-driven display system. In some embodiments, virtual images have a monocular depth that is far from a viewer. In some embodiments, the virtual images are closer to a viewer, and a gesture camera captures information about gestures made by a viewer, said gestures modifying the virtual images or some property or dynamics of the vehicle.

Multipurpose virtual display systems for integrated HUDs, instrument clusters, and interactive displays using internal and ambient lighting

A system and method for generating compact light-field displays through varying optical depths provides digital content in a more effective and efficient manner. The system includes a field-evolving cavity with a cavity exit pupil, a relay mechanism, and a system enclosure with an enclosure exit pupil. The field-evolving cavity modifies the light-field displays before outputting the light-field displays with the cavity exit pupil. More specifically, the field-evolving cavity includes at least one display panel, which initially generates the light-field displays, and at least one optical-tuning mechanism, which subsequently modifies the light-field displays to varying optical depths. The system enclosure houses the field-evolving cavity and the relay mechanism. The relay mechanism directs the light-field displays from the cavity exit pupil to the enclosure exit pupil, which outputs the light-field displays to a user.

System and method for generating compact light-field displays through varying optical depths

Systems and methods of converting visual content for display on a virtual display system include extracting depth information from input visual content and formatting the input visual content and the depth information. The virtual display system may produce virtual images that are multifocal virtual images. The conversion of the input visual content into the multifocal virtual images may be impacted by properties of the human vision system, physical modeling of the input visual content, user input or sensory data, or generative content.

Systems and methods for display content conversion and optimization for virtual display systems

A display system and method for generating virtual images or light field images includes, in some embodiments, a display and a field-evolving cavity. The field-evolving cavity modulates the optical depth of the virtual image. In some embodiments, the components of the display system are curved. The focal plane of the virtual image is curved and may approximate a portion of a human horopter. In some embodiments, the display system is integrated into a part of a vehicle. Components of the display system may move relative to each other, such that the display system is collapsible or foldable when not in use.

Systems and methods for integrating into a vehicle virtual display systems using field evolving cavities and curved components

Systems and methods are described for generative or extended display experiences with generative functions. In some embodiments, a display system is a virtual display system. A plurality of input streams is generated and received by a function module, which operates on the input streams to produce modified display content. In some embodiments, the function module implements an artificial intelligence module. In some embodiments a user modifies the display content through user input, which includes eye gaze.

Methods and systems for interactive displays with intelligent generative content and tandem computing

Full lightfield with monocular and stereoscopic depth control via monocular-to-binocular hybridization

Display and imaging systems with 1D-1D optical surfaces for stereoscopic and monocular depth programming

A system for facilitating stress-adaptive virtual experience station includes a virtual display system and camera system coupled to a kinematic rig. An array of transducers coupled to the station interact with a user based on a feedback signal, configured for user health treatments, audio effects, or computational imaging techniques.

Methods, systems, apparatuses, and devices for facilitating stress-adaptive virtual exerience stations

Some implementations of the disclosure relate to an optical system, including: a first light source; a secondary light source that is optically coupled to the first light source; a reflective element that is transparent with respect to the first light source but reflective with respect to the secondary light source, the reflective element being disposed between the first light source and the secondary light source; and a semi-reflective layer disposed on the secondary light source, such that reflection of light from the secondary light source by the reflective element and back through the semi-reflective element results in greater than 25% of the light from first light source exiting the optical system.

Methods and systems for programming momentum and increasing light efficiency in deeper roundtrips of folded optics and cavities via time-space harmonics and moiré effects

Methods and systems for programming momentum and increasing light efficiency in deeper roundtrips of folded optics via axial refraction

Methods and systems for programming momentum and increasing light efficiency above 25% in folded optics and field evolving cavities via quantum effects

Systems and methods are described for improving the utilization of an extended display system. Some aspects relate to an extended display generator having an input stream module to generate or receive input streams. Input streams may be generated locally (e.g., by a game engine) or remotely (e.g., from the internet). A function module of the generator provides functions that modify or extract information from the input streams. Then extended display generator applies a template to the input streams and function outputs, defining how such display content is presented to a user. A graphical user interface is used to specify which input streams, functions, and visual template should be used. The extended display shows the selected input stream(s) and the functional output(s) in a format defined by the visual template.

Growing community of inventors

San Mateo, CA, United States of America

Barmak Heshmat Dehkordi