Lockheed Martin Corporation

CEO Vision, Inc

Other

Virtus Corporation

David A Smith

Gregory Anthony Harrison

Brian Upton

Aran Lunzer

Yoshiki Ohshima

Patrick John Goergen

Gary E Wiese

Jason M Black

Vanessa Ada Freudenberg

Randel A Crowe

Glenn Clark Cuddihy

Anselm Eickhoff

Bert Freudenberg

John Schooley Camp

Ralph Spickermann

Danielle Marie Holstine

Joshua D Kitain

Eric W Worden

Dragos Maciuca

Eric Sorokowsky

Jonathan Charles Brant

Cynthia M Saelzer

Hasan W Schwandes

Michael A Dembinski

Carmen M Grama

Gary E Weise

Rick Boggs

Ehsan Ghaneie

David W Easter

Gregory Anhony Harrison

Systems and methods for a shared virtual environment are provided. The systems and methods include a unique architecture where domains known as 'islands' are replicated across various local machines. These islands include objects that publish events. These events include messages that are provided from the island's controller, to a reflector for the addition of a timestamp. The timestamp ensures computational synchronization between all mirrored islands. The timestamped messages are provided from the reflector back to the controllers of the various islands. The controllers incorporate these messages into the existing message queue based upon the message timing. The local machines then execute the messages in time order, until the external message indicates. These timestamp “heartbeats” thus dictate the execution activity across all islands and ensure synchronization of all islands.

Systems and methods for secure, low bandwidth replicated virtual worlds for shared space computing

Systems and methods for a unitary physics engine and image smoothing is provided. In this method, a game and a plug-in physics engine are initialized on multiple gaming systems. Time advancement messages are received by a controller within the physics engine from a reflector, causing the physics engine to compute events in a queue up to the time of the timing message, according to the same set of physics rules. This causes a deterministic computation of all object positions within the game that is identical across all gaming systems. In between the deterministic calculations, the local gaming system may compute speculative object positions, based upon the last deterministic position and the accelerations, velocities and object attributes at that moment. These speculative calculations may be performed at least as often as the frame rate of the display (typically 30, 60 or 120 frames per second). Once the next deterministic calculations are refreshed, the true position of the objects may be compared against the current speculative position, and if needed, a reconciliation may be performed.

Systems and methods for an object movement engine in a gaming environment

Systems and methods for a controlling a shared virtual environment are provided. The systems and methods includes a public display connects to a reflector via a network. A shared virtual environment is replicated on the public display. A QR code is displayed on the public display for scanning by a mobile device. The QR code includes instructions to download a controller interface and location of the reflector. The mobile device provides inputs, via the reflector, to the shared virtual environment. This causes mirroring of computations on each of the plurality of objects across the shared virtual environment deterministically. Further, a new message from the reflector with an appended timestamp is transmitted to advance time within the public display. Inputs from the mobile device may include a touchscreen input corresponding to rendered joysticks and buttons, and/or an accelerometer input after position of the mobile device has been calibrated related to the public display.

Systems and methods for control of a virtual world

Systems and methods for generating a virtual environment in a flock of vehicles are provided. In this method a reflector is utilized to define a coverage area. Sensory data from autonomous vehicles within this coverage area is collected, along with non-vehicle data. Then a virtual environment may be replicated using the data at a local computational device on each of the vehicles via the transmission of messages through the reflector. Each vehicle can use this data to make decisions regarding movements, as well as having the traffic patterns optimized based upon an objective. When traffic flow is being optimized it is also possible to assign weights to the vehicles to provide them preferential treatment in the traffic flow model. The traffic flow model that is generated may be a fluid dynamics model, or may be based upon deep learning techniques. The objective for the model is generally to maximize total vehicle throughput in order to reduce overall traffic congestion.

Systems and methods for vehicle flocking for improved safety and traffic optimization

A head-mounted display (HMD) apparatus comprising at least one optical system, each optical system comprising a lens having a reflective optical surface and an HMD device associated with and distanced from the reflective optical surface. The HMD device comprises a substrate having horizontal and/or vertical convex curvatures having a curved geometric profile which continuously curves with smooth transitions in horizontal and/or vertical dimensions. The curved profile is dimensioned to curve around a temple of a wearer and extend in a direction toward an ear of a wearer. The substrate comprising a plurality of pixel elements arranged along the horizontal convex curvature and being controlled to selectively radiate light representative of computer-generated content (CGC) to the associated reflective optical surface such that those selected pixel elements for display emanate rays of the light for subsequent reflection from the reflective optical surface toward a respective one eye of the wearer.

Full human field of view (FOV) wrap around head-mounted display apparatus with a convex display device

An optical system that includes a lens element and a lens element holder. The optical system also includes a display device holder that is configured to hold a display device having a single light-emitting panel. The lens element includes a right-eye reflective surface and a left-eye reflective surface. The right-eye reflective surface includes a first plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of a first portion of the light-emitting panel toward a predetermined right-eye location, and the left-eye reflective surface includes a second plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of a second portion of the light-emitting panel toward a predetermined left-eye location.

Multiple-eye, single-display, ultrawide-field-of-view optical see-through augmented reality system

Multiple-reflector ultrawide field of view (UWFOV) systems and methods are provided. In one embodiment, a head-wearable display device includes a frame, a narrow-beam light source fixed with respect to the frame, a UWFOV reflective surface fixed with respect to the frame, and a diverging reflective surface fixed with respect to the frame that is configured to receive light emitted from the narrow-beam light source and reflect the light toward the UWFOV reflective surface to spread the light completely across the UWFOV reflective surface.

Head-wearable ultra-wide field of view display device

Head-mounted displays () are disclosed which include a frame (), an image display system () supported by the frame (), and a Fresnel lens system () supported by the frame (). The HMD () can employ a reflective optical surface, e.g., a free-space, ultra-wide angle, reflective optical surface (a FS/UWA/RO surface) (), supported by the frame (), with the Fresnel lens system () being located between the image display system () and the reflective optical surface (). The Fresnel lens system () can include at least one curved Fresnel lens element (). Fresnel lens elements () for use in HMDs are also disclosed which have facets () separated by edges () which lie along radial lines () which during use of the HMD pass through a center of rotation () of a nominal user's eye () or through the center of the eye's lens () or are normal to the surface of the eye's cornea.

Head-mounted display apparatus employing one or more Fresnel lenses

A curved Fresnel lens is provided. The Fresnel lens includes a grooved surface and a smooth surface. The grooved surface includes a plurality of concentric sloped facets and a plurality of concentric draft facets. Pairs of concentric draft facets and concentric sloped facets form a plurality of concentric grooves in the grooved surface. The concentric sloped facets are configured to focus light toward an eye of a nominal user. At least some of the concentric draft facets are congruent with conical surfaces of respective imaginary light cones that have corresponding vertices that originate from respective focal points, wherein each imaginary light cone extends through the Fresnel lens at an angle based in part on an index of refraction of the Fresnel lens and extends beyond the grooved surface into free space.

Fresnel lens with reduced draft facet visibility

Embodiments relate to an immersive viewer system and viewer housing. The system comprises a viewer housing having first and second viewing apertures and a device holder. The system includes a first set of Fresnel lenses in-line with the first viewing aperture and a second set of Fresnel lenses in-line with the second viewing aperture. The system may include a computing device having a generally rectangular profile with a narrow depth configured to be supported in the device holder such that a display screen of the computing device is directly viewable through the first and second viewing apertures. The first set and second set of Fresnel lenses bend a two-dimensional (2D) image displayed by the display screen to fully cover 180 degrees of a human field-of-view. The first and second sets of Fresnel lenses are configured to cause the 2D image to appear as a three-dimensional (3D) image.

Three-dimensional (3D) immersive viewer system

A system including a structure attachable to a surface in a real world environment, the structure establishing a known location and orientation of the structure, a docking element, as part of the structure, to secure an augmented reality device in a stationary position for alignment of the augmented reality device with the real world environment and with a parallel virtual environment, and a processor operable to perform the alignment by resetting the inertial navigation system of the augmented reality device to the known location when docked in the docking element and aligning the location and orientation of the virtual representation of the augmented reality device in the parallel virtual environment so that the parallel virtual environment in the augmented reality device overlaps the real world environment. A method and computer software produce are also disclosed.

System, method and computer program product for real-time alignment of an augmented reality device

A method of designing lenses includes defining a material having an inside reflective surface spanning an area, and providing an optical design algorithm which defines a plurality of oxels across the area. Each oxel has a plurality of sub-elements including a center sub-element and a plurality of neighboring sub-elements. Based on a defined optical prescription for the inside reflective surface, an optically corrected reference 3D surface is calculated for each oxel having spherical and cylindrical corrections relative to a spherical contour which spans a predetermined field of view (FOV) with respect to a single (common) predetermined reference point. A position of at least a first of the sub-elements for each of the oxels is moved to approach respective final 3D positions on the optically corrected reference 3D surface, where the moving is constrained to be along an individual line connecting each of the first sub-elements to the single predetermined reference point.

Free-space lens design method

A head mounted display (HMD)-based training tool includes a HMD, sensor components, and electronics components. The sensor components include an external environment sensor for obtaining data of a real training scene. The electronics components include a simulator including at least one processor coupled to receive the real training scene data. The simulator generates virtual image data based on simulator input signals, where the virtual image data represents at least one virtual object. A display device is coupled to receive the virtual image data from the simulator. A field of view (FOV) of the HMD includes the virtual object from the display device and a real-world view of the real training scene, wherein the simulator modifies the virtual image data responsive to changes in the simulator input signals.

Growing community of inventors

Cary, NC, United States of America

David A Smith