Bae Systems, Inc.

Christopher James Whiteford

Nicholas Giacomo Robert Colosimo

Julian David Wright

Mark Robert Goodall

Heather Jean Page

A mixed reality control apparatus for a system having at least one remote data source requiring at least one physical control input, the apparatus comprising a headset for placing over a user's eyes, in use, the headset including a screen, the apparatus further including a processor configured to receive data from the at least one remote data source and display the data on the screen within a three-dimensional virtual environment, and image capture means for capturing images of the real world environment in the vicinity of the user, the processor being further configured to: blend at least portions or objects of the images of the real world environment into the three-dimensional virtual environment to create a mixed reality environment, including the data, to be displayed on the screen; and generate a virtual representation of the at least one physical control input and blend the virtual representation into the mixed reality environment at a selected location, and generate a marker representative of the selected location; wherein the apparatus is configured to receive a user input in association with the marker, identify the user input as an action in respect of the control input, or the virtual representation thereof, and generate a control signal to effect the action accordingly.

Interactive system control apparatus and method

A mixed reality system for creating a terminal control station enabling communication with and/or control of remote functions and applications, the system comprising a headset () for placing over a user's eyes, in use, said headset including a screen (), the system further comprising a processor () configured to receive data from multiple sources and display said data on said screen within a three-dimensional virtual environment, and an input for receiving control information data from an external data source within the real world environment, said processor () being further configured to receive image data representative of said external data source and blend said image data into said three-dimensional virtual environment to create a mixed reality environment, including a representation of said external data source and said control information data, to be displayed on said screen (), the system being configured to allow a user, in use, to manipulate data displayed within said mixed reality environment.

Interactive control station

An apparatus for effecting a control action in respect of a function within a virtual or mixed reality system, the control action corresponding to a predefined bodily movement of an authorized user of said function, wherein an authorized user is defined by a predetermined criterion in respect of a selected body part and/or a passive device carried thereon. The apparatus comprises a detection module for detecting a predefined bodily movement; a multi-spectral imaging system for capturing spectral reflectance and/or emission data at a plurality of wavelengths in respect of said selected body part and/or the passive device carried thereon; and an analysis module for comparing at least a portion of the spectral data with data corresponding to an authorized user of said function to determine if said criterion is met, and outputting a signal to effect said control action only if said criterion is met.

Apparatus and method for effecting a control action in respect of system functions

Apparatus for selectively displaying an operational area comprising an internal and an external environment separated from another by at least one physical obstruction, the apparatus comprising a headset including a screen for placing over a user's eyes, the system further comprising a processor configured to generate a three-dimensional virtual environment, and an image capture device for capturing images of the internal environment, said processor being configured to blend image data representative thereof into said three dimensional virtual environment to create a mixed reality environment including a representation of said at least one physical obstruction, the processor configured to receive image data representative of said external environment and to remove at least a portion of said physical obstruction from said mixed reality environment displayed on said screen, and blend said image data of said external environment into said mixed reality environment wherein said physical obstruction appears to be transparent.

Apparatus and method for selectively displaying an operational environment

An image processing method and apparatus for determining depth in an original image captured by a light field image capture device, in which a light field analysis algorithm is applied a plurality of times to the original image, changing the focus setting each time, so as to generate a respective plurality of scene images focused at different depths; edge detection is performed in respect of each of the scene images to generate a respective plurality of edge detected images; area identification is performed in respect of each edge detected image to generate a respective plurality of area identification images indicative of areas of respective edge detected images in which edges have been detected; and the area identification images are applied to respective scene images so as to extract from the scene images respective image segments corresponding to the areas in which edges have been detected.

Growing community of inventors

Warton, United Kingdom

Christopher James Whiteford