Equinox Corporation

Other

Johns Hopkins University

Lawrence B Wolff

Diego A Socolinsky

Joshua D Neuheisel

Christopher K Eveland

Marvin Hutt

Andrea Selinger

Hua Chen

A methodology and apparatus is described that registers images outputted by at least two video camera sensors that are not necessarily bore-sighted nor co-located together. Preferably this can be performed in real-time at least at video rate. The two video camera sensors can be either of similar or two different modalities (e.g., one can be intensified visible, while the other can be thermal infrared) each possibly with a different field-of-view. The methodology and apparatus take advantage of a combination of Inertial Measurement Units (IMUs) information and image registration between the two camera sensors from computational image processing. In one preferred embodiment, the system uses a rifle mounted weapon sight camera sensor and a helmet mounted sensor camera. The aim point of the weapon sight camera sensor (e.g., typically at the image center) zeroed to the true rifle aim point is digitally overlayed as a reticle on the video image from the helmet sensor, displayed on a head mounted display (HMD). In another embodiment pixel-level image fusion is displayed across the overlapping field-of-view of the rifle mounted camera sensor weapon sight with the helmet mounted camera image.

Method and apparatus for dynamic image registration

A methodology for forming a composite color image fusion from a set of N gray level images takes advantage of the natural decomposition of color spaces into 2-D chromaticity planes and 1-D intensity. This is applied to the color fusion of thermal infrared and reflective domain (e.g., visible) images whereby chromaticity representation of this fusion is invariant to changes in reflective illumination.

Color invariant image fusion of visible and thermal infrared video

A methodology and apparatus is described that incorporates the use of thermal infrared imaging into a complete end-to-end face recognition system. Since thermal infrared primarily images emissive phenomenology there are advantages over video imaging in the reflective domain (e.g., visible, near-infrared) for face recognition, particularly with respect to image invariance in the presence of varying illumination incident on the subject. On the other hand video cameras in the reflective domain provide important image detail not apparent in thermal infrared imagery. Fusion of thermal infrared imagery with reflective domain (e.g., visible, near-infrared) imagery provides even further advantages. Embodiments of such systems that incorporate thermal infrared imaging for automatic face recognition are important for access control, verification, identification, and surveillance and monitoring.

Method and apparatus for using thermal infrared for face recognition

A sensor fusion system simultaneously acquires at least two images in a subspectrum of the visible/NIR/SWIR (0.4-2.0 micron) reflective spectrum and in a subspectrum of the thermal infrared (3.0-15 micron) spectral regions using respective sensing arrays viewing a common aperture. Although sensed by separate focal plane arrays, radiation enters at the front-end of a commonly shared focusing optical system so that all sensed radiation originates along exactly the same optical path and then is directed to each sensing plane. This provides precise co-registration of reflective and thermal infrared imagery regardless of the depth-of-field range of the scene being imaged, and enables the precise integration of image fusion processing and algorithms to fully exploit the complementary properties of reflected and thermally emitted radiation from a scene.

Common aperture fused reflective/thermal emitted sensor and system

A method is presented for the treatment and visualization of local contrast in n-dimensional multispectral images, which directly applies to n-dimensional multisensor images as well. A 2&times;2 matrix called the contrast form is defined comprised of the first derivatives of the n-dimenional image function with respect to the image plane, and a local metric defined on n-dimensional photometric space. The largest eigenvector of this 2&times;2 contrast form encodes the inherent local contrast at each point on the image plane. It is shown how a scalar intensity function defined on n-dimensional photometric space is used to select a preferred orientation for this eigenvector at each image point in the n-dimensional image defining the contrast vector field for an n-dimensional image. A grey level visualization of local n-dimensional image contrast is produced by the greylevel image intensity function such that the sum of the square difference between the components of the gradient vector of this intensity function and the components of the contrast vector field is minimized across the image plane. This is achieved by solving the corresponding Euler-Lagrange equations for this variational problem. An m-dimensional image, 1<m<n, visualization of n-dimensional data is produced by an m-dimensional image function such that the sum of the square difference between the components of the contrast form of this m-dimensional image and the components of the contrast form for the n-dimensional image is minimized across the image plane.

Visualization of local contrast for n-dimensional image data

An apparatus for determining electrical conductivity of a surface of an object. The apparatus comprises a first polarizer for polarizing light incident upon the surface of the object. The apparatus also comprises a camera mechanism for receiving the polarized light reflected from the surface of the object and identifying the electrical conductivity of the surface of the object from phase retardance of polarization of the polarized light upon reflection from the surface of the object. The present invention pertains to a method for determining electrical conductivity of a surface of an object. The method comprises the steps of polarizing light. Next there is the step of reflecting the polarized light off the surface of the object. Then there is the step of receiving the reflected polarized light at a camera mechanism. Next there is the step of converting the received polarized light into a corresponding electrical signal with the camera mechanism. Next, there is the step of determining phase retardance of polarization due to the reflection of the polarized light off of the surface of the object. Then, there is the step of identifying the electrical conductivity of the surface of the object from the phase retardance of the polarization of the polarized light reflected off of the surface of the object.

Method and apparatus for determining electrical conductivity of a

An apparatus comprising an optical filter which resolves electromagnetic radiation into a sequence of resolved polarization components. The apparatus is also comprised of an imaging device having a storage device. The imaging device is disposed adjacent to the optical filter to receive the sequence of resolved polarization components from the optical filter and store them in the storage device for subsequent processing. The present invention pertains to an apparatus for viewing. The apparatus comprises a frame. The apparatus also is comprised of a first optical filter mounted on the frame to cover one eye of a viewer when the viewer wears the frame. The first optical filter resolves electromagnetic radiation into a sequence of resolved polarization components so the viewer can view the sequence of resolved polarization components. The present invention also pertains to an apparatus for viewing. The apparatus is comprised of a housing. The apparatus also includes at least a first lens disposed in the housing through which a viewer looks to aid vision of the viewer. The apparatus is also comprised of a first optical filter attached to the housing and adjacent the lens so light passing through the lens essentially passes through the first optical filter. The first optical filter resolves electromagnetic radiation into a sequence of resolved polarization components so the viewer can view the sequence of resolved polarization components. The present invention also pertains to a method for interpreting a scene.

Method and apparatus for viewing

A polarization viewer comprising a mechanism for forming a broadview image having a spectral width greater than 2 angstroms and 0.50.degree. based on polarization information of a scene. The polarization viewer is also comprised of a mechanism for providing polarization information to the forming mechanism. The providing mechanism is in communication with the forming mechanism. In a first embodiment, the providing mechanism includes a camera mechanism in communication with the forming mechanism. The camera mechanism includes a fixed polarizer analyzer disposed such that electromagnetic radiation entering the camera mechanism passes through the polarizer analyzer. The providing mechanism can also include a mechanism for steering a polarization plane of the radiation. The steering mechanism is disposed such that radiation passing through the polarizer analyzer first passes through the steering mechanism. The steering mechanism preferably includes a first twist crystal and at least a second twist crystal aligned with the first twist crystal such that radiation passing through the first crystal then passes through the second crystal. Each crystal has a first state and a second state. The first state does not effect the polarization plane of the radiation as the radiation passes through the crystal. The second state rotates the polarization plane of the radiation as the radiation passes through the crystal.

Polorization viewer

A method and apparatus for determining object characteristics such as shape and relative electrical conductivity and for resolving specular and diffuse components of reflection are disclosed. These object characteristics are determined by measuring the following polarization parameters of reflected light from the object surface: (i) the magnitude of the minimum polarization component, (ii) the magnitude of the maximum polarization component, and (ii) the directional orientation of the minimum polarization component. These parameters are used to ascertain at an object point the specular plane and the ratio of the Fresnel reflection coefficients, perpendicular to parallel, with respect to the specular plane. Both of these are used for the determination of the surface normal at object points. The numerical value of the Fresnel reflection coefficient is used to discriminate between surfaces of varying electrical conductivity, lower values indicating highly conductive metals, higher values indicating poorly conducting dielectrics. The numerical value of the Fresnel reflection coefficient is used to resolve specular and diffuse reflection components.

Growing community of inventors

New York, NY, United States of America

Lawrence B Wolff