Raytheon Company

Tyler Layne Hook

Carl A Woody

Christopher J Beardsley

Liam Skoyles

Justin T Martin

David M Zimmerman

Anthony Santamaria

Benjamin P Lane

Justin Martin

A sensor data processing apparatus can be coupled to multiple image sensors of different types. The apparatus adjusts frame transmission rates based on the number of sensors and type of image data sourced by the sensors to optimize utilization of bandwidth on a number of transport channels. The apparatus can be configured to transport selected frames in the image data that are identified as critical frames at a higher rate than non-selected frames in the image data.

Transporting ultra-high definition video from multiple sources

Adaptive bitrate streaming of UHD image data

An interconnect apparatus performs real time scoring and data throughput measurement of parallel data channels. The scoring and measurement information is communicated as feedback across the interconnect. Processing circuitry in the interconnect apparatus routes data to channels that have the best performance and reduces the data rate on channels that have lower performance based on the feedback information. This provides a method of dynamic load balancing to achieve optimal video data rates in a dynamic impedance environment. The interconnect apparatus also adjusts phase and data sampling times for improved fidelity of data transported across the interface.

Video load balancing and error detection based on measured channel bandwidth

A sensor data processing system and method performs segmentation and packing of image data from one or more ultra-high definition (UHD) image sensor for transport and processing by conventional high definition image data processing systems and pathways. The UHD image frames are segmented into a number of smaller frames and directed in parallel over the conventional HD pathways. Metadata is generated and directed along with the smaller frames. The metadata includes sufficient information for lossless reconstruction of the UHD image frames from the smaller frames.

Method for encoding and processing raw UHD video via an existing HD video architecture

A system for transporting fast frame rate video data from a high frame rate image sensor mosaics and spreads the fast frame rate video data in 1920&#xd7;1080p30 video frames for transporting via an existing standard video architecture. Packing information, spreading information, and unique ID/timestamps for each frame is encoded in metadata and inserted in ancillary metadata space of the 1080p30 video frames. A robust encoding scheme generates the metadata and ensures that the transported video can be reassembled into its original fast frame rate form after being spread over multiple channels.

Method for encoding raw high frame rate video via an existing HD video architecture

A sensor data processing apparatus can be coupled to multiple image sensors of different types. The apparatus determines a geolocation of areas imaged in each frame or pixel based on sensor geolocation information and encodes the geolocation information in metadata space of the corresponding frame. The apparatus is configured to align edges and/or corners of the frame with edges or corners of adjacent frames based on the geolocation information to stitch together a mosaic or panoramic image without overlapping frames. The apparatus can be figured to stitch together image frame in real time without performing feature registration and without resampling frames.

Real time frame alignment in video data

A sensor data processing apparatus can be coupled to multiple image sensors of different types. The apparatus encodes symbology metadata in metadata space of image frames and maintains raw data from the sensors in the frames. The symbology metadata identifies a type of symbol that can be overlaid on the frame along with a location in the frame that identifies where the symbol can be overlaid. The apparatus transports the frames including the symbology metadata to an output path without overlaying symbology onto the raw data in the frames. Post processing can be performed to selectively overlay symbology in the image of a corresponding frame based on the symbology metadata.

Symbology encoding in video data

Aspects are generally directed to multi-sensor boresight alignment methods and systems for a multi-spectral reimaging optical system. In one example, a multi-sensor boresight alignment system includes a system interface to receive a first image frame from a first sensor and a second image frame from a second sensor, the first image frame having a contrast within a first spectral band and including a first image of a plate having a pattern of apertures, and the second image frame having a contrast within a second spectral band and including a second image of the plate. The system includes a field programmable gate array (FPGA) coupled to the system interface, the FPGA configured to spot track each image frame to identify a corresponding centroid of the pattern of apertures and correct an optical alignment between the first and second sensors based on a position of the corresponding centroids.

Growing community of inventors

Waltham, MA, United States of America

Tyler Layne Hook