Sri International

L-3 Communications Corporation

Philip Miller

Supun Samarasekera

Rakesh Kumar

Vincent Paragano

Han-Pang Chiu

Mikhail Sizintsev

Keith James Hanna

Harpreet Singh Sawhney

Manoj Aggarwal

Aydin Arpa

Mark Alan Sartor

Nikhil Gagvani

Ryan Villamil

Zachary Seymour

Niluthpol C Mithun

Glenn Murray

Alex Krasner

Abhinav Rajvanshi

Peter Demers

Xun Zhou

Junjiao Tian

Kevin Kaighn

Arthur Robert Pope

Daniel Clement Williams

A method, machine readable medium and system for RGBD semantic segmentation of video data includes determining semantic segmentation data and depth segmentation data for less than all classes for images of each frame of a first video, determining semantic segmentation data and depth segmentation data for images of each key frame of a second video including a synchronous combination of respective frames of the RGB video and the depth-aware video in parallel to the determination of the semantic segmentation data and the depth segmentation data for each frame of the first video, temporally and geometrically aligning respective frames of the first video and the second video, and predicting semantic segmentation data and depth segmentation data for images of a subsequent frame of the first video based on the determination of the semantic segmentation data and depth segmentation data for images of a key frame of the second video.

RGBD video semantic segmentation with temporal and geometric consistency

During GPS-denied/restricted navigation, images proximate a platform device are captured using a camera, and corresponding motion measurements of the platform device are captured using an IMU device. Features of a current frame of the images captured are extracted. Extracted features are matched and feature information between consecutive frames is tracked. The extracted features are compared to previously stored, geo-referenced visual features from a plurality of platform devices. If one of the extracted features does not match a geo-referenced visual feature, a pose is determined for the platform device using IMU measurements propagated from a previous pose and relative motion information between consecutive frames, which is determined using the tracked feature information. If at least one of the extracted features matches a geo-referenced visual feature, a pose is determined for the platform device using location information associated with the matched, geo-referenced visual feature and relative motion information between consecutive frames.

Collaborative navigation and mapping

A system and method for preparing for distribution to, distributing to and/or use by one or more devices broadband data associated with intelligence information garnered from an aerial vehicle ('AV'): The method may include obtaining from sensors coupled to the AV video depicting an area of surveillance, obtaining metadata associated with the video, aligning, temporally, the video and metadata, using reference information to align, spatially, the video and metadata, forming for distribution to the at least one device enhanced metadata as a function of the video, metadata and reference information, wherein the enhanced metadata is operable to enable displaying at the devices at least a portion of the video, whereby after receiving a distribution of the enhanced metadata, the devices are operable to display such portion of the video.

Method and apparatus for capture and distribution of broadband data

According to an aspect of the invention, a system for providing immersive surveillance a site has a plurality of cameras each producing a respective raw video of a respective portion of the site. A processing component receives the raw video from the cameras and generates processed video from it. A visualization engine is coupled to the processing system, and receives the processed video therefrom. The visualization engine renders real-time images corresponding to a view of the site in which at least a portion of the processed video is overlaid onto a rendering of an image based on a computer model of the site. The visualization engine displays the images in real time to a viewer. The processing component comprises first and second filter modules. The second filter module processes video received as output from the first filter module. A controller component controls all transmission of data and video between the first and second filter modules.

Modular immersive surveillance processing system and method

Growing community of inventors

Yardley, PA, United States of America

Philip Miller