Sri International

Sarnoff Corporation

Bogdan Calin Mihai Matei

Harpreet Singh Sawhney

Rakesh Kumar

Hui Ting Cheng

Sang-Hack Jung

Supun Samarasekera

Ajay Divakaran

Dennis Lee Matthies

Saad Masood Khan

Chris Broaddus

Ying Shan

Mayank Bansal

Clay Douglas Spence

Michael Wade Hansen

Zhiwei Zhu

John Benjamin Southall

Raia Hadsell

Jayan Eledath

Barbara Hanna

Janet Kim

Nicholas John Vander Valk

Charles Fielding Finch Karney

Xiyang Dai

Arthur Robert Pope

Anil Usumezbas

Nhon Hoc Trinh

A method, machine readable medium and system for semantic segmentation of 3D point cloud data includes determining ground data points of the 3D point cloud data, categorizing non-ground data points relative to a ground surface determined from the ground data points to determine legitimate non-ground data points, segmenting the determined legitimate non-ground and ground data points based on a set of common features, applying logical rules to a data structure of the features built on the segmented determined non-ground and ground data points based on their spatial relationships and incorporated within a machine learning system, and constructing a 3D semantics model from the application of the logical rules to the data structure.

Fully automated multimodal system architecture for semantic segmentation of large-scale 3D outdoor point cloud data

Techniques are disclosed for identifying discriminative, fine-grained features of an object in an image. In one example, an input device receives an image. A machine learning system includes a model comprising a first set, a second set, and a third set of filters. The machine learning system applies the first set of filters to the received image to generate an intermediate representation of the received image. The machine learning system applies the second set of filters to the intermediate representation to generate part localization data identifying sub-parts of an object and one or more regions of the image in which the sub-parts are located. The machine learning system applies the third set of filters to the intermediate representation to generate classification data identifying a subordinate category to which the object belongs. The system uses the part localization and classification data to perform fine-grained classification of the object.

Machine learning system for generating classification data and part localization data for objects depicted in images

A computer implemented method for determining a vehicle type of a vehicle detected in an image is disclosed. An image having a detected vehicle is received. A number of vehicle models having salient feature points is projected on the detected vehicle. A first set of features derived from each of the salient feature locations of the vehicle models is compared to a second set of features derived from corresponding salient feature locations of the detected vehicle to form a set of positive match scores (p-scores) and a set of negative match scores (n-scores). The detected vehicle is classified as one of the vehicle models based at least in part on the set of p-scores and the set of n-scores.

3-D model based method for detecting and classifying vehicles in aerial imagery

A method and apparatus for determining a geographic location of a scene in a captured depiction comprising extracting a first set of features from the captured depiction by algorithmically analyzing the captured depiction, matching the extracted features of the captured depiction against a second set of extracted features associated with reference depictions with known geographic locations and when the matching is successful, identifying the geographic location of the scene in the captured depiction based on a known geographic location of a matching reference depiction from the reference depictions.

Method and apparatus for inferring the geographic location of captured scene depictions

A computer implemented method for determining a vehicle type of a vehicle detected in an image is disclosed. An image having a detected vehicle is received. A number of vehicle models having salient feature points is projected on the detected vehicle. A first set of features derived from each of the salient feature locations of the vehicle models is compared to a second set of features derived from corresponding salient feature locations of the detected vehicle to form a set of positive match scores (p-scores) and a set of negative match scores (n-scores). The detected vehicle is classified as one of the vehicle models models based at least in part on the set of p-scores and the set of n-scores.

A computer implemented method for detecting the presence of one or more pedestrians in the vicinity of the vehicle is disclosed. Imagery of a scene is received from at least one image capturing device. A depth map is derived from the imagery. A plurality of pedestrian candidate regions of interest (ROIs) is detected from the depth map by matching each of the plurality of ROIs with a 3D human shape model. At least a portion of the candidate ROIs is classified by employing a cascade of classifiers tuned for a plurality of depth bands and trained on a filtered representation of data within the portion of candidate ROIs to determine whether at least one pedestrian is proximal to the vehicle.

Method and apparatus for real-time pedestrian detection for urban driving

A method and apparatus for recognizing an object, comprising providing a set of scene features from a scene, pruning a set of model features, generating a set of hypotheses associated with the pruned set of model features for the set of scene features, pruning the set of hypotheses, and verifying the set of pruned hypotheses is provided.

Method and apparatus for recognizing 3-D objects

A method for extracting a 3D terrain model for identifying at least buildings and terrain from LIDAR data is disclosed, comprising the steps of generating a point cloud representing terrain and buildings mapped by LIDAR; classifying points in the point cloud, the point cloud having ground and non-ground points, the non-ground points representing buildings and clutter; segmenting the non-ground points into buildings and clutter; and calculating a fit between at least one building segment and at least one rectilinear structure, wherein the fit yields the rectilinear structure with the fewest number of vertices. The step of calculating further comprises the steps of (a) calculating a fit of a rectilinear structure to the at least one building segment, wherein each of the vertices has an angle that is a multiple of 90 degrees; (b) counting the number of vertices; (c) rotating the at least one building segment about an axis by a predetermined increment; and (d) repeating steps (a)-(c) until a rectilinear structure with the least number of vertices is found.

Building segmentation for densely built urban regions using aerial LIDAR data

A method and system for improving the accuracy and timeliness of video metadata by incorporating information related to the motion of the camera as derived from the video imagery itself. Frame-to-frame correspondences are used to accurately estimate changes in camera pose. While the method and system do not require geo-registration, geo-registration results, if available, may be considered in processing the video images and generating improved camera pose estimates.

Method and system for improving video metadata through the use of frame-to-frame correspondences

Growing community of inventors

Monmouth Junction, NJ, United States of America

Bogdan Calin Mihai Matei