Sri International

Sarnoff Corporation

Jayakrishnan Kumar Eledath

Harpreet Singh Sawhney

Mayank Bansal

Hui Ting Cheng

Ajay Divakaran

Bogdan C Matei

Timothy J Shields

Xutao Lv

Chaitanya Desai

Qian Yu

Omar Javed

Amir Tamrakar

Jingen Liu

Jiejie Zhu

Barbara Hanna

Sarah Paris-Mascicki

Vincent Endres

Rakesh Kumar

Supun Samarasekera

Jeffrey Lubin

Theodore Armand Camus

Girish Acharya

Michael John Wolverton

Michael Wade Hansen

John R Fields

Lambert Ernest Wixson

Gary Alan Greene

John Benjamin Southall

Steven S Weiner

Aveek Kumar Das

Saad Ali

Robert Mandelbaum

Aaron Spaulding

Christos Alkivladis Polyzois

Deepam Mishra

Thomas Catanese

Ron Krakower

Aastha Jain

Manish Kumar

A computing system includes a vision-based user interface platform to, among other things, analyze multi-modal user interactions, semantically correlate stored knowledge with visual features of a scene depicted in a video, determine relationships between different features of the scene, and selectively display virtual elements on the video depiction of the scene. The analysis of user interactions can be used to filter the information retrieval and correlating of the visual features with the stored knowledge.

Real-time human-machine collaboration using big data driven augmented reality technologies

A computing system and method for identifying related visual content of a collection of visual media files comprising one or more image files and video files includes monitoring inputs to the computing system, the inputs associated with a user interaction with electronic content using the computer system, identifying a visual media file in the collection of visual media files relevant to the electronic content based on a semantic label assigned to the visual media file by the computing system, creating a representative image of the identified visual media file, and displaying the representative image for selection. The computing system enables a selection of the displayed representative image for association of the identified visual media file with the electronic content.

Multi-dimensional realization of visual content of an image collection

A computing system for realizing visual content of an image collection executes feature detection algorithms and semantic reasoning techniques on the images in the collection to elicit a number of different types of visual features of the images. The computing system indexes the visual features and provides technologies for multi-dimensional content-based clustering, searching, and iterative exploration of the image collection using the visual features and/or the visual feature indices.

A system for object detection and tracking includes technologies to, among other things, detect and track moving objects, such as pedestrians and/or vehicles, in a real-world environment, handle static and dynamic occlusions, and continue tracking moving objects across the fields of view of multiple different cameras.

Real-time detection, tracking and occlusion reasoning

Methods and apparatuses of the present invention generally relate to generating actionable data based on multimodal data from unsynchronized data sources. In an exemplary embodiment, the method comprises receiving multimodal data from one or more unsynchronized data sources, extracting concepts from the multimodal data, the concepts comprising at least one of objects, actions, scenes and emotions, indexing the concepts for searchability; and generating actionable data based on the concepts.

Method and apparatus for correlating and viewing disparate data

Real-time object detection, tracking and occlusion reasoning

A system for automatically capturing an event of interest in a venue is disclosed, comprising a plurality of cameras for capturing video images of the event; and at least one processor communicatively connected to said plurality of cameras and configured to execute a plurality of modules, said modules comprising a rectification module for combining the video images to form a wide-angle view; at least one of a motion analysis module configured for tracking salient blobs that are not part of a background of the wide-angle view, an activity analysis module configured for extracting temporal and spatial patterns from the wide-angle view, and a shape and appearance module configured for selecting one or more objects in the wide-angle view based on descriptors that are scale and rotational invariant; and a region of interest selector for selecting a viewpoint from the wide-angle view based on output from at least one of the motion analysis module, the activity analysis module, and the shape and appearance module, wherein the region of interest selector outputs the selected viewpoint for display. The system further comprises at least one audio recording device for capturing audio from the event; and means for synchronizing the video images and audio.

Apparatus for intelligent and autonomous video content generation and streaming

Embodiments of the present invention are directed towards methods and apparatus for generating a common operating picture of an event based on the event-specific information extracted from data collected from a plurality of electronic information sources. In some embodiments, a method for generating a common operating picture of an event includes collecting data, comprising image data and textual data, from a plurality of electronic information sources, extracting information related to an event from the data, said extracted information comprising image descriptors, visual features, and categorization tags, by applying statistical analysis and semantic analysis, aligning the extracted information to generate aligned information, recognizing event-specific information for the event based on the aligned information, and generating a common operating picture of the event based on the event-specific information.

A computer vision service includes technologies to, among other things, analyze computer vision or learning tasks requested by computer applications, select computer vision or learning algorithms to execute the requested tasks based on one or more performance capabilities of the computer vision or learning algorithms, perform the computer vision or learning tasks for the computer applications using the selected algorithms, and expose the results of performing the computer vision or learning tasks for use by the computer applications.

Computer vision as a service

A computer-implemented method comprising collecting data from a plurality of information sources, identifying a geographic location associated with the data and forming a corresponding event according to the geographic location, correlating the data and the event with one or more topics based at least partly on the identified geographic location and storing the correlated data and event and inferring the associated geographic location if the data does not comprise explicit location information, including matching the data against a database of geo-referenced data.

A system for automatically capturing an event of interest in a venue is disclosed, comprising a plurality of cameras for capturing video images of the event; and at least one processor communicatively connected to said plurality of cameras and con figured to execute a plurality of modules, said modules comprising a rectification module for combining the video images to form a wide-angle view; at least one of a motion analysis module configured for tracking salient blobs that are not part of a background of the wide-angle view, an activity analysis module configured for extracting temporal and spatial patterns from the wide-angle view, and a shape and appearance module configured for selecting one or more objects in the wide-angle view based on descriptors that are scale and rotational invariant; and a region of interest selector for selecting a viewpoint from the wide-angle view based on output from at least one of the motion analysis module, the activity analysis module, and the shape and appearance module, wherein the region of interest selector outputs the selected viewpoint for display. The system further comprises at least one audio recording device for capturing audio from the event; and means for synchronizing the video images and audio.

The present invention provides a collision avoidance apparatus and method employing stereo vision applications for adaptive vehicular control. The stereo vision applications are comprised of a road detection function and a vehicle detection and tracking function. The road detection function makes use of three-dimensional point data, computed from stereo image data, to locate the road surface ahead of a host vehicle. Information gathered by the road detection function is used to guide the vehicle detection and tracking function, which provides lead motion data to a vehicular control system of the collision avoidance apparatus. Similar to the road detection function, stereo image data is used by the vehicle detection and tracking function to determine the depth of image scene features, thereby providing a robust means for identifying potential lead vehicles in a headway direction of the host vehicle.

Apparatus and method for object detection and tracking and roadway awareness using stereo cameras

A method and apparatus for providing an improved workflow for digital watermarking during a production process. The invention provides a content tracking authority facility that forms a centralized location for storing and distributing watermarks and locations within a payload to place the watermarks. All post-production facilities that are involved in processing a particular payload (e.g., any content that can be watermarked, including video content) connect to the content tracking authority facility to receive watermarks for the content they are processing as well as locations within the content to use to place the watermark.

Method and apparatus for providing improved workflow for digital watermarking

A method for fixating a camera, mounted on a motorized mount, on a target point. The method includes receiving a plurality of images representative of a scene; selecting, within the plurality of images, a first display reference image containing the target point at a first coordinate location; estimating, in a current image within the plurality of images, a transformation that maps the current image to the first display reference image; estimating a second coordinate location of the target point in the current image using the transformation; computing an image slip between the target point in the current image and the target point in the first display reference image; converting the image slip into an angular correction for fixating the camera; modifying the angular correction by using closed-loop control with the motorized mount; and warping the current image using the transformation to align the current image with the first display reference image. This warping step provides a stable view of the scene even in the presence of camera movements that cannot be eliminated using mechanical stabilization, and in the presence of motor control lags and oscillations due to measurement and actuator latencies.

Growing community of inventors

Princeton, NJ, United States of America

Jayakrishnan Kumar Eledath