Virage, Incorporated

University of California

Navisalute, LLC

Krumbs, Inc.

Ramesh Jain

Bradley Horowitz

Amarnath Gupta

Jeffrey R Bach

Arun Hampapur

Chiao-Fe Shu

Richard D Humphrey

Charles Fuller

Mojgan Monika Gorkani

Michael J Portuesi

Charles E Fuller

Chiao-fe Shu

Pinaki Sinha

Simone Santini

Arun Katkere

Saied Moezzi

Ophir Frieder

Howard J Federoff

Massimo S Fiandaca

Laleh Jalali

Neilesh Jain

Hyungik Oh

Koji Wakimoto

Gerd Utz Westermann

Ansgar Scherp

Srikanth Agaram

Systems and methods for tracking activities from a plurality of multimodal inputs are described. Activity tracking can include receiving a plurality of multimodal inputs, synchronizing the plurality of multimodal inputs, generating segments from the synchronized multimodal inputs, recognizing activities associated with each generated segment by performing a bagged formal concept analysis (BFCA), and recording the recognized activities in a storage. Tracking of activities can include the detection of moments (e.g., eating moments), during which an activity tracking application can prompt a user for information (e.g., a food journal).

Systems and methods for automatic activity tracking

Embodiments herein relate to biosensors and other elements combined in real-time for health applications that acquire health data of an individual from one or more data streams by a first element and integrate these data through a second element that is configured to predict and/or recognize an interruptive health event and then via one or more successive elements alert one or more providers of a possible interruptive health event, enable the providers to propose one or more effective interventions, communicate directly with the individual and providers and/or caregivers, and/or provide confirmation in the event that effective interventions were made. Embodiments also relate to predicting and recognizing brain attack in real-time by acquiring and integrating health data from one or more data streams, interfacing with one or more providers so that they can propose and/or effect one or more effective interventions, and communicating with an affected individual, providers, and/or caregivers.

Method and system for brain attack triage (BAT)

A system for sharing moment experiences is described. A system receives moment data from an input to a mobile device. The system receives geographic location information, time information, and contextual information that is local to the mobile device. The system creates a message about the moment data based on the geographic location information, the time information, and the contextual information. The system outputs the moment data with the message.

Sharing moment experiences

Architecture and its implementation of an event-based media management system and method are disclosed. A generic model for events is used for developing architecture for media management, called Eventcentric Media Management (EMMa) system. The system focuses on event experiences and provides flexible functionality for media management. The system and method analyze cross-media files for features to extract atomic events and apply algorithms to cluster files including similar or related features. Thus, the EMMa system allows unified media indexing of multiple media types, better abstraction of the real world, use of context, media processing operations to compute and store features and tags, and a more intuitive support for multiple users. It provides environments for querying and browsing media related to events and authoring of multimedia presentations for sharing with other individuals.

Event based organization and access of digital photos

A method of classifying and organizing digital images utilizing optical metadata (captured using multiple sensors on the camera) may define semantically coherent image classes or annotations. The method defines optical parameters based on the physics of vision and operation of a camera to cluster related images for future search and retrieval. An image database constructed using photos taken by at least thirty different users over a six year period on four different continents was tested using algorithms to construct a hierarchal clustering model to cluster related images. Additionally, a survey about the most frequent image classes shot by common people forms a baseline model for automatic annotation of images for search and retrieval by query keyword.

Photo classification using optical parameters of camera from EXIF metadata

One aspect of the invention is directed to a system and method for video cataloging. The video is cataloged according to predefined or user definable metadata. The metadata is used to index and then retrieve encoded video.

Video cataloger system with audio track extraction

One aspect of the invention is directed to a system and method for video cataloging. The video is cataloged according to predefined or user definable metadata. The metadata is used to index and then retrieve encoded video. In one embodiment, the video is cataloged concurrently with encoding of the video.

Video cataloger system with synchronized encoders

One aspect of the invention is directed to a system and method for video cataloging. The video is cataloged according to predefined or user definable metadata. The metadata is used to index and then retrieve encoded video. In another aspect of the invention, video metadata track processors convert metadata tracks of the video information to produce displayable frames containing hyperlinking between displayable data. Another aspect of the invention is directed to a method of browsing stored video information, including displaying hyperlinked frames of metadata track representations, and selecting and displaying links between displayable frames.

Video cataloger system with hyperlinked output

One aspect of the invention is directed to a system and method for video cataloging. The video is cataloged according to predefined or user definable metadata. The metadata is used to index and then retrieve encoded video. Video feature extractors produce metadata tracks from the video information, and each metadata track indexes the stored video information. A feature extractor registration interface registers the video feature extractors, providing for registration with the video engine of new video feature extractors with new metadata tracks.

Video cataloger system with extensibility

A similarity-based database of images, where images are preferably ranked and correlated in correspondence to biological preattentive similarity, supports a new type of interface for visual navigation within the database to the end that a human may perceive not only selected images resultant from a query, but the relationship between the selected images. In particular, navigation is within a display space whose geometric characteristics depend on the geometry of the perceptual space in which image similarity is measured. The display space is a subset of the three dimensional Euclidean space that, for many of the distance functions appropriate to the images, is contained in the unit cube. The perceptual intuition of the metric is given (i) in part by the distribution of images in the space, and (ii) in part by making the motion of the user uniform with respect to the metric of the space.

Visual navigation in perceptual databases

A system and method for improving the retrieval performance of a query engine in a visual information retrieval (VIR) system by encoding domain-specific knowledge into the VIR system through a visual dictionary or 'victionary'. The victionary is a dictionary-like information-mapping module that is used to retrieve visual information at a 'semantic' level. A VIR system that performs generic image processing is enhanced by adding a query transformation unit and a query expansion unit, i.e., the victionary. With these additional components, a user may present a query either as a text term (such as a keyword or phrase), or as an image (with weights) and execute a 'semantic query'. During semantic query processing, the victionary-enhanced system transforms the user's original term (or image query) to a set of equivalent queries, and internally executes all the equivalent queries before presenting the results to the user. The victionary unit is responsible for taking the term (or image query) and finding the equivalent feature vectors (and weights). A result processor accumulates the score sheets of each equivalent query and presents a composite ranking that reflects a faithful representation of each equivalent query to the user. The architecture of the victionary-enhanced system is open and extensible, so that one or more domain-specific victionary modules can be plugged into the system. The plug-in architecture of the victionary module is effected through an application programming interface (API).

Visual dictionary

A system and method for content-based search and retrieval of visual objects. A base visual information retrieval (VIR) engine utilizes a set of universal primitives to operate on the visual objects. An extensible VIR engine allows custom, modular primitives to be defined and registered. A custom primitive addresses domain specific problems and can utilize any image understanding technique. Object attributes can be extracted over the entire image or over only a portion of the object. A schema is defined as a specific collection of primitives. A specific schema implies a specific set of visual features to be processed and a corresponding feature vector to be used for content-based similarity scoring. A primitive registration interface registers custom primitives and facilitates storing of an analysis function and a comparison function to a schema table. A heterogeneous comparison allows objects analyzed by different schemas to be compared if at least one primitive is in common between the schemas. A threshold-based comparison is utilized to improve performance of the VIR engine. A distance between two feature vectors is computed in any of the comparison processes so as to generate a similarity score.

Growing community of inventors

San Diego, CA, United States of America

Ramesh Jain