Columbia University

At&t Intellectual Property I, LP

Other

At+t Corp.

International Business Machines Corporation

Eastman-Kodak Company

Seungyup Paek

Atul Puri

Shih-Fu Chang

Ana Belen Benitez

Qian Huang

Chung-Sheng Li

John Richard Smith

Lawrence David Bergman

John R Smith

Charlie Judice

Alexandros Elefteriadis

The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

Multimedia integration description scheme, method and system for MPEG-7

Systems and methods for describing video content establish video description records which include an object set (), an object hierarchy () and entity relation graphs (). Video objects can include global objects, segment objects and local objects. The video objects are further defined by a number of features organized in classes, which in turn are further defined by a number of feature descriptors (, and). The relationships () between and among the objects in the object set () are defined by the object hierarchy () and entity relation graphs (). The video description records provide a standard vehicle for describing the content and context of video information for subsequent access and processing by computer applications such as search engines, filters and archive systems.

Video description system and method

The present invention relates to a system for generating a description record from multimedia information including, e.g., video data. A multimedia information input interface is used to receive multimedia information. A computer processor receives the multimedia information, processes the video information by performing video object extraction processing to generate video object descriptions from the video information, processes the generated video object descriptions by object hierarchy construction and extraction processing to generate video object hierarchy descriptions, and processes the generated video object descriptions by entity relation graph descriptions.

Growing community of inventors

New York, NY, United States of America

Seungyup Paek