Nippon Telegraph and Telephone Corporation

Yukinobu Taniguchi

Yoshinobu Tonomura

Akihito Akutsu

Takashi Satou

Hiroshi Hamada

Yasuhiro Niikura

Kenichi Minami

Takashi Sato

Atsushi Shimizu

Hideaki Ozawa

Kota Hidaka

Shinya Nakajima

Go Irie

Gen Suzuki

Tomio Kishimoto

Takashi Satoh

Akihoto Akutsu

An audio feature is extracted from audio signal data for each analysis frame and stored in a storage part. Then, the audio feature is read from the storage part, and an emotional state probability of the audio feature corresponding to an emotional state is calculated using one or more statistical models constructed based on previously input learning audio signal data. Then, based on the calculated emotional state probability, the emotional state of a section including the analysis frame is determined.

Emotion detecting method, emotion detecting apparatus, emotion detecting program that implements the same method, and storage medium that stores the same program

In the creation of an electronic image book provided with a book-type interface; a video is analyzed; images are extracted from the video under predetermined event type conditions; the extracted images are stored as index information in an index management table; images are selected from the index management table under desired conditions and laid out as a sequence of representative images in a page screen; item numbers of the laid out representative images, information about their positions on the page and information about a video file linked to the representative images are recorded in a page management table in correspondence with pages; and at the same time, representative image data corresponding to the item number is recorded in an image data table.

Method for creating and utilizing electronic image book and recording medium having recorded therein a program for implementing the method

A scheme for interactive video manipulation and display of a moving object on a background image is disclosed. In this scheme a background image stored in a background image storage unit is read out and displayed on a screen, and a manipulation target spatial position is set on the screen. Then, a partial image to be synthesized and displayed is uniquely specified from partial images which are set in correspondence to spatial positions on the background image and representing an object moving on the background image, according to the manipulation target spatial position set by the setting step, and the partial image as specified by the specifying step is read out from a partial image storage unit, and synthesized and displayed at the manipulation target spatial position on the background image. A scheme for realizing a variable speed video playback with a playback speed different from a normal one is also disclosed.

Scheme for interactive video manipulation and display of moving object on background image

A video caption detection scheme capable of detecting captions from the coded video data which are coded by using a combination of predictive coding and motion compensation, without requiring the decoding of coded video data into frame images. In this video caption detection scheme, whether each pixel/block in the video data is coded by using inter-frame correlation without using motion compensation or not is judged. Then, a region in the video data at which pixels/blocks that is judged as being coded by using inter-frame correlation without using motion compensation are concentrated time-wise and space-wise, is detected as a caption region. The detection can be realized by counting a frequency of appearance of a pixel/block which is judged as being coded by using inter-frame correlation without using motion compensation, at each pixel/block position of a frame over a prescribed counting period, and then comparing the counted frequency of appearance with a prescribed threshold value.

Scheme for detecting captions in coded video data without decoding coded video data

A video editing scheme for enabling a video editing operation on the coded video data efficiently. In a system in which the coded video data are decoded and displayed on a video display device, events including scene changes are detected from the coded video data, and icons are produced from the coded video data in correspondence to the detected events. On the other hand, playback possible positions from which the coded video data can be playbacked smoothly are determined, and an index information including an information on the produced icons and the determined playback possible positions is managed. Then, a plurality of icons are displayed on a single display, and a user is allowed to specify a desired icon among the displayed icons on the single display. Then, one playback possible position corresponding to the desired icon specified by the user is obtained according to the managed index information, and the coded video data are supplied to the video display device starting from the obtained playback possible position.

Video editing scheme using icons directly obtained from coded video data

A scheme for detecting shot boundaries in the compressed video data at high speed and high accuracy. In this shot boundary detection scheme, a Predictive-picture (P picture) change is calculated from a P picture sequence in the input video data which is compressed by an inter-frame/inter-field forward direction prediction coding scheme, according to coded data contained in the P picture sequence, while an Intra-picture (I picture) change is calculated from an I picture sequence in the input video data which is compressed by an intra-frame/intra-field coding scheme, according to coded data contained in the I picture sequence. Then, a shot boundary is detected by evaluating both the P picture change and the I picture change.

Scheme for detecting shot boundaries in compressed video data using

A buffer memory buffers a sequence of image data I.sub.0, I.sub.1, . . . of respective frames while shifting them step by step and discarding the least recent one of them for each step. An inter-image distance calculating means calculates the distance d(t-i, t-j) between respective pieces of image data held in the buffer memory and stores such distance values in a distance table part in a sequential order. A scene changing ratio calculating part calculates the scene changing ratio C(t-j.sub.c) at time t while referring to the distance table part. A decision part compares the scene changing ratio C(t-j.sub.c) with a predetermined threshold value to determine if the image of a preceding frame j.sub.c -th from the time t is a cut point.

Method and apparatus for video cut detection

A video signal, replay by a video player, is subjected to image processing by a calculation control part of a video image searching device to calculate the image quality value and another feature value. An image whose image quality satisfies a predetermined condition and whose feature value matches a predetermined condition is detected as an image in which an event has occurred. Such images are printed on an output paper together with associated addition information. A main control part of a video image access device reads out the additional information on the output paper by a scanner and effects control via a video control part to search the image corresponding to that information by a video player.

Growing community of inventors

Tokyo, Japan

Yukinobu Taniguchi