Nippon Telegraph and Telephone Corporation

Massachusetts Institute of Technology

The University of Tokyo

Takahito Kawanishi

Kunio Kashino

Yasunori Oishi

Kaoru Hiramatsu

Ryo Kitahara

Osamu Yoshioka

Hiroko Muto

Takehiro Moriya

Yutaka Kamamoto

Noboru Harada

Ryosuke Sugiura

Hirokazu Kameoka

James Robert Glass

Go Irie

Akisato Kimura

Xiaomeng Wu

David F Harwath

Yasunori Ohishi

Keisuke Hasegawa

Kenichi Noguchi

Hidehisa Nagano

Jouji Nakayama

Kouichi Furukado

Junichi Nakajima

Krishna Onkar

A search apparatus for searching media data for a target region that matches query data includes a first feature extraction unit configured to extract a first feature vector from the query data using a first trained neural network; a second feature extraction unit configured to obtain a first region from the media data and extract a second feature vector from the first region using a second trained neural network; a localization unit configured to determine a candidate for the target region using a third trained neural network, based on the first feature vector, the second feature vector, and the first region or a location of the first region; and a control unit configured to repeat the operations of the second feature extraction unit and the localization unit until a predetermined condition is satisfied, by using the determined candidate for the target region as the first region to be used by the second feature extraction unit.

Search apparatus, training apparatus, search method, training method, and program

An acquiring unit of a depth estimation apparatus acquires an input image. In addition, a depth map generating unit inputs the input image acquired by the acquiring unit into a depth estimator for generating, from an image, a depth map in which a depth of a space that appears on the image is imparted to each pixel of the image, and generates an estimated depth map that represents a depth map corresponding to the input image. The depth estimator is a model having been learned in advance so as to reduce, with respect to each error between a depth of the estimated depth map and a depth of a correct-answer depth map that presents the depth map of a correct answer, a value of a loss function set such that a degree of increase of a loss value with respect to a pixel at which the error is larger than a threshold is smaller than a degree of increase of a loss value with respect to a pixel at which the error is equal to or smaller than the threshold.

Depth estimation device, depth estimation model learning device, depth estimation method, depth estimation model learning method, and depth estimation program

An image adjustment device includes: an illumination component derivation unit that derives an illumination component of a grayscale image; a reflectance component derivation unit that derives a reflectance component image that is a resulting image in which the illumination component is removed from the grayscale image; a contrast component derivation unit that derives a contrast component based on a contrast value between a pixel of the reflectance component image and a peripheral area of the pixel; a histogram derivation unit that derives a luminance histogram of the grayscale image weighted according to the contrast value for each pixel of the contrast component; a conversion function derivation unit that derives a luminance conversion function for converting a luminance such that a luminance histogram of a converted grayscale image in which the grayscale image is converted by the luminance conversion function and a predetermined histogram are matched with or similar to each other; and a luminance conversion unit that generates the converted grayscale image.

Image adjustment apparatus, image adjustment method, and program

An objective of the present invention is to make a search for illegal (illegitimate) content more efficient. The illegitimate content relates to content posted by an unauthorized user without a legitimate ownership of the content. An illegitimate content search device according to the present invention comprises a phishing content sensing part for, using a profile of candidate content being potentially illegitimate content, sensing, from among the candidate content, phishing content being non-illegitimate content for guiding a user's viewing.

Illegal content search device, illegal content search method, and program

An objective of the present invention is to make a search for illegal (illegitimate) content more efficient. The illegitimate content relates to content posted by an unauthorized user without a legitimate ownership of the content. An illegitimate content search device according to the present invention comprises: a query generation dictionary storage part for storing a query generation dictionary for generating a search query used in searching for illegitimate content; a query generation dictionary creation part for extracting, from a title of illegitimate content, associated wording being associated with wording included in a title of legitimate content, and registering the extracted associated wording in the query generation dictionary for generating the search query used in searching for the illegitimate content; and a search query generation part for generating the search query using the associated wording registered in the query generation dictionary.

The present disclosure relates to a search for illegal (illegitimate) content In particular, the present disclosure provides the search in an efficient manner by excluding pieces of presumed illegitimate content from the candidates of illegitimate content for comparing with legitimate content. The illegitimate content comprises content posted by an unauthorized user without a legitimate ownership of the content. An illegitimate content sensing device according to the present disclosure comprises a presumed illegitimate content deletion part for, on the basis of a profile of candidate illegitimate content, identifying pieces of the candidate illegitimate content having a profile which is within a degree of identicalness to a profile of previously identified illegitimate content as presumed illegitimate content.

The present invention enables detection of a sponsorship credit display in a broadcast program with higher precision. A sponsorship credit display detection deviceaccording to the present invention includes: a learning data creation unitthat creates, as learning data, from a broadcast program in which the sponsorship credit display has been detected, a still image where the sponsorship credit display is displayed and a still image where the sponsorship credit display is not displayed; a learning unitthat uses the learning data created by the learning data creation unitto learn a parameter to be applied to a detection model for detecting a sponsorship credit display in a broadcast program; and a sponsorship credit display detection unitthat uses the detection model to which the parameter learned by the learning unithas been applied to detect a sponsorship credit display in a recognition target broadcast program.

Device and method for detecting display of provided credit, and program

An objective of the present invention is to achieve greater efficiency in searches for illegal (illegitimate) content. The illegitimate content relates to content posted by an unauthorized user without a legitimate ownership of the content. An illegitimate content search device according to the present invention comprises: a content profile acquisition part for acquiring a profile including a posting history of illegitimate content posted by a user having posted candidate content being potentially illegitimate content; and a matching priority calculation part for calculating, on the basis of the profile, the priority of the candidate content with regard to determining whether a plurality of pieces of content is illegitimate content, and elevating the priority of the illegitimate content with a history of having posted the illegitimate content higher than if content without the history.

A learning device calculates a feature of each data included in a pair of datasets in which two modalities among a plurality of modalities are combined, using a model that receives data on a corresponding modality among the modalities and outputs a feature obtained by mapping the received data into an embedding space. The learning device then selects similar data similar to each target data that is data on a first modality in a first dataset of the datasets, from data on a second modality included in a second dataset of the datasets. The learning device further updates a parameter of the model such that the features of the data in the pair included in the first and the second datasets are similar to one another, and the feature of data paired with the target data is similar to the feature of data paired with the similar data.

Learning device, learning method, and learning program for images and sound which uses a similarity matrix

A learning device calculates an image feature using a model (image encoder) that receives an image and outputs the image feature obtained by mapping the image into a latent space. The learning device calculates an audio feature using a model (audio encoder) that receives a speech in a predetermined language and outputs the audio feature obtained by mapping the speech into the latent space, and that includes a neural network provided with a self-attention mechanism. The learning device updates parameters of the models used by an image feature calculation unit and an audio feature calculation unit such that the image feature of a first image is similar to the audio feature of a speech corresponding to the first image.

Learning device, learning method, learning program, retrieval device, retrieval method, and retrieval program

To enable extraction of an area related to a sponsor credit from a video including the sponsor credit of a television broadcast or the like without generating learning data for each form of various kinds of sponsor credits. A detection device () according to the present invention includes a detection unit () that associates a still image including a prescribed character or figure from a preliminary video or a still image not including the prescribed character or figure with a sound signal including the prescribed sound acquired from the preliminary video so as to detect a desired scene as an area that includes at least one of the prescribed character or figure and the prescribed sound from the target video.

Detection device, detection method, and program

The present invention enables detection of a sponsorship credit display segment in a broadcast program with higher precision. A sponsorship credit display detection deviceaccording to the present invention includes: a related phrase storage unitthat stores related phrases included in announcement of a sponsorship credit display and related to the sponsorship credit display, in association with estimation periods; a voice recognition unitthat performs voice recognition on an audio signal of the broadcast program; a related phrase detection unitthat detects a stored related phrase from results of the voice recognition; a sponsorship credit display segment estimation unitthat, using an appearance time of the detected related phrase as a start point, estimates a period corresponding to the estimation period stored in association with the detected related phrase as a sponsorship credit display segment; and a detection unitthat, among estimated sponsorship credit display segments, detects a segment that continues for at least a predetermined time period as a sponsorship credit display segment.

The present invention enables detection of a sponsorship credit display in a broadcast program with higher precision. A sponsorship credit display detection deviceaccording to the present invention includes: a CM segment detection unitthat extracts a cut point, which is a time point where a frame in which the volume of an audio signal of a broadcast program is less than a volume threshold value and the amount of change from a previous frame is at least a pixel change threshold value is played, and detects a CM segment by comparing an interval of the extracted cut point with a CM defined length; a sponsorship credit display segment estimation unitthat estimates, as a sponsorship credit display segment, a predetermined time period before or after at least one continuous CM segment detected by the CM segment detection unit; and an output unitthat outputs information indicating the sponsorship credit display segment.

Performance of an encoding process and a decoding process for a sound signal is enhanced. A representative value calculating partcalculates, for each frequency section by a plurality of samples fewer than the number of frequency samples of a sample sequence of a frequency domain signal corresponding to an input acoustic signal, from the sample sequence of the frequency domain signal, a representative value of the frequency section from sample values of samples included in the frequency section, for each of predetermined time sections. A signal companding partobtains, for each of the predetermined time sections, a frequency domain sample sequence obtained by multiplying a weight according to a function value of the representative value by a companding function for which an inverse function can be defined and each of the samples corresponding to the representative value in the sample sequence of the frequency domain signal, as a sample sequence of a weighted frequency domain signal.

Sample sequence converter, signal encoding apparatus, signal decoding apparatus, sample sequence converting method, signal encoding method, signal decoding method and program

Information related to CMs included in a broadcast program can be automatically added. A CM information generation deviceincludes: a CM section detection unitthat detects one or more CM sections within a broadcast program by comparing the volume of the broadcast program with a volume threshold; a CM detection list generation unitthat generates a CM detection list describing company names of companies that have advertised detected CMs, which are CMs in the CM sections detected by the CM section detection unit, by cross-referencing the detected CMs with CM masters that have been associated with company names of advertisers in advance; a company name list generation unitthat generates a company name list describing company names that are specified by a sponsorship credit display indicating sponsors of the broadcast program; and a CM information generation unitthat generates CM information related to the detected CMs by comparing the CM detection list with the company name list.

Growing community of inventors

Tokyo, Japan

Takahito Kawanishi