Nec Corporation

Nec Solution Innovators, Ltd.

Kai Ishikawa

Shinichi Ando

Takashi Onishi

Masaaki Tsuchida

Akihiro Tamura

Susumu Akamine

Daniel Georg Andrade Silva

Kenji Tateishi

Akitoshi Okumura

Hironori Mizuguchi

Satoshi Nakazawa

Kosuke Yamamoto

Toshio Takeda

Chiho Igi

Daniel Andrade

Shumpei Kubosawa

An information processing apparatus includes a lexical analysis unit that generates a training word string, a group generation unit that generates a plurality of training word groups, a matrix generation unit that generates, for each training word group, a training matrix in which a plurality of words and respective semantic vectors of the words are associated, a classification unit that calculates, for a word of each position of the training word string, a probability of the word corresponding to a specific word, using the training matrices generated by the matrix generation unit and a determination model that uses a convolutional neural network, and an optimization processing unit that updates parameters of the determination model, such that the probability of the word labeled as corresponding to the specific word is high, among the probabilities of the words of the respective positions of the training word string calculated by the classification unit.

Lexical analysis training of convolutional neural network by windows of different lengths with matrix of semantic vectors

An information processing apparatus includes a lexical analysis unit that generates a training word string, a pair generation unit that generates a plurality of training word pairs, a matrix generation unit that generates, for each training word pair, a training matrix in which a plurality of words and respective semantic vectors of the words are associated, a classification unit that calculates, for a word of each position of the training word string, a probability of the word corresponding to a specific word, using the training matrices generated by the matrix generation unit and a determination model that uses a convolutional neural network, and an optimization processing unit that updates parameters of the determination model, such that the probability of the word labeled as corresponding to the specific word is high, among the probabilities of the words of the respective positions of the training word string calculated by the classification unit.

Information processing apparatus, information processing method, and computer-readable recording medium

The present invention is a text mining system comprising a synonym cluster acquiring section configured to acquire synonym clusters from texts in text data to be analyzed, the synonym clusters each being a collection of synonymous texts, an implication relationship acquiring section configured to acquire implication relationships among the synonym clusters, and an implication graph generating section configured to generate an implication graph including vertices of synonym clusters and directed edges each indicating a direction from an implied synonym cluster to an implying synonym cluster from the implication relationships among the synonym clusters.

Text mining system, text mining method, and program

A text processing system that is able to appropriately determine textual entailment between sentences with high coverage is provided. The text processing system is configured to execute: processing of extracting a common substructure that is a partial structure of a same type, the partial structure being common to a first sentence and a second sentence and, based on the a structure representing the first sentence and a structure representing the second sentence; processing of extracting at least one of a feature amount representing a dependency relationship between the at least one common substructure in the first and second sentences and a feature amount representing a dependency relationship between the common substructure in the first and second sentences and a substructure different from the common substructure; and processing of determining an entailment relationship between the first sentence and the second sentence by using the extracted feature amount.

Text processing system, text processing method and storage medium storing computer program

A method for classifying a new instance including a text document by using training instances with class including labeled data and zero or more training instances with class including unlabeled data, comprising: estimating a word distribution for each class by using the labeled data and the unlabeled data; estimating a background distribution and a degree of interpolation between the background distribution and the word distribution by using the labeled data and the unlabeled data; calculating two probabilities for that the word generated from the word distribution and the word generated from the background distribution; combining the two probabilities by using the interpolation; combining the resulting probabilities of all words to estimate a document probability for the class that indicates the document is generated from the class; and classifying the new instance as a class for which the document probability is the highest.

Method for classifying a new instance

A text mining device () is used in which data composed of a set of records including an attribute value and text data is used as analysis target data. The text mining device () includes an analysis perspective candidate generation unit () that extracts an attribute value from the analysis target data and generates an analysis perspective candidate using the extracted attribute value, and a characteristic degree calculation unit () that compares text data in a record including the attribute value extracted as the analysis perspective candidate with text data in a record set that includes at least a record other than the record including the attribute value in the analysis target data, and calculates a characteristic degree indicating a relationship between the analysis perspective candidate and the analysis target data based on a result of the comparison.

Text mining device, text mining method, and computer-readable recording medium

Provided is a text processing system capable of classifying a plurality of texts into groups whose overviews are able to be grasped and classifying texts semantically having entailment relation into the same group even if the texts are not determined to have the entailment relation. Entailment recognition meansperforms entailment recognition between texts on given texts. Group generation meansselects an individual text and generates a group including texts entailing the selected text as members. Group integration meansintegrates groups in the case where groups satisfy a predetermined condition based on the degree of overlap of members between groups.

Text processing using entailment recognition, group generation, and group integration

A conversation-sentence generation device according to the invention of this application includes: an input unit that receives, as input information, a conversation sentence given from a user to an agent, and clue information based on which a physical and psychological state of the agent is estimated; an agent state storing unit that stores the physical and psychological state of the agent as an agent state; an agent state estimating unit that estimates a new agent state based on the input information and the agent state; an utterance intention generating unit that generates, based on the input information and the agent state, an utterance intention directed from the agent to the user; a conversation sentence generating unit that generates, based on the input information, the agent state, and the utterance intention, a conversation sentence given from the agent to the user; and an output unit that outputs the conversation sentence generated by the conversation sentence generating unit.

Conversation-sentence generation device, conversation-sentence generation method, and conversation-sentence generation program

An entailment evaluation device includes: a generation unit which generates first information indicating at least the order of occurrence of events of first and second simple sentences included in the hypothesis text and generates second information indicating at least the order of occurrence of events of third and fourth simple sentences included in a target text, the third simple sentence being related to the first simple sentence, the fourth simple sentence being related to the second simple sentence; a calculation unit which obtains a calculation result by comparing, based on the first and second information, the order of occurrence of events of first and second simple sentences and order of occurrence of events of third and fourth simple sentences; and a determination unit which determines, based on at least the calculation result, whether or not the target text entails the hypothesis text.

Entailment evaluation device, entailment evaluation method, and recording medium

A synonym relation determination device comprises: a synonym expression candidate storage unit which associates and stores a synonym candidate (EW) with the synonym source (OW); a text gathering unit which associates and gathers text with an issuing time; a synonym candidate search unit which calculates from the issuing time of the text a time interval (PD) in which the synonym candidate is searched in a text set (TX); a synonym source search unit which searches for a synonym source from the text set of a period which overlaps with the time interval in which the synonym candidate is searched for and calculates an occurrence of the synonym source; and synonym relation extraction unit which, when the occurrence of the synonym source is present in the time interval in which the synonym candidate is searched for, extracts a synonym relation between the synonym candidate and the synonym source.

Synonym relation determination device, synonym relation determination method, and program thereof

To provide an implication determining device, an implication determining method, and an implication determining program capable of improving implication determination performance. A new fact determination unit determines whether a given hypothesis is a new fact that indicates a first revealed fact in a hypothesis implied sentence that is a sentence implying the given hypothesis based on a specific expression written in the hypothesis implied sentence. An implication determination unit determines whether the given hypothesis is implied in a sentence to be determined that is a sentence to be determined whether the hypothesis is included.

Implication determining device, implication determining method and implication determining program determining if hypothesis is a new fact

A synonymous expression assessment device includes: synonymy assessment means for receiving input of binary relations each of which includes a nominal and a predicate, and assessing whether or not the input binary relations are synonymous using a similarity between input nominals and a similarity between input predicates; and inter-predicate similarity computation means for, when computing the similarity between the input predicates based on a distribution of occurrence frequencies of nominals that are in binary relations to the input predicate in a document set, performing the computation using a distribution of only nominals that are used in the same type of concept as the input nominal.

Device, method and program for assessing synonymous expressions

Disclosed are a text mining method, device, and program capable of performing text mining with a specific topic as an object with high precision. An element identification unit calculates a feature degree, which is an index for indicating a degree that within a text set of interest, which is a set of text that is to be analyzed, an element of the text appears. An output unit identifies distinctive elements within the text set of interest on the basis of the calculated feature degree and outputs the identified elements. The element identification unit corrects the feature degree on the basis of a topic relatedness degree, which is a value indicating a degree related to a topic of analysis, which is a topic for which each text portion of the text being analyzed has been partitioned into predetermined units that are to be analyzed.

Text mining method, text mining device and text mining program

A question-answering device, a question-answering method, and a question-answering program that can obtain an answer to an inputted query with high probability are described. A score calculation elementdetermines a matching degree between the group of the style and the topic of an inputted query and the group of the style and the topic of the query of question-answer pairs. A search result presentation elementnarrows the question-answer pairs on the basis of the matching degree.

Question answering device, question answering method, and question answering program

A text processing apparatus is provided with a segment determination unitand a descriptive content determination unit. The segment determination unitdetermines, with respect to a homogeneous segment that is similar to segments constituting a first text which is set as an analysis target (analysis target text) and that is included in another first text, whether the content thereof is included in a second text. The descriptive content determination unitdetermines whether each segment constituting the analysis target text should be described in a corresponding second text, based on the determination result.

Growing community of inventors

Tokyo, Japan

Kai Ishikawa