International Business Machines Corporation

Kabushiki Kaisha Toshiba

Toshiro Takase

Akira Koseki

Michiaki Tatsubori

Tetsuro Morimura

Hiroki Yanagisawa

Yuichi Nakamura

Satoshi Makino

Kent Tamura

Hideaki Komatsu

Yuji Watanabe

Toru Nagano

Hisashi Miyashita

Hiroshi Kanayama

Takashi Ichikawa

Naoki Tamaoki

Haruki Imai

Takeshi Imamura

Hiroaki Nakamura

Akiko Suzuki

Satoshi Masuda

Masaki Ono

Naohiko Uramoto

Akio Ui

Takuya Mishina

Takahide Nogayama

Yukihiko Sohda

Toshinari Itoko

Yuhichi Nakamura

Shinya Kawanaka

Ryoh Neyama

Akihiro Kosugi

Kenichiro Ueno

Hyen-Vui Chung

Ryo Neyama

Methods and systems for gathering information from a user include identifying an origin topic and a target topic. A path from the origin topic to the target topic is determined. The path includes a set of bridging topics, where each bridging topic in the path is within a threshold distance in a semantic space from a previous topic and a subsequent topic. An interactive conversation is conducted with the user, introducing each topic in the path until the target topic has been reached. At least one predetermined piece of information relating to a user response to the target topic is recorded.

Topic navigation in interactive dialog systems

A computer-implemented method for learning a policy for selection of an associative topic, which can be used in a dialog system, is described. The method includes obtaining a policy base that indicates a topic transition from a source topic to a destination topic and a short-term reward for the topic transition, by analyzing data from a corpus. The short-term reward may be defined as probability of associating a positive response. The method also includes calculating an expected long-term reward for the topic transition using the short-term reward for the topic transition with taking into account a discounted reward for a subsequent topic transition. The method further includes generating a policy using the policy base and the expected long-term reward for the topic transition. The policy indicates selection of the destination topic for the source topic as an associative topic for a current topic.

Learning of policy for selection of associative topic in dialog system

A method for implementing artificial intelligence agents to perform machine learning tasks using predictive analytics to leverage ensemble policies for maximizing long-term returns includes obtaining a set of inputs including a set of ensemble policies and a meta-policy parameter, selecting an action for execution within the system environment using a meta-policy function determined based in part on the set of ensemble policies and the meta-policy function parameter, causing the artificial intelligence agent to execute the selected action within the system environment, and updating the meta-policy function parameter based on the execution of the selected action.

Implementing artificial intelligence agents to perform machine learning tasks using predictive analytics to leverage ensemble policies for maximizing long-term returns

A method for selecting an action, includes reading, into a memory, a Partially Observed Markov Decision Process (POMDP) model, the POMDP model having top-k action IDs for each belief state, the top-k action IDs maximizing expected long-term cumulative rewards in each time-step, and k being an integer of two or more, in the execution-time process of the POMDP model, detecting a situation where an action identified by the best action ID among the top-k action IDs for a current belief state is unable to be selected due to a constraint, and selecting and executing an action identified by the second best action ID among the top-k action IDs for the current belief state in response to a detection of the situation. The top-k action IDs may be top-k alpha vectors, each of the top-k alpha vectors having an associated action, or identifiers of top-k actions associated with alpha vectors.

Partially observed Markov decision process model and its use

A method is provided for rule creation that includes receiving (i) a MDP model with a set of states, a set of actions, and a set of transition probabilities, (ii) a policy that corresponds to rules for a rule engine, and (iii) a set of candidate states that can be added to the set of states. The method includes transforming the MDP model to include a reward function using an inverse reinforcement learning process on the MDP model and on the policy. The method includes finding a state from the candidate states, and generating a refined MDP model with the reward function by updating the transition probabilities related to the state. The method includes obtaining an optimal policy for the refined MDP model with the reward function, based on the reward policy, the state, and the updated probabilities. The method includes updating the rule engine based on the optimal policy.

Rule creation using MDP and inverse reinforcement learning

A computer-implemented method is presented for building a topic model to discover topics in a collection of documents generated by a plurality of users. The method includes extracting conversations from the collection of documents, dividing the extracted conversations into a plurality of segments, generating a topic distribution for each of the plurality of segments based on the extracted conversations and a first pre-defined prior probability distribution, and generating continuous value constructs for each of the topic distributions based on an external corpus and a second pre-defined prior probability distribution, wherein similarity is defined between the continuous value constructs.

Interactively building a topic model employing semantic similarity in a spoken dialog system

A method of recommending Mashups, including identifying, using a processor, pre-existing Mashups implementing application program interfaces (APIs), where each implemented API has one or more attached Tag(s) including API characteristics; extracting the characteristics from the Tags attached to the API(s) implemented in the Mashup, form a set including all of the characteristics from the APIs implemented in Mashup; identifying one or more API(s) not implemented in the Mashups; extracting the characteristics from the Tags attached to the API(s) not implemented in the Mashup to form another set; identifying API characteristics that are an element of one set, but not an element of the other set, forming a third set of these characteristics; modeling a relationship between API(s) using the sets; calculating the probability of one or more API(s) not implemented in a Mashup being used for new Mashup; and presenting the API(s) to a user for new Mashups.

Approach to recommending mashups

An extraction method for extracting a sub query to be converted to a program for processing stream data continuously inputted to a database, from a query including instructions, as sub queries, to be issued to a database management system. The extraction method includes receiving input of the query and a lower limit value of efficiency as processing time per unit memory increase amount. A calculating operation calculates a one memory increase amount and the efficiency using the memory increase amount and the processing time to be reduced. The method selects a sub query whose calculated efficiency is equal to or higher than the lower limit value and extracts the selected sub query as a conversion object on condition that the integrated memory increase amount is equal to or smaller than the maximum memory increase amount.

Extraction device, data processing system, and extraction method

An extraction device for extracting a sub query to be converted to a program for processing stream data continuously inputted to a database, from a query including instructions, as sub queries, to be issued to a database management system. The extraction device includes: an input unit; an operation unit for calculating the memory increase amount in a case of processing the stream data and the processing time to be reduced for each sub query, and calculating the efficiency by using them; and an extraction unit for selecting at least one sub query whose efficiency is equal to or higher than the lower limit value, integrating the memory increase amount calculated for the selected sub query, and on condition that the integrated memory increase amount is equal to or smaller than the maximum memory increase amount, extracting the selected sub query as a conversion object.

A computer-implemented method, system, and computer program product for generating a synonym list from an existing thesaurus includes preparing a first feature vector from a natural language query and preparing a second feature vector from a result of the natural language query, determining, using a processor, whether a combination of a first feature from the first feature vector and a second feature from the second feature vector is included as a synonym pair in the existing thesaurus, and generating the synonym list by adding the combination to the synonym list when the determination is positive. The result of the natural language query may be identified by a user browsing action or by a positive feedback from a user. The method further includes reading a log which includes a single set or plural sets of the natural language query and the result of the natural language query.

Generation of synonym list from existing thesaurus

Techniques are disclosed for generating rules for classifying structured documents, and for classifying, retrieving, or checking structured documents, using generated rules. In one example, a method for generating rules for classifying a plurality of electronic structured documents to which a same schema is applied comprises a computer performing the following steps: determining one or more variable portions defined by the schema by scanning the schema; acquiring respective feature values of the determined variable portions from each of the plurality of structured documents and associating the structured document, from which the feature values are acquired, with the acquired feature values; and generating the rules on the basis of the feature values associated with the structured document.

Generating rules for classifying structured documents

A method and system for dividing a tree structure of a structured document based on a tree structure defined by a schema of the structured document. The method includes the following steps: calculating an index value of size of a subtree having each element as a root for at least part of at least one element included in the tree structure defined by the schema, and deciding on a division pattern using the index value, where the division pattern is used to divide the tree structure of the structured document to which the schema is applied so that the size of the subtree, after being divided, meets a predetermined standard.

Method, program, and system for dividing tree structure of structured document

A calculating unit calculates either one of a reaction probability between a chemical species used in a semiconductor process and a semiconductor device and a deactivation probability of the chemical species, according to either one of a structure of the semiconductor device and a plurality of materials. A simulation unit performs a simulation of a physical phenomenon occurring in a reaction chamber based on either one of the reaction probability and the deactivation probability.

Growing community of inventors

Tokyo, Japan

Toshiro Takase