Soco, Inc.

International Business Machines Corporation

Kyusong Lee

Tiancheng Zhao

Youngja Park

Yilian Liu

Systems and methods involving SPARTA (Sparse Transformer Matching) are disclosed. Embodiments may relate to scalable and transferable retrieval methods for question answering.

Question answering retrieval via sparse transformer matching

Techniques for dialog data collection are disclosed. In an embodiment, a method comprises providing a first graphical user interface () configured to receive first user input data, providing a second graphical user interface () configured to receive second user input data, asynchronously transmitting the first user input data to the second graphical user interface () or the second user input data to the first graphical user interface (), and generating training data for a natural language processing system model () based on the first user input data and the second user input data.

Asynchronous role-playing system for dialog data collection

Aspects of the present invention disclose a method, computer program product, and system for pre-training a neural network. The method extracting features of data set received from a source, the data set includes labelled data and unlabeled data. Generating a plurality of data clusters from instances of data in the data set, the data clusters are weighted according to a respective number of similar instances of labeled data and unlabeled data within a respective data cluster. Determining a data label indicating a data class that corresponds to labeled data within a data cluster of the generated plurality of data clusters. Applying the determined data label to unlabeled data within the data cluster of the generated plurality of data clusters. In response to applying the determined data label to unlabeled data within the data cluster of the generated plurality of data clusters, deploying the data cluster to a neural network.

Growing community of inventors

Pittsburgh, PA, United States of America

Kyusong Lee