Clinc, Inc.

Kevin Leach

Michael A Laurenzano

Jonathan K Kummerfeld

Stefan Larson

Jason Mars

Lingjia Tang

Johann Hauswald

Parker Hill

Joseph J Peper

Yunqi Zhang

Andrew Lee

Sean Stapleton

Christopher Clarke

Daniel C Michelin

A system and method of implementing an intuitive search interface for tactically searching one or more annotated utterance corpora in a machine learning-based dialogue system includes identifying an utterance corpus query for searching one or more annotated utterance corpora of a machine learning-based dialogue system; interpreting the utterance corpus query by translating the utterance corpus query into one or more search expressions recognizable to an utterance sample retrieval program searchably interfacing with the one or more annotated utterance corpora of the machine learning-based dialogue system; retrieving one or more annotated utterance samples from the one or more annotated utterance corpora based on the interpretation of the utterance corpus query; and returning the one or more annotated utterance samples to an intuitive utterance corpus search interface.

Systems and methods implementing data query language and utterance corpus implements for handling slot-filling and dialogue intent classification data in a machine learning task-oriented dialogue system

Systems and methods for intelligently training a subject machine learning model includes identifying new observations comprising a plurality of distinct samples unseen by a target model during a prior training; creating an incremental training corpus based on randomly sampling a collection of training data samples that includes a plurality of new observations and a plurality of historical training data samples used in the prior training of the target model; implementing a first training mode that includes an incremental training of the target model using samples from the incremental training corpus as model training input; computing performance metrics of the target model based on the incremental training; evaluating the performance metrics of the target model against training mode thresholds; and selectively choosing based on the evaluation one of maintaining the first training mode and automatically switching to a second training mode that includes a full retraining of the target model.

Systems and methods for mixed setting training for slot filling machine learning tasks in a machine learning task-oriented dialogue system

Systems and methods for synthesizing training data for multi-intent utterance segmentation include identifying a first corpus of utterances comprising a plurality of distinct single-intent in-domain utterances; identifying a second corpus of utterances comprising a plurality of distinct single-intent out-of-domain utterances; identifying a third corpus comprising a plurality of distinct conjunction terms; forming a multi-intent training corpus comprising synthetic multi-intent utterances, wherein forming each distinct multi-intent utterance includes: selecting a first distinct in-domain utterance from the first corpus of utterances; probabilistically selecting one of a first out-of-domain utterance from the second corpus and a second in-domain utterance from the first corpus; probabilistically selecting or not selecting a distinct conjunction term from the third corpus; and forming a synthetic multi-intent utterance including appending the first in-domain utterance with one of the first out-of-domain utterance from the second corpus of utterances and the second in-domain utterance from the first corpus of utterances.

Systems and methods for machine learning-based multi-intent segmentation and classification

Systems and methods for constructing an artificially diverse corpus of training data includes evaluating a corpus of utterance-based training data samples, identifying a slot replacement candidate; deriving distinct skeleton utterances that include the slot replacement candidate, wherein deriving the distinct skeleton utterances includes replacing slots of each of the plurality of distinct utterance training samples with one of a special token and proper slot classification labels; selecting a subset of the distinct skeleton utterances; converting each of the distinct skeleton utterances of the subset back to distinct utterance training samples while still maintaining the special token at a position of the slot replacement candidate; altering a percentage of the distinct utterance training samples with a distinct randomly-generated slot token value at the position of the slot replacement candidate; and constructing the artificially diverse corpus of training samples based on a collection of the percentage of the distinct utterance training samples.

Systems and methods for constructing an artificially diverse corpus of training data samples for training a contextually-biased model for a machine learning-based dialogue system

Growing community of inventors

Ann Arbor, MI, United States of America

Kevin Leach