Verizon Patent and Licensing Inc.

Keqian Li

Yifan Hu

Kevin Yen

Changwei Hu

Fei Tan

The present teaching relates to method, system, medium, and implementations for text processing. Upon receiving input data including an original token and a ground truth token label for the original token, a manipulation is applied to the original token to generate a manipulated token based on which to generate manipulated input data. Training data is generated based on the manipulated input data, the ground truth token label, and a ground truth action that, when applied to the manipulated token, yields the original token with the ground truth token label. A text moderation model is trained based on the training data.

System and method for text moderation via pretrained transformers

The present teaching relates to method, system, medium, and implementations for text processing. Upon receiving input data including a plurality of text strings, a plurality of manipulated text strings are generated for each of the plurality of training text strings by first applying a manipulation to each of at least one original token in the text string to generate a manipulated token, where the original token has a ground truth token label and then determining, with respect to each manipulated token, a ground truth action which, when applied to the manipulated token, yields the original token with the ground truth token label. Training data are generated with a plurality of training data packs, each of which corresponds to one of the plurality of text strings in the input data and includes a manipulated text string with at least one manipulated token, at least one ground truth token label, and at least one ground truth action which, when applied to the at least one manipulated token produces the at least one ground truth token label. The training data are for training text moderation models that facilitate text moderation.

Growing community of inventors

New York, NY, United States of America

Keqian Li