Beijing Didi Infinity Technology and Development Co., Ltd.

Ying Lyu

Kun Han

In some cases, lower quality, large scale training data can be automatically generated by automatic labeling. The generated training data can be used to pre-train a machine learning model. For instance, the model can be a model for detection of verbal harassment. Parameters of the pre-trained model can be refined or updated using another one or more higher-quality sets of training data, with which the model can be subsequently trained.

Training mechanism of verbal harassment detection systems

In some cases, a verbal harassment detection system may use machine learning models to detect verbal harassment in real-time or near real-time. The system may receive an audio segment comprising a portion of audio captured by a microphone located within a vehicle. Further, the system may convert the audio segment to a text segment. The system may provide at least the text segment to a prediction model associated with verbal harassment detection to obtain a harassment prediction. Further, the system may provide the audio segment to an emotion detector to obtain a detected emotion of a speaking user that made an utterance included in the audio segment. Based at least in part on the harassment prediction and the detected emotion, the system may automatically, and without user intervention, determine whether a user is being harassed.

Real-time verbal harassment detection system

In some cases, one or more heuristics can be automatically generated using a small dataset of segments previously labeled by one or more domain experts. The generated one or more heuristics along with one or more patterns can be used to assign training labels to a large unlabeled dataset of segments. A subset of segments representing an occurrence of verbal harassment can be selected using the assigned training labels. Randomly selected segments can be used as being indicative of a non-occurrence of verbal harassment. The selected subset of segments and randomly selected segments can be used to train one or more machine learning models for verbal harassment detection.

Growing community of inventors

Santa Clara, CA, United States of America

Ying Lyu