Intuit, Inc.

Yakov Gazman

Linoy Cohen

Udi Menkes

Matan Vetzler

An alignment score is generated for a test language model from input data including a number of triplet data structures. The method also includes identifying, responsive to the alignment score failing to satisfy a score threshold, a fail triplet data structure in the number of triplet data structures for which the evaluation score includes the indication of fail. A judge language model is executed on the fail triplet data structure to output a type of misalignment that the test language model produced when the test language model executed on the fail prompt. The judge language model is re-executed on a combination of the fail triplet data structure and the type of misalignment to output a cause of the fail response. An enhanced prompt is generated accordingly and then returned.

Growing community of inventors

Petah Tikva, Israel

Yakov Gazman