Detecting computer-generated hallucinations using progressive scope-of-analysis enlargement

Abstract

A technique determines whether a target item is adequately supported by a source item, and therefore likely free of hallucinations. The technique operates by progressively expanding a scope of source content to be considered when determining whether an individual target part of the target item has support in the source item. For instance, the technique initially determines whether any individual source part in the source item supports the target part. If this stage fails to identify support, the technique next considers whether a larger portion of the source item supports the particular target item. In some implementations, the technique selects a scope of analysis at a particular stage by choosing a group of source parts that most closely match the target part under consideration. The technique concatenates those source parts in the same order in which they appear in the source item.