Rule-based augmentation of a physical environment

Abstract

A group of available virtual objects may each have a respective rule set that indicates how a corresponding available virtual object may be used to augment a physical environment. In some examples, the rule sets may be determined based at least in part on sample images that show approved settings or locations for the available virtual objects. To augment a physical space, one or more characteristics of the physical space may be determined, such as contexts, surface characteristics, and others. The rule sets for the available virtual objects may then be compared to the characteristics of the physical space to determine approved virtual objects that are approved for use to augment the physical space. A selected virtual object may then be selected from the approved virtual objects and inserted into a view of the physical space to create an augmented view of the physical space.