Systems and methods for optical performance captured animated figure with real-time reactive projected media

Abstract

A reactive media system of includes a motion control system. The motion control system includes an animated figure having a figure portion. The motion control system also includes a set of trackers coupled to a first surface of the figure portion. Each tracker of the set of trackers is configured to emit a respective sensor signal. The reactive media system also includes a media control system. The media control system includes a tracking camera configured to receive the respective sensor signals from the set of trackers. The tracking camera is also configured to determine a current position of the set of trackers relative to one another, relative to the tracking camera, or both based on receipt of the respective sensor signals. The tracking camera is also configured to generate state signals indicative of a current position and a current orientation of the figure portion based on the current position of the set of trackers. The media control system also includes a media controller communicatively coupled to the tracking camera. The media controller is configured to generate first image data indicative of images to be projected onto at least a second surface of the figure portion having the current position and the current orientation. The second surface comprises an external surface and the second surface is different than the first surface. The media control system also includes a projector communicatively coupled to the media controller. The projector is configured to receive the data indicative of the images from the media controller. The projector is also configured to project the images onto the second surface of the figure portion having the current position and the current orientation.