Unity Technologies Sf

Weta Digital Limited

Jake Botting

Dejan Momcilovic

Dejan Momcilovich

Performance capture marker housing

Embodiments facilitate the calibration of cameras in a live action scene using fixed cameras and drones. In some embodiments, a method configures a plurality of reference cameras to observe at least three known reference points located in the live action scene and to observe one or more reference points associated with one or more moving cameras having unconstrained motion. The method further configures the one or more moving cameras to observe one or more moving objects in the live action scene. The method further receives reference point data in association with one or more reference cameras of the plurality of reference cameras, where the reference point data is based on the at least three known reference points and the one or more reference points associated with the one or more moving cameras. The method further computes a location and an orientation of each moving camera of the one or more moving cameras based on one or more of the reference point data and one or more locations of one or more reference cameras of the plurality of reference cameras.

Motion capture calibration using cameras and drones

Embodiments facilitate the calibration of cameras in a live action scene using drones. In some embodiments, a method configures a plurality of reference cameras to observe at least one portion of the live action scene. The method further configures one or more moving cameras having unconstrained motion to observe one or more moving objects in the live action scene and to observe at least three known reference points associated with the plurality of reference cameras. The method further receives reference point data in association with the one or more moving cameras, where the reference point data is based on the at least three known reference points. The method further computes a location and an orientation of each moving camera of the one or more moving cameras based on one or more of the reference point data and one or more locations of one or more reference cameras of the plurality of reference cameras.

Motion capture calibration using drones

Embodiments provide a wearable article for a performance capture system. In some embodiments, a wearable article includes one or more regions, where the one or more regions are configured to be worn on at least a portion of a body of a user, where the one or more regions have a first pliability and a second pliability, where the first pliability and the second pliability are different pliabilities, and where at least one of the one or more regions are configured to hold devices in predetermined positions while maintaining shape and respective pliability. In some embodiments, the wearable article also includes a plurality of mounting mechanisms coupled to the one or more regions for mounting one or more reference markers to be used for position determination.

Wearable article for a performance capture system

A sealed active marker apparatus of a performance capture system is described to provide protective housing for active marker light components coupled to a strand and attached via a receptacle, to an object, such as via a wearable article, in a live action scene. The receptacle includes a protrusion portion that permits at least one particular wavelength range of light emitted from the enclosed active marker light component, to diffuse in a manner that enables easy detection by a sensor device. A base portion interlocks with a bottom plate of the receptacle to secure the strand within one or more channels. A sealant material coating portions of the apparatus promotes an insulating environment for the active marker light component.

Sealed active marker for performance capture

Implementations provide a wearable article for a performance capture system. In some implementations, a wearable article includes one or more regions, where the one or more regions are configured to be worn on at least a portion of a body of a user, and where at least one of the one or more regions are configured to hold performance capture equipment in predetermined positions. In some implementations, the wearable article also includes a plurality of mounting mechanisms coupled to the one or more regions for mounting reference markers to be used for position determination. In some implementations, the wearable article also includes a plurality of fastening mechanisms coupled to the one or more regions for fastening devices and accessories for controlling the reference markers.

Wearable article supporting performance capture equipment

An active marker apparatus is provided for securely affixing active markers to a wearable article of an object in a performance capture system. The active marker light components coupled to a strand, are inserted into a receptacle to position the active marker light components onto the wearable article. A gap is provided in a chamber between the active marker light component and an interior surface of a protrusion portion of the receptacle. At least a section of the protrusion portion permits light emitted from the active marker light component into the chamber, to diffuse in a manner that allows the light to be easily detected by a camera in the live action scene. Each active marker light component is locked into place in a respective receptacle by one or more channels that receive the strand. A cap fitting may further assist in securing the receptacle to the wearable article and optionally aid in visual detection of the receptacle.

Active marker enhancements for performance capture

The present description relates to light patterns used in a live action scene of a visual production to encode information associated with objects in the scene, such as movement and position of the objects. A data capture system is enabled to differentiate between various groups of active markers attached to the objects in the scene. The groups of active markers emit particular wavelengths in strobing patterns predefined for the various groups. In some implementations, the groups are instructed to emit its assigned signature light pattern through a signal controller transmitting an initial key signature predefined for the group, followed by pattern signals to a control unit. The data representing the pattern is captured in illuminated and blank frames. Frames showing the light pattern are analyzed to extract information about the groups of active markers, such as distinguishing the groups and identifying the objects to which they are attached.

Strobing of active marker groups in performance capture

The present description relates to light patterns used in a live action scene of a visual production to encode information associated with objects in the scene, such as movement and position of the objects. A data capture system includes active markers that emit light of a particular wavelength in predefined strobing patterns. In some implementations, the active markers are instructed to emit an assigned signature pattern of light through a signal controller sending signals to a control unit. Various components are synchronized such that pulsing of light corresponds to time slices and particular frames captured by the performance capture system. The data representing the pattern is embedded in illuminated and blank frames. Frames showing the light pattern are analyzed to extract information about the active markers, such as identification of the active markers and objects to which they are attached.

Active marker strobing and synchronization for performance capture communication

The present description relates relate to recalibration of a sensor device for performance capture, by detecting a miscalibration problem with sensor device and assessment of the problem. A recalibration system includes sensor devices initially calibrated at a recording site. A recording site change occurs and afterwards, a failure to match virtual rays projected from one sensor device with virtual rays projected from the active marker is detected. In response to determining the failure, the active marker is signaled to emit a unique display of light. The failure of the rays to match is assessed based on whether sensor devices capture the unique display of light. Three-dimensional (3-D) coordinates of an active marker is reconstructed from marker data of the calibrated sensor devices. A problematic sensor device is recalibrated based on the assessment, using the 3-D coordinates of the active marker from marker data of the remaining calibrated sensor devices, without stopping the recording.

Multi-presence detection for performance capture

Active marker strobing for performance capture communication

Embodiments facilitate the calibration of cameras in a live action scene. In some embodiments, a system receives images of the live action scene from a plurality of cameras. The system further receives reference point data generated from a performance capture system, where the reference point data is based on at least three reference points, where the at least three reference points are positioned within the live action scene, and where distances between the at least three reference points are predetermined. The system further determines a location and orientation of each camera based on the reference point data.

Motion capture calibration

A performance capture system is provided to detect one or more active marker units in a live action scene. Active marker units emanate at least one wavelength of light that is captured by the performance capture system and used to detect the active markers in the scene. The system detects the presence of the light as a light patch in a capture frames and determines if the light patch represents light from an active marker unit. In some implementations, various active markers in a scene may emanate different wavelengths of light. For example, wavelengths of light from multi-emitting active marker units may be changed due to various conditions in the scene.

Active marker device for performance capture

Implementations facilitate the calibration of cameras in a live action scene. In some implementations, a system includes a base, where the base is configured to removably couple to a camera in the live action scene. The system further includes a plurality of extensions coupled to the base, where the plurality of extensions extends outwardly away from the base. The system further includes a plurality of reference points identifiable by a sensor, where the reference points are coupled to ends of corresponding extensions of the plurality of extensions, and where the plurality of extensions positions the plurality of reference points in a three-dimensional arrangement. Distances between pairs of reference points are based on one or more aspects of the extensions, and the distances between the pairs of reference points are used to compute reference point data generated from a performance capture system.

Three-dimensional assembly for motion capture calibration

Embodiments provide a wearable article with channels for a performance capture system. In some embodiments, a wearable article includes one or more regions of the wearable article configured to be worn on at least a portion of a body of a user. In some embodiments, the wearable article also includes at least one of the one or more regions comprising at least one base layer and at least one secondary layer configured to form at least one connection passage between the at least one base layer and the at least one secondary layer. In some embodiments, the at least one connection passage is configured to provide access for flexible cable connections between at least one reference marker and one or more other reference markers or a control unit. In some embodiments, the at least one connection passage is configured to allow movement of a flexible cable within the connection passage in response to movement of the user.

Growing community of inventors

Wellington, New Zealand

Jake Botting