Disney Enterprises, Inc.

Eth Zurich (eidgenoessische Technische Hochschule Zurich)

Eth Zurich (eidgenossische Technische Hochschule Zurich)

Eth Zürich (eidgenossische Technische Hochscule Zürich)

Bernd Bickel

Wojciech Matusik

Thabo D Beeler

Markus H Gross

Bernhard Thomaszewski

Robert Walker Sumner

Derek Edward Bradley

Markus Gross

Paul A Beardsley

Philip John Jackson

Amit Bermano

Marc Alexa

Jan Kautz

Hanspeter Pfister

Stelian Coros

Anselm Grundhofer

Miguel A Otaduy

Stephen Robert Marschner

Peter Kaufmann

Daisuke Iwai

Steve Marschner

Philipp Bruschweiler

Fabrizio Pece

Olivier Roullier

Wojciech Jarosz

Marios Papas

Moritz Niklaus Bächer

Yeara Kozlov

Fabian Hahn

Christian Regg

Otmar Hilliges

Bob Sumner

Benjamin Hepp

Paul Gregory Kry

Sandro Mani

Shinjiro Sueda

Melina Skouras

Embodiments herein describe deformable controllers that rely on piezoelectric material embedded in the controllers to detect when the input device is being manipulated into a particular deformation or gesture. The computing system may perform different actions depending on which deformation is detected. The embodiments herein describe design techniques for optimizing the placement of the piezoelectric material in the controller to improve the accuracy of a mapping function that maps sensor responses of the material to different controller deformations. In one embodiment, the user specifies the different deformations of the controller she wishes to be recognized by the computing system (e.g., raising a leg, twisting a torso, squeezing a hand, etc.). The design optimizer uses the locations of the desired deformations to move the location of the piezoelectric material such that the sensor response of the material can be uniquely mapped to these locations.

Designing customized deformable input devices using simulated piezoelectric sensor responses

A computer-implemented method is provided for physical face cloning to generate a synthetic skin. Rather than attempt to reproduce the mechanical properties of biological tissue, an output-oriented approach is utilized that models the synthetic skin as an elastic material with isotropic and homogeneous properties (e.g., silicone rubber). The method includes capturing a plurality of expressive poses from a human subject and generating a computational model based on one or more material parameters of a material. In one embodiment, the computational model is a compressible neo-Hookean material model configured to simulate deformation behavior of the synthetic skin. The method further includes optimizing a shape geometry of the synthetic skin based on the computational model and the captured expressive poses. An optimization process is provided that varies the thickness of the synthetic skin based on a minimization of an elastic energy with respect to rest state positions of the synthetic skin.

Physical face cloning

A system for augmenting the appearance of an object including a plurality of projectors. Each projector includes a light source and a lens in optical communication with the light source, where the lens focuses light emitted by the light source on the object. The system also includes a computer in communication with the plurality of projectors, the computer including a memory component and a processing element in communication with the memory component and the plurality of projectors. The processing element determines a plurality of images to create an augmented appearance of the object and provides the plurality of images to the plurality of projectors to project light corresponding to the plurality of images onto the object to create the augmented appearance of the object. After the images are projected onto the object, the augmented appearance of the objected is substantially the same regardless of a viewing angle for the object.

Augmenting physical appearance using illumination

A method for creating a replication material corresponding to the appearance of a translucent or partially translucent target material. The appearance of the target material can be measured or may be prescribed by a user. The method includes receiving by a processor optical data related to a target subsurface scattering parameter of the target material. Once the processor has received the optical or light characteristic data, the method includes determining by the processor a replication pigment concentration to replicate the appearance of the target material caused by the target subsurface scattering parameter. The processor determines this concentration based on a plurality of pigment subsurface scattering parameters corresponding to a plurality of stored pigment concentrations in the computing device. Once the replication pigment concentration has been determined, the method includes creating, physically or virtually, the replication material by combining the pigment concentration with a base material.

Method of fabricating translucent materials with desired appearance

A method for fabricating custom surface reflectance and spatially-varying bi-directional reflectance distribution functions (BDRFs or svBRDFs). The 3D printing method optimizes micro-geometry to produce a normal distribution function (NDF) that can be printed on surfaces with a 3D printer. Particularly, the method involves optimizing the micro-geometry for a wide range of analytic NDFs and simulating the effective reflectance of the resulting surface. Using the results of the simulation, the appearance of an input svBRDF can be reproduced. To this end, the micro-geometry is optimized in a data-driven fashion and distributed on the surface of the printed object. The methods were demonstrated to allow 3D printing svBRDF on planar samples with current 3D printing technology even with a limited set of printing materials, and the described methods have been shown to be naturally extendable to printing svBRDF on arbitrary shapes or 3D objects.

3D printing with custom surface reflectance

There is provided a tensegrity design system and a method for use in designing a complex tensegrity structure. In one implementation, such a method includes providing virtual building blocks selectable by a user for assembly of a desired tensegrity structure, receive user-selected building blocks from among the plurality of virtual building blocks from the user, and identifying connections among the user-selected building blocks based on user inputs to the tensegrity design system. The method also includes determining a network of forces for stabilizing a tensegrity structure corresponding to the desired tensegrity structure, based on the user-selected building blocks and their connections, and generating a simulation of the tensegrity structure corresponding to the desired tensegrity structure for display to the user.

Modular design of complex tensegrity structures

Methods and systems of reconstructing an eyelid are provided. A method of reconstructing an eyelid includes obtaining one or more images of the eyelid, generating one or more image input data for the one or more images of the eyelid, generating one or more reconstruction data for the one or more images of the eyelid, and reconstructing a spatio-temporal digital representation of the eyelid using the one or more input image data and the one or more reconstruction data.

Detailed spatio-temporal reconstruction of eyelids

In an object generation system, consumable base materials are characterized in a characterization process wherein an object generation system can use a plurality of so-characterized base materials. User input representing a desired object and set of characteristics for that desired object are processed, using a computer or computing device, to derive a mapping of locations for placement of portions of the plurality of base materials such that when the mapping is provided to an object generator, the generated object approximates the representing a desired object and set of characteristics. The characterization of a base material might include elasticity of the base material, the user input might be a desired shape and elasticity, the object generator might be a 3D multi-material printer and the generated object might at least approximate the desired shape and elasticity as a result of being constructed from the plurality of base materials used by the printer.

Fabrication of materials with desired characteristics from base materials having determined characteristics

There is provided a motion-based design system and a method for use in producing a motion-based design of a mechanical object. In one implementation, such a method includes identifying a motion curve associated with a movement by an articulated structure corresponding to the mechanical object, and mapping the motion curve to a mechanical sub-assembly. The mapping is performed based on a previously characterized trajectory of the mechanical sub-assembly and the similarity of that trajectory to the motion curve. The method also includes utilizing the first mechanical sub-assembly to substantially replicate the motion curve.

Motion-based design of mechanical objects

Techniques are provided to model hair and skin. Multiscopic images are received that depict at least part of a subject having hair. The multiscopic images are analyzed to determine hairs depicted. Two-dimensional hair segments are generated that represent the hairs. Three-dimensional hair segments are generated based on the two-dimensional hair segments. A three-dimensional model of skin is generated based on the three-dimensional hair segments.

Coupled reconstruction of hair and skin

A three-dimensional relief can be produced from one or more two-dimensional digital (2D) images. A height field is computed from the 2D images and illumination direction information. The height field comprises a multiplicity of geometric surface elements arrayed in a 2D field corresponding to the pixels of the one or more 2D images. Each geometric surface element corresponds to a pixel of each of the digital images and has at least one height parameter representing a displacement from a surface floor. Once the height field is computed, optimizations can be made to the height field including adding and adjusting albedo and glossy surface finishing. The height field can be used to fabricate relief elements in a material, such that each relief element corresponds in shape, position in the height field, and height above the surface floor, to one of the geometric surface elements in the height field.

Physical reproduction of reflectance fields

An automated process facilitates the fabrication-oriented design of a mold for an inflatable, deformable balloon. The automated process comprises a computational balloon design process that, given a desired shape of an inflated balloon, computes an optimal rest shape of the balloon that, when inflated, approximates the desired shape as closely as possible. In such a design process, the optimal rest shape of the balloon is solved for numerically using a physics-driven shape optimization method combining physical simulation of inflatable elastic membranes with a dedicated constrained optimization algorithm. Once the optimal rest shape is determined, a dip mold can be fabricated that is suitable for manufacturing balloons having such a rest shape.

Computational design of inflatable deformable balloons

Growing community of inventors

Zurich, Switzerland

Bernd Bickel