Massachusetts Institute of Technology

Mitsubishi Electric Research Laboratories, Inc.

Google Inc.

Lantos Technologies, Inc.

Daniel Vlasic

Federico Frigerio

Manas Chandran Menon

Douglas P Hart

Douglas M Johnston

Wojciech Matusik

Hanspeter Pfister

Forrester H Cole

Xiaowei Chen

Giovanni Vannucci

Kyle Genova

Alison M Forsyth

Ben Frantzdale

Alban De Brouchoven De Bergeyck

Systems and methods of the present disclosure are directed to a method that can include obtaining a 3D mesh comprising polygons and texture/shading data. The method can include rasterizing the 3D mesh to obtain a 2D raster comprising pixels and coordinates respectively associated with a subset of pixels. The method can include determining an initial color value for the subset of pixels based on the coordinates of the pixel and the associated shading/texture data. The method can include constructing a splat at the coordinates of a respective pixel. The method can include determining an updated color value for a respective pixel based on a weighting of the subset of splats to generate a 2D rendering of the 3D mesh based on the coordinates of a pixel and a splat.

Systems and methods for generating splat-based differentiable two-dimensional renderings

In one aspect, there is provided an apparatus. The apparatus may include a balloon membrane. The balloon membrane may include an opening, an exterior surface, and an interior surface. The interior surface may include one or more fiducial markers forming a pattern detectable by a scanner imaging the interior surface of the balloon membrane. Scanned portions of the interior surface of the balloon membrane may be combined based on the fiducial markers forming the pattern. Related methods and articles of manufacture, including computer program products, are also disclosed.

Fiducial markers for fluorescent 3D imaging

The attenuation and other optical properties of a medium are exploited to measure a thickness of the medium between a sensor and a target surface. Disclosed herein are various mediums, arrangements of hardware, and processing techniques that can be used to capture these thickness measurements and obtain dynamic three-dimensional images of the target surface in a variety of imaging contexts. This includes general techniques for imaging interior/concave surfaces as well as exterior/convex surfaces, as well as specific adaptations of these techniques to imaging ear canals, human dentition, and so forth.

Selecting an earpiece based on dynamic data

Various improvements to inflatable membranes for use in three-dimensional imaging of interior spaces are disclosed. These improvements include, among other things, equipping the inflatable membrane with desirable optical features, such as fiducials, optical coatings, etc., that can be used to improve data acquisition.

Three dimensional scanning using membrane with optical features

Evaluating fit of an earpiece based on dynamic data

Various improvements to three dimensional imaging systems having inflatable membranes are disclosed. These improvements include, among other things, a proximity sensor that can be used to warn a user of the device when approaching a feature in a cavity, such as an eardrum in an ear canal; or optical sensors with an optical coating matching the refractive index of the medium in which the optical sensors are deployed, to improve data acquisition.

Enhanced sensors in three dimensional scanning system

Various improvements to inflatable membranes are disclosed. These improvements include, among other things, features on the membrane that can mitigate hazards such as bubble formation or frictional damage during inflation of the membrane.

Inflatable membrane with hazard mitigation

Various improvements to inflatable membranes are disclosed. These improvements include techniques for advantageously controlling the inflation of a membrane within a cavity, such as a human ear canal.

Inflatable membrane having non-uniform inflation characteristic

Positioning an input transducer for an earpiece based upon dynamic data

Simulating earpiece fit based upon dynamic data

A multi-purpose device that can be used, as, among other things, an otoscope and a three dimensional scanning system is disclosed.

Integrated otoscope and three dimensional scanning system

Using dynamic data to determine a material profile for earpiece

Imaging shape changes in ear canals

Dynamic three-dimensional imaging of ear canals

A system captures motion data in natural environments. A set of sources and a set of sensors are arranged on an object such as a human body. Each source emits ultrasonic signals detected by the sensors. A driver module is also arranged on the body. The driver module generates the ultrasonic signals for the set of sources and timing signals for the set of sensors. Distances between the set of sources and the set of sensors are measured based on a time of flight of the ultrasonic signals. Three dimensional locations of the set of sources and the set of sensors are determined from the distances. The distance measurements are refined using inertial components that provide rotation rates and accelerations. All these measurements together yield poses or configurations of the object.

Growing community of inventors

Cambridge, MA, United States of America

Daniel Vlasic