Carnegie Mellon University

University of Toronto

Ppg Industries Ohio, Inc.

William Marsh Rice University

Vitro, S.a.b. De C.v.

Guard, Inc.

Srinivasa Narasimhan

Matthew O'Toole

William L Whittaker

Supreeth Achar

Joseph Bartels

Kiriakos Neoklis Kutulakos

Mark Sheinin

Kevin J Matjasko

Frank J Triggiani

Jian Jim Wang

Herman Herman

Ashutosh Sabharwal

Chris Barton

Nigel Morris

Anthony Rowe

Nichole Suzanne Rouillac

Aswin C Sankaranarayanan

Robin Nicholas Hubbard

James C Hoe

Jaime W Bourne

D W Wilson Hamilton

Jonathan Chei-Feung Lau

Jian Wang

Kiriakos Kutulakos

Artur Dubrawski

Akash K Maity

Robert Tamburo

Marie Nguyen

Chao Liu

A fast imaging apparatus and method for high resolution diffuse optical tomography with a line imaging and illumination system is disclosed. The method uses an algorithm comprising a convolution approximation of the forward heterogeneous scattering model that can be inverted to produce deeper than ever before structured beneath the surface. The method can detect reasonably accurate boundaries and relative depth of absorption variations up to a depth of approximately 8 mm below highly scattering medium such as skin.

High resolution diffuse optical tomography using short range indirect imaging

Provided are systems, methods, and computer program products for generating modified light emissions. The system includes at least one signal receiver arranged on a vehicle, at least one sensor arranged on the vehicle, at least one lighting system arranged on the vehicle, and at least one processor in communication with the at least one signal receiver, the at least one sensor, and the at least one lighting system, the at least one processor configured to: receive a first signal with the at least one signal receiver; receive sensor data from the at least one sensor; determine lighting data based on the first signal; generate a modified light emission by geometrically transforming the lighting pattern based on the sensor data; and control the at least one lighting system to output the modified light emission.

System, method, and computer program product for generating modified light emissions

A novel class of imaging systems that combines diffractive optics with 1D line sensing is disclosed. When light passes through a diffraction grating or prism, it disperses as a function of wavelength. This property is exploited to recover 2D and 3D positions from line images. A detailed image formation model and a learning-based algorithm for 2D position estimation are disclosed. The disclosure includes several extensions of the imaging system to improve the accuracy of the 2D position estimates and to expand the effective field-of-view. The invention is useful for fast passive imaging of sparse light sources, such as streetlamps, headlights at night and LED-based motion capture, and structured light 3D scanning with line illumination and line sensing.

Systems and methods for diffraction line imaging

Techniques for analysis and deep learning modeling of sensor-based object detection data in bounded aquatic environments are described, including capturing an image from a sensor disposed substantially above a waterline, the sensor being housed in a structure electrically coupled to a light housing, converting the image into data, the data being digitally encoded, evaluating the data to separate background data from foreground data, generating tracking data from the data after the background data is removed, the tracking data being evaluated to determine whether a head or a body are detected by comparing the tracking data to classifier data, tracking the head or the body relative to the waterline if the head or the body are detected in the tracking data, and determining a state associated with the head or the body.

Analysis and deep learning modeling of sensor-based object detection data in bounded aquatic environments

A method to dynamically and adaptively sample the depths of a scene using the principle of triangulation light curtains is described. The approach directly detects the presence or absence of obstacles (or scene points) at specified 3D lines in a scene by sampling the scene. The scene can be sampled sparsely, non-uniformly, or densely at specified regions. The depth sampling can be varied in real-time, enabling quick object discovery or detailed exploration of areas of interest. Once an object is discovered in the scene, adaptive light curtains comprising dense sampling of a region of the scene containing the object, can be used to better define the position, shape and size of the discovered object.

Agile depth sensing using triangulation light curtains

An energy optimized imaging system that includes a light source that has the ability to illuminate specific pixels in a scene, and a sensor that has the ability to capture light with specific pixels of its sensor matrix, temporally synchronized such that the sensor captures light only when the light source is illuminating pixels in the scene.

Energy optimized imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor

Embodiments described herein are generally directed to a device that monitors for the presence of objects passing through or impinging on a virtual shell near the device, referred to herein as a 'light curtain', which is created by rapidly rotating a line sensor and a line laser in synchrony. The boundaries of the light curtain are defined by a sweeping line defined by the intersection of the sensing and illumination planes.

Programmable light curtains

Energy-efficient epipolar imaging is applied to the ToF domain to significantly expand the versatility of ToF sensors. The described system exhibits 15+ m range outdoors in bright sunlight; robustness to global transport effects such as specular and diffuse inter-reflections; interference-free 3D imaging in the presence of many ToF sensors, even when they are all operating at the same optical wavelength and modulation frequency; and blur- and distortion-free 3D video in the presence of severe camera shake. The described embodiments are broadly applicable in consumer and robotics domains.

Method for epipolar time of flight imaging

A system for creating a near-spherical point cloud of RGBD data includes one or more sensing units for providing depth data, each sensing unit having a stereo pair of sensors fitted with the wide-angle lens from which a one-dimensional line of pixels is read, and one or more lasers for illuminating the single line of pixels, the sensing units mounted on a spinning platform. The spinning platform is mounted on the base having a plurality of cameras mounted therein for providing 360-degree RGB data.

Energy optimized imaging system with 360 degree field-of-view

Imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor

A computer-implemented method for visualizing an object includes the steps of providing a simulated environment; rendering, with at least one processor, at least one virtual object based at least partially on the simulated environment, a viewable angle of the at least one virtual object, and object characteristics associated with the at least one virtual object, the object characteristics comprising at least one of the following: reflectance, transmittance, attenuation, or any combination thereof; and changing a viewable angle of the at least one virtual object in response to user input. A system and a computer program product for implementing the aforementioned method includes appropriately communicatively connected hardware components.

System and method for visualizing an object in a simulated environment

A computer-implemented method for visualizing an object includes the steps of providing a simulated environment; rendering, with at least one processor, at least one virtual object based at least partially on the simulated environment, a viewable angle of the at least one virtual object, and object characteristics associated with the at least one virtual object, the object characteristics comprising at least one of the following: reflectance, transmittance, attenuation, or any combination thereof, and changing a viewable angle of the at least one virtual object in response to user input. A system and a computer program product for implementing the aforementioned method includes appropriately communicatively connected hardware components.

Growing community of inventors

McDonald, PA, United States of America

Srinivasa Narasimhan