Ramona Optics Inc.

Duke University

Jaehee Park

Mark Harfouche

Gregor Horstmeyer

Colin Cooke

Veton Saliu

Joseph A Izatt

Roarke W Horstmeyer

Sina Farsiu

Ruobing Qian

Kevin Zhou

Jed Doman

Paul Reamey

A method of mesoscopic photogrammetry can be carried out using a set of images captured from a camera on a mobile computing device. Upon receiving the set of images, the method generates a composite image, which can include applying homographic rectification to warp all images of the set of images onto a common plane; applying a rectification model to undo perspective distortion in each image of the set of images; and applying an undistortion model for adjusting for camera imperfections of a camera that captured each image of the set of images. A height map is generated co-registered with the composite image, for example, by using an untrained CNN whose weights/parameters are optimized in order to optimize the height map. The height map and the composite image can be output for display.

Feature-free photogrammetric 3D imaging with cameras under unconstrained motion

A system and method for high-resolution polarimetric imaging can include an array of micro-cameras to simultaneously capture polarized optical information from a wide area. Polarized illumination sources can be placed below and/or above the sample to direct polarized light to the sample during image capture. Post processing can be performed on the captured images to obtain polarimetric properties of the sample.

Snapshot polarization imaging with a micro-camera array microscope

Image features are extracted from multiple variably-illuminated images, with the images acquired from a multi-camera array microscope. A sequence of images per camera is captured, with the illumination pattern varied between each image capture. After image capture, a post-processing algorithm finds keypoints of interest within the images captured by each camera. These features can be used to assist with stitching together images from the multi-camera array, in addition to image compression, object tracking or other automated tasks.

Methods to detect image features from variably-illuminated images

A system and method for high resolution multi-fluorescence imaging with synchronized image acquisition amongst sensors can be used to simultaneously capture fluorescence signals from multiple fluorophores over extremely large fields of view. The system can include an array of micro-cameras, along with a particular arrangement of fluorescent filters that can be fixed in one location or moved to new locations.

System and method for synchronized fluorescence capture

A method to capture microscopy images from multiple image sensors and to relay them to one or more central processing units while minimizing delay in image capture can include the co-optimization of image acquisition hardware, data aggregation digital logic, firmware, and integration with data post processing on the central processing units. The methods can include organizing the incoming image data into data packets containing partial image frames, together with configuring the central processing units to be capable of analyzing the received partial image frames. The quick analysis of the images, e.g., on the partial image frames, can allow the computational system to rapidly respond to the captured images, such as to provide feed back on the captured images before the next images are to be captured.

Method to capture multiple simultaneous microscopy images from multiple digital sensors using field programmable gate arrays

A method to capture microscopy images from multiple image sensors and to relay them to one or more central processing units with high frame rates can include preprocessing the image data from the image sensors to reduce the sizes of the captured images, before sending the image data to a central processing station for analysis. Using multiple image sensors and an image reduction process, large image frames of over 20 megapixels and up to 1 gigapixel or more can be obtained at high imaging frame rates of 30 or more to up to hundreds or thousands of frames per second.

Growing community of inventors

Durham, NC, United States of America

Jaehee Park