University of Colorado

Shane Transue

Min-Hyung Choi

Ann C Halbower

Various embodiments of the disclosed technology present a structural foundation for volumetric flow reconstructions for expiratory modeling enabled through multi-modal imaging for pulmonology. In some embodiments, this integrated multi-modal system includes infrared (IR) imaging, thermal imaging of carbon dioxide (CO), depth imaging (D), and visible spectrum imaging. These multiple image modalities can be integrated into flow models of exhale behaviors enable the creation of three-dimensional volume reconstructions based on visualized COdistributions over time, formulating a four-dimensional exhale model which can be used to estimate various pulmonological traits (e.g., breathing rate, flow rate, exhale velocity, nose/mouth distribution, tidal volume estimation, and COdensity distributions). Various embodiments also enable the accurate acquisition of numerous pulmonary metrics that are then stored within distributed systems for respiratory data analytics and feature extraction through deep learning embodiments.

Non-contact breathing activity monitoring and analyzing through thermal and CO2 imaging

Systems and methods are described for mobile and augmented reality-based depth and thermal fusion scan imaging. Some embodiments of the present technology use sophisticated techniques to fuse information from both thermal and depth imaging channels together to achieve synergistic effects for object recognition and personal identification. Hence, the techniques used in various embodiments provide a much better solution for, say, first responders, disaster relief agents, search and rescue, and law enforcement officials to gather more detailed forensic data. Some embodiments provide a series of unique features including small size, wearable devices, and ability to feed fused depth and thermal streams into AR glasses. In addition, some embodiments use a two-layer architecture for performing device local fusion and cloud-based platform for integration of data from multiple devices and cross-scene analysis and reconstruction.

Mobile and augmented reality based depth and thermal fusion scan

An imaging system is provided. The imaging system includes a 3D image capture device, which is configured to capture a depth image of an object, and a thermal image capture device, which is configured to capture a thermal image of the object. The imaging system also includes a processing system, which is coupled with the 3D image capture device and the thermal image capture device. The processing system is configured to process the depth image and the thermal image to produce a thermal-depth fusion image by aligning the thermal image with the depth image, and assigning a thermal value derived from the thermal image to a plurality of points of the depth image.

Growing community of inventors

Arvada, CO, United States of America

Shane Transue