Mitsubishi Electric Research Laboratories, Inc.

University of Michigan

Vineet R Kamat

Yuichi Taguchi

Chen Feng

Yong Xiao

Suyang Dong

Da Li

Carol C Menassa

A method of making a thermal comfort estimation of one or more human occupants in a built space in real-time is presented. The method employs one or more thermographic cameras and one or more red, green, and blue depth (RGB-D) sensors. The method has several steps. In an example, the method involves capturing thermal images of the human occupant(s) via the thermographic camera(s) and capturing RGB-D images of the human occupant(s) via the RGB-D camera(s). The method further involves extracting facial skin temperatures of the human occupant(s) using the captured thermal images and using the captured RGB-D images. And the method involves estimating the thermal comfort of the human occupant(s) using the extracted facial skin temperatures.

Detecting presence and estimating thermal comfort of one or more human occupants in a built space in real-time using one or more thermographic cameras and one or more RGB-D sensors

Systems for completing missing points in a three-dimensional (3D) point cloud. The systems include a 3D sensor for measuring point data of objects in a scene, a processor in connection with the 3D sensor and a memory storing a program and the point data, and a display monitor connected to the processor and the 3D sensor for displaying a completed 3D point cloud, wherein the processor executes instruction steps of the program. The instruction steps include acquiring the point data of the objects to generate the 3D point cloud, wherein the point data include a set of points on the objects, extracting planar segments from the 3D point cloud, identifying connectivity relations and missing points among the planar segments, and filling the missing points in the 3D point cloud to generate the completed 3D point cloud using the planar segments and the connectivity relations.

Method and system for completing point clouds using planar segments

A method determines dimensions in a scene by first acquiring a depth image of the scene acquired by a sensor, and extracting planes from the depth image. Topological relationships of the planes are determined. The dimensions are determined based on the planes and the topological relationships. A quality of the dimensions is evaluated using a scene type, and if the quality is sufficient outputting the dimensions, and otherwise outputting a guidance to reposition the sensor.

Method for determining dimensions in an indoor scene from a single depth image

A method of blending at least one virtual construction jobsite object and at least one real construction jobsite object in a dynamic augmented reality scene of a construction jobsite includes several steps. One step involves capturing a depth map image via a depth sensing device, and capturing a red, green, and blue (RGB) image via an RGB image-capturing device. Another step involves registering the depth map image and the RGB image to a common coordinate system. Yet another step involves projecting the at least one virtual construction jobsite object in a scene of the construction jobsite with the use of geographical information system (GIS) data, computer-aided design (CAD) data, or both types of data, to generate the augmented reality scene of the construction jobsite. And yet another step involves removing hidden surfaces of the at least one virtual construction jobsite object in the augmented reality scene.

Blending real and virtual construction jobsite objects in a dynamic augmented reality scene of a construction jobsite in real-time

A method extracts planes from three-dimensional (3D) points by first partitioning the 3D points into disjoint regions. A graph of nodes and edges is then constructed, wherein the nodes represent the regions and the edges represent neighborhood relationships of the regions. Finally, agglomerative hierarchical clustering is applied to the graph to merge regions belonging to the same plane.

Growing community of inventors

Ann Arbor, MI, United States of America

Vineet R Kamat