System and method enabling a collaborative 3d map data fusion platform and virtual world system thereof

Abstract

A method includes providing a three-dimensional (3D) map data fusion platform in memory of a server comprising at least one processor; providing in the 3D map data fusion platform a map comprising imagery of a real-world location; publishing in the 3D map data fusion platform with reference to the map a real-time virtual replica network (RVRN), wherein the RVRN comprises a plurality of 3D virtual replicas, each of the 3D virtual replicas corresponding to a real-world object in the real-world location and comprising a plurality of object features, the object features including: a real-time position, orientation, and a 3D structure; obtaining a pose of a first client device; performing a simultaneous location and mapping (SLAM) process of a first coordinate space, wherein the SLAM process uses image data from an imaging device of the first client device, the pose of the first client device and data of the map to determine a pose of a first plurality of features within the first coordinate space; creating a first new map comprising 3D coordinates of the first plurality of features within the first coordinate space; and merging, by the 3D map data fusion platform, the first new map comprising the 3D coordinates of the first plurality of features within the first coordinate space with the published RVRN, creating a fused 3D map.