Visually interacting with three dimensional data in augmented or virtual reality

Abstract

An apparatus includes: a memory embodying three-dimensional data and computer executable instructions; sensors detecting a movable controller in a real space; at least one processor, operative by the computer executable instructions to facilitate: mapping the three dimensional data to a virtual space; tracking a real position and orientation of the movable controller using data from the sensors; converting the real position and orientation into a virtual position and orientation relative to the three dimensional data; identifying a selected region of the three dimensional data, which is tethered to the virtual position and orientation; and rendering the three dimensional data in the virtual space, with the selected region being rendered differently from the remainder of the three dimensional data; and showing a user the rendering of the three dimensional data in the virtual space by activating a virtual or augmented reality display that is activated by the at least one processor.