System and method for rendering operative guidance overlay

Abstract

Embodiments for rendering an operative guidance overlay in association with a patient are disclosed. A method includes receiving image data indicating an anatomical structure of the patient and a structure of operative instruments; generating virtual models based on the image data; receiving sensor data associated with a user, the operative instruments, or the patient; dynamically generating guidance overlay data associated with the anatomical structure of the patient, or the operative instruments based on the virtual models and the sensor data; and rendering the operative guidance overlay in association with the patient based on the guidance overlay data using a wearable augmented reality interface device. The virtual models include a virtual anatomical model of the anatomical structure of the patient, or virtual instrument models associated with the operative instruments. The rendering comprises continuous alignment of the virtual anatomical model with the patient and the virtual instrument models with the operative instruments.