Use of augmented reality to assist navigation during medical procedures

Abstract

Physicians performing invasive procedures require accuracy and precision when working with surgical tools. Surgical procedures are increasingly becoming minimally invasive, with physicians operating using cameras to view the surgery site and directing their tools through oculars or video displays. Ideally, the physician should be able to perform the invasive procedure while simultaneously observing both the real-time image of the patient and additional data critical for his medical decisions about the manipulation of the surgical tool and the next surgical step. The augmented reality navigation system of the present disclosure provides tool location visibility for invasive procedures through the use of location sensors included on a camera and/or on the tools used during a procedure. A location tracking system determines and monitors the locations of the tools and camera based on the characteristics of signals detected by the sensors and displays informational overlays on images obtained with a camera.