Other

Gabriel Fine

Nathan Silberman

A system, method, and computer program product for presurgical planning related to an object associated with a medical procedure for a patient is disclosed. A model can be trained for an object as part of a medical procedure, the trained model being generated from one or more machine learning algorithms that are trained on annotated images of the object with spatial information of the object. An imaging computer system can receive or simulate one or more images of the object captured by an imaging device positioned external to the patient. The imaging computer system can further determine, based on applying the trained model to the one or more images of the object, spatial information of the object during the medical procedure. A display can output the one or more images and the spatial information of the object.

Presurgical planning

A system, method, and computer program product for image-based detection of an object internal to a patient is disclosed. A model can be trained for an internal object, such as an invasive medical device, the trained model being generated from one or more machine learning algorithms that are trained on annotated images of the object with spatial information of the object. An imaging computer system can receive one or more images of the internal object captured by an imaging device positioned external to the patient. The imaging computer system can further detect, based on applying the trained model to the one or more images of the object, the internal object within the patient. A display can output the one or more images and the identifying information for the object.

Image-based detection of internal object

A system, method, and computer program product for image-based detection of conditions for an object internal to a patient is disclosed. A model can be trained for an internal object, such as an invasive medical device, the trained model being generated from one or more machine learning algorithms that are trained on annotated images of the object with condition information of the object. An imaging computer system can receive one or more images of the internal object captured by an imaging device positioned external to the patient. The imaging computer system can further determine, based on applying the trained model to the one or more images of the object, current condition information for the internal object, such as current spatial information for the object. A display can output the one or more images and the condition information for the object.

Image-based detection of object condition

A system and method for image-based monitoring of an object inserted into a patient is disclosed. A model can be trained for an object configured to be inserted into a patient as part of a medical procedure, the trained model being generated from one or more machine learning algorithms that are trained on annotated images of the object with spatial information of the object. An imaging computer system can receive one or more images of the object inserted within the patient captured by an imaging device positioned external to the patient. The imaging computer system can further determine, based on applying the trained model to the one or more images of the object, current spatial information of the object within the patient. A display can output the one or more images and the current spatial information of the object.

System for monitoring object inserted into patient's body via image processing

A system and method is disclosed for displaying augmented image data for invasive medical devices. A current orientation and a current position of the invasive medical device within a patient can be determined by applying a trained model of the invasive medical device to unannotated images of the invasive medical device as captured by an imaging device. The images of the invasive medical device can be displayed and overlaid with the current orientation and current position of the invasive medical device. User input can be received to initialize tracking of an orientation and a position of the invasive medical device as the invasive medical device is moved within the patient.

Displaying augmented image data for medically invasive devices via image processing

A system and method is disclosed for augmenting image data of an invasive medical device using optical imaging. An optical imaging sensor, separate from the invasive medical device, can generate images of the medical device within a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with orientation and distance information of the invasive medical device. An imaging computer system can apply the trained model to images of the invasive medical device within the patient to determine a current orientation and a current distance of the invasive medical device. The images of the invasive medical device as captured by the optical imaging sensor, visual orientation information representing the current orientation of the invasive medical device, and visual distance information representing the current distance of the invasive medical device within the patient can be displayed.

System for augmenting image data of medically invasive devices using optical imaging

A system and method for augmenting unlabeled imaging data of invasive medical devices is disclosed. An imaging device can generate images of the invasive medical device inside a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device having labels indicating orientation and position information. An imaging computer system can apply the trained model to unlabeled images of the invasive medical device within the patient to determine a current orientation and a current position of the invasive medical device inside the patient. The images of the invasive medical device, visual orientation information representing the current orientation of the invasive medical device, and visual position information representing the current position of the invasive medical device inside the patient can be outputted to a display.

Augmenting unlabeled images of medically invasive devices via image processing

A system and method is disclosed for augmenting image data of an invasive medical device having non-medical structures. An invasive medical device having markers with distinct physical shapes relative to other portions of the invasive medical device can be inserted in a patient. An imaging device can generate images of the invasive medical device within the patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device annotated with marker and spatial information. An imaging computer system can apply the trained model to images of the invasive medical device having depictions of the markers to determine current spatial information. The depictions of the markers can be identified and correlated with the spatial information from the annotated images. The images and visual spatial information representing the spatial information of the invasive medical device can be outputted to a display.

Augmenting image data of medically invasive devices having non-medical structures

A system and method is disclosed for guiding an invasive medical device with radiation absorbing markers. The invasive medical device can include markers with different radiation absorbing properties relative to other portions of the invasive medical device. An imaging device can generate images of the invasive medical device within a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device annotated with marker information identifying the markers and spatial information for the invasive medical device. An imaging computer system can apply the trained model to images of the invasive medical device within the patient including depictions of the markers to determine current spatial information of the invasive medical device inside the patient. The images of the invasive medical device and visual spatial information representing the spatial information of the invasive medical device can be outputted to a display.

Guiding medically invasive devices with radiation absorbing markers via image processing

A system and method is disclosed for guiding invasive medical devices relative to anatomical structures. An imaging device can generate one or more images of the invasive medical device within the patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with at least one of orientation and position information. An imaging computer system can apply the trained model to unannotated images of the invasive medical device within the patient to determine at least one of a current orientation and a current position of the invasive medical device relative to the one or more anatomical structures within the patient. The images of the invasive medical device, visual orientation information representing the current orientation, and visual position information representing the current position of the invasive medical device relative to the anatomical structures within the patient can be outputted to a display.

System for guiding medically invasive devices relative to anatomical structures via image processing

A system and method is disclosed for automatically determining position information for an invasive medical device based on imaging data. An imaging device can generate 2D images of the invasive medical device within the patient from a vantage point relative to the patient. A trained model for the invasive medical device can be trained on annotated 2D images of the invasive medical device with position information. An imaging computer system can apply the trained model to unannotated 2D images of the invasive medical device within the patient to determine a current position of the invasive medical device. The 2D images of the invasive medical device and visual position information representing the current position of the invasive medical device can be outputted to a display.

Automatically determining orientation and position of medically invasive devices via image processing

A system and method for guiding invasive medical devices relative to other medical devices is disclosed. An imaging device can generate images of the invasive medical device within a body. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with at least one of orientation and position information. An imaging computer system can apply the trained model to unannotated images of the invasive medical device to determine at least one of a current orientation and a current position of the invasive medical device relative to another medical device within the body. At least one of visual orientation information representing the current orientation of the invasive medical device relative to the other medical device and visual position information representing the current position of the invasive medical device relative to the other medical device within the body can be outputted.

System for guiding medically invasive devices relative to other medical devices via image processing

A method of determining the position and orientation of an invasive medical device is described using altered devices and a machine learning algorithm for detecting the position and orientation of such devices from imagery. Such predictions can subsequently be displayed to an operator to improve the speed and accuracy by which they perform procedures.

Growing community of inventors

Salt Lake City, UT, United States of America

Gabriel Fine