Intuitive Surgical Operations, Inc.

Verily Life Sciences LLC

Google Inc.

Caitlin Q Donhowe

Vincent Duindam

Tao Zhao

Timothy D Soper

Federico Barbagli

Giuseppe Maria Prisco

Prashant Chopra

Carolyn M Fenech

Michael D Paris

Oliver J Wagner

Xing Jin

Anoop B Kowshik

Dorin Panescu

Amir Belson

Thomas J Yorkey

Eric Storne

Carol Reiley

Kristoffer John Donhowe

Kenneth Robert Krieg

Joëlle Barral

Jun Zhang

Stephen J Blumenkranz

Catherine J Mohr

Martin Habbecke

Randall L Schlesinger

Joëlle K Barral

Christopher R Carlson

Samuel Kwok Wai Au

Mark Rose

Lauren Von Dehsen

Samuel Y Chang

Kwok Wai Samuel Au

Liana Kong

Antons Krumins

Priya Kasirajan

Eric Michael Burger

Kara Malhotra

Kamilla Tekiela

Eric Burger

A system comprises a medical instrument including a sensing tool and comprises a processing unit including one or more processors. The processing unit is configured to receive data related to a patient anatomy from the sensing tool while the medical instrument traverses the patient anatomy. The processing unit is further configured to construct an anatomic model of the patient anatomy from the data received from the sensing tool. The processing unit is further configured to generate an image of the anatomic model for display and register a position of the medical instrument to the anatomic model.

Systems and methods for intraoperative segmentation

A method of deploying an interventional instrument comprises identifying a target structure in an anatomic frame of reference. The method further comprises determining a target region in the anatomic frame of reference with respect to a current position of the interventional instrument and recording a first engagement location of the interventional instrument within the target region.

Systems and methods for planning multiple interventional procedures

A system for performing an interventional procedure includes an interventional instrument and a control system. The control system includes a processor and a memory comprising machine-readable instructions that, when executed by the processor, cause the control system to: receive a model of an anatomic structure, the anatomic structure including a plurality of passageways; identify a target structure in the model; identify a planned deployment location for positioning a distal tip of the interventional instrument to perform the interventional procedure on the target structure; determine whether an angle of approach of the distal tip relative to a passageway wall of a passageway of the plurality of passageways at the planned deployment location is acceptable; and navigate the interventional instrument, via computer control or based on user input, to perform the interventional procedure on the target structure.

Systems and methods for interventional procedure planning

A catheter system comprises an elongate flexible catheter and a support structure mounted on the catheter. The support structure comprises a first alignment feature and a second alignment feature. The first alignment feature is configured to mate with a first sensor component and the second alignment feature configured to mate with a second sensor component. When the system further comprises a first sensor component mated with the first alignment feature and a second sensor component mated with the second alignment feature, the first sensor component is fixed relative to the second sensor component in at least one degree of freedom at the support structure by the first and second alignment features.

Systems and methods for configuring components in a minimally invasive instrument

A method may comprise storing a first waypoint corresponding to a first position of a tip of a steerable medical device including an articulatable segment. The controller may perform a motion pause check operation to determine that an insertion motion of the articulatable segment into a patient anatomy has been paused, while the tip is at a second position. The controller may determine that the articulatable segment has resumed the insertion motion into the patient anatomy. After determining that the articulatable segment has resumed the insertion motion, a second waypoint corresponding to the second position of the tip of the steerable medical device, may be stored. A boundary region may be defined to form a three-dimensional volume enclosing the positions of the stored waypoints. The articulatable segment may be constrained to remain within the boundary region as the articulatable segment is inserted in the patient anatomy.

Method and system for steerable medical device path definition and following during insertion and retraction

A method of registering sets of anatomical data for use during a surgical procedure is provided herein. The method may include segmenting a set of first modality image data representing a model of one or more passageways within a patient and generating a first set of points based on the segmented set of first modality image data representing the model of the one or more passageways. The method may further include determining a set of matches between a second set of points and the first set of points, wherein the second set of points is obtained by a second modality and discarding a subset of the set of matches based on a first heuristic to generate a modified set of matches. The second set of points may then be moved relative to the first set of points based on the modified set of matches and displayed on a display.

Systems and methods of registration for image-guided surgery

A system includes a medical instrument configured for movement by a teleoperational assembly and a processing unit including one or more processors. The processing unit is configured to provide instructions to the teleoperational assembly to move the medical instrument within an anatomic passageway according to a commanded velocity profile, receive a set of spatial information from the medical instrument positioned within the anatomic passageway, and filter the set of spatial information to select a quantity of spatial data records from the set of spatial information proportionate to the commanded velocity profile.

Systems and methods for filtering localization data

A method comprises tracking a set of optical fiducials positioned on a reference portion of a medical instrument. The medical instrument includes an elongated flexible body with a distal end and a rigid proximal body which includes the reference portion. The method further comprises receiving shape information from a shape sensor extending within the medical instrument between the reference portion and the distal end and determining a pose of a portion of the elongated flexible body with respect to the patient anatomy.

Systems and methods for using tracking in image-guided medical procedure

A method comprises receiving a set of model points of a model of one or more passageways of a patient. The method further comprises receiving a set of measured points collected from within the one or more passageways of the patient. Each point comprises coordinates within a medical environment occupied by the patient. The method further comprises matching each measured point to a model point to generate a set of matches. The method further comprises assigning a weight to each of the measured points based on the set of matches to generate a weighted set of matches. The method further comprises moving the set of measured points relative to the set of model points based on the weighted set of matches.

One example method for improving robotic surgical safety via video processing includes identifying, during a robotic surgical procedure, one or more surgical tools using one or more images of the surgical procedure captured by a camera, the robotic surgical procedure employing a robotic surgical device controlling the one or more identified surgical tools; predicting, for at least one of the one or more images, one or more loaded surgical tools that are controlled by the robotic surgical device and should be in a field of view of the camera; comparing the one or more identified surgical tools with the one or more loaded surgical tools; determining that at least one of the one or more loaded surgical tools does not match any of the one or more identified surgical tools; and causing the at least one loaded tool of the robotic surgical device to be disabled.

Robotic surgical safety via video processing

A method performed by a computing system comprises receiving a fluoroscopic image of a patient anatomy while a portion of a medical instrument is positioned within the patient anatomy. The fluoroscopic image has a fluoroscopic frame of reference. The portion has a sensed position in an anatomic model frame of reference. The method further comprises identifying the portion in the fluoroscopic image and identifying an extracted position of the portion in the fluoroscopic frame of reference using the identified portion in the fluoroscopic image. The method further comprises registering the fluoroscopic frame of reference to the anatomic model frame of reference based on the sensed position of the portion and the extracted position of the portion.

Systems and methods for using registered fluoroscopic images in image-guided surgery

Systems and methods for depth detection and virtual modeling using surgical robots during a surgical procedure are described. The robotic surgical systems include robotic arms with interchangeable surgical tools. An endoscope at the end of one of the robotic arms includes a depth sensor for detecting a distance from the camera to patient anatomy. The depth data and image data are used to generate a feature model of the patient anatomy for reference by a surgeon. The feature model is displayed to the surgeon in an augmented reality view with preoperative and intraoperative images mapped thereon for reference and guidance of a surgical procedure.

Robotic surgery depth detection and modeling

Systems and methods for identifying surgery tools of a robotic surgery system in surgery video based on robot kinematics are described. Kinematic data describing a position of a first robotic surgery arm including a surgery tool is used to determine a nominal position of the first robotic surgery arm. A search area within image data obtained during a robotic surgery from an endoscope attached to a second robotic surgery arm is determined based on the kinematic data and a nominal position of the surgery tool. The surgery tool is identified within the search area of the image data using an object detection technique.

Surgery tool segmentation with robot kinematics

Examples of systems and methods for detecting delays during a surgical procedure are disclosed. For example, one disclosed method includes receiving, a computing device, video of a robotic surgical procedure; determining, by the computing device, an estimated time-to-complete ('TTC') the robotic surgical procedure based on the video; and in response to determining a deviation between the estimated TTC and an expected duration of the robotic surgical procedure exceeds a threshold, outputting an indication that the robotic surgical procedure is deviating from the expected duration.

Growing community of inventors

Mountain View, CA, United States of America

Caitlin Q Donhowe