Intuitive Surgical Operations, Inc.

Accom

Intuitive Surgical, Inc.

John D Stern

Brian David Hoffman

Wenyi Zhao

David D Scott

Tao Zhao

Gunter D Niemeyer

Robert G Younge

Catherine J Mohr

David S Gere

Luigi C Gallo

Ian E McDowall

Christopher J Hasser

Douglas J George

Michael J Tierney

David Gere

Christopher R Burns

William C Nowlin

Eugene F Duval

Craig R Gerbi

Gary S Guthart

Paul E Lilagan

Akhil Jiten Madhani

Don S Minami

J Kenneth Salisbury

Sohei Takemoto

Kenneth A Woodhouse

Ian McDowell

Ben Lamprecht

Bob Hager

Junaid Sheikh

Jose Alvarez

Ian M Mcdowall

Robotic, telerobotic, and/or telesurgical devices, systems, and methods take advantage of robotic structures and data to calculate changes in the focus of an image capture device in response to movement of the image capture device, a robotic end effector, or the like. As the size of an image of an object shown in the display device varies with changes in a separation distance between that object and the image capture device used to capture the image, a scale factor between a movement command input may be changed in response to moving an input device or a corresponding master/slave robotic movement command of the system. This may enhance the perceived correlation between the input commands and the robotic movements as they appear in the image presented to the system operator.

Autofocus and/or autoscaling in telesurgery

An endoscope with an optical channel is held and positioned by a robotic surgical system. A capture unit captures (1) a visible first image at a first time and (2) a visible second image combined with a fluorescence image at a second time. An image processing system receives (1) the visible first image and (2) the visible second image combined with the fluorescence image and generates at least one fluorescence image. A display system outputs an output image including an artificial fluorescence image.

Augmented visualization for a surgical robot using a captured visible image combined with a fluorescence image and a captured visible image

An endoscope with an optical channel is held and positioned by a robotic surgical system. A capture unit captures (1) a visible first image at a first time and (2) a visible second image combined with a fluorescence image from the light at a second time. An image processing system receives (1) the visible first image and (2) the visible second image combined with the fluorescence image and generates at least one fluorescence image. A display system outputs an output image including an artificial fluorescence image.

An endoscope with a stereoscopic optical channel is held and positioned by a robotic surgical system. A capture unit captures (1) a visible first image and (2) a visible second image combined with a fluorescence second image from the light. An intelligent image processing system receives (1) the visible first image and (2) the visible second image combined with the fluorescence second image and generates at least one fluorescence image of a stereoscopic pair of fluorescence images and a visible second image. An augmented stereoscopic display system outputs a real-time stereoscopic image including a three-dimensional presentation including in one eye, a blend of the at least one fluorescence image of a stereoscopic pair of fluorescence images and one of the visible first and second images; and in the other eye, the other of the visible first and second images.

Augmented stereoscopic visualization for a surgical robot using a captured visible image combined with a fluorescence image and a captured visible image

An endoscope with a stereoscopic optical channel is held and positioned by a robotic surgical system. A first capture unit captures: a visible first color component of a visible left image combined with a fluorescence left image from first light from one channel in the endoscope; a visible second color component of the visible left image from the first light; and a visible third color component of the visible left image from the first light. A second capture unit captures: a visible first color component of a visible right image combined with a fluorescence right image from second light from the other channel in the endoscope; a visible second color component of the visible right image from the second light; and a visible third color component of the visible right image from the second light. An augmented stereoscopic outputs a real-time stereoscopic image including a three-dimensional presentation including the visible left and right images and the fluorescence left and right images.

Augmented stereoscopic visualization for a surgical robot using a camera unit with a modified prism

In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Image capture unit and an imaging pipeline with enhanced color performance in a surgical instrument and method

An illumination channel, a stereoscopic optical channel and another optical channel are held and positioned by a robotic surgical system. A first capture unit captures a stereoscopic visible image from the first light from the stereoscopic optical channel while a second capture unit captures a fluorescence image from the second light from the other optical channel. An intelligent image processing system receives the captured stereoscopic visible image and the captured fluorescence image and generates a stereoscopic pair of fluorescence images. An augmented stereoscopic display system outputs a real-time stereoscopic image comprising a three-dimensional presentation of a blend of the stereoscopic visible image and the stereoscopic pair of fluorescence images.

Augmented stereoscopic visualization for a surgical robot using a captured fluorescence image and captured stereoscopic visible images

A robotic surgical system positions and holds an endoscope. A visible imaging system is coupled to the endoscope. The visible imaging system captures a visible image of tissue. An alternate imaging system is also coupled to the endoscope. The alternate imaging system captures a fluorescence image of at least a portion of the tissue. A stereoscopic video display system is coupled to the visible imaging system and to the alternate imaging system. The stereoscopic video display system outputs a real-time stereoscopic image comprising a three-dimensional presentation of a blend of a fluorescence image associated with the captured fluorescence image, and the visible image.

Augmented stereoscopic visualization for a surgical robot

An endoscope with a stereoscopic optical channel is again held and positioned by a robotic surgical system. A capture unit captures (1) at a first time, a first image from light from the channel; and (2) at a second time different from the first time, a second image from the light. Only one of the first image and the second image includes a combination of a fluorescence image and a visible image. The other of the first image and the second image is a visible image. An intelligent image processing system generates an artificial fluorescence image using the captured fluorescence image. An augmented stereoscopic display system outputs an augmented stereoscopic image of at least a portion of the tissue comprising the artificial fluorescence image.

Augmented stereoscopic visualization for a surgical robot using time duplexing

In one embodiment of the invention, a robotic surgical system includes a master control console having a stereo viewer to view stereo images; a surgical manipulator having a stereo endoscopic camera coupled to a robotic arm to generate the stereo images of a surgical site; a stereo telestration device coupled between the stereo endoscopic camera and the stereo viewer to mix telestration graphics and the stereo images of the surgical site together for viewing by the stereo viewer; and a telestration generator coupled to the stereo telestration device to generate the telestration graphics for overlay on the stereo images of the surgical site.

Stereo telestration for robotic surgery

This invention relates to a stereo imaging system for use in telerobotic systems. A method of imaging a target site in a stereo imaging system is provided. The method typically includes capturing a right and a left optical image of the target site and transforming the right and the left optical images preferably into digital information. The method further includes converting the digital information into opposed images of the target site displayed on a stereo display of the stereo imaging system, one of the opposed images being associated with the right optical image and the other of the opposed images being associated with the left optical image. The method further includes regulating the digital information to cause the positions of the target site displayed on the opposed images to change relative to each other. The invention further provides for a method of aligning the opposed images, to a method of adjusting the stereo working distance of an image capture device, such as an endoscope and to a stereo imaging system.

Stereo imaging system and method for use in telerobotic systems

Growing community of inventors

Menlo Park, CA, United States of America

John D Stern