Verb Surgical Inc.

Eric Mark Johnson

Pablo E Garcia Kilroy

Haoran Yu

Bernard Fai Kin Siu

Joan Savall

Bernhard A Fuerst

Anette Lia Freiin Von Kapri

Jagadish Venkataraman

Taylor Joseph Cone

Dave Scott

Karen Shakespear Koenig

Michal Levin

Andrea Bajo

Robert Thomas Wiggers

Lawrence Edward Miller

Francois W Brahic

Emma Essock-Burns

Pablo Eduardo Garcia Kilroy

Bernard Fai Siu

Risto Kojcev

Alexander Barthel

A virtual reality system providing a virtual robotic surgical environment, and methods for using the virtual reality system, are described herein. Within the virtual reality system, various user modes enable different kinds of interactions between a user and the virtual robotic surgical environment. For example, one variation of a method for facilitating navigation of a virtual robotic surgical environment includes displaying a first-person perspective view of the virtual robotic surgical environment from a first vantage point, displaying a first window view of the virtual robotic surgical environment from a second vantage point and displaying a second window view of the virtual robotic surgical environment from a third vantage point. Additionally, in response to a user input associating the first and second window views, a trajectory between the second and third vantage points can be generated sequentially linking the first and second window views.

Emulation of robotic arms and control thereof in a virtual reality environment

A method of determining a location of a user input device of a surgical robotic system within a surgical workspace using a virtual workspace including determining, by one or more processors communicatively coupled to a user input device, that a user is engaging with the user input device within a surgical workspace; in response to determining the user is engaging with the user input device, displaying a virtual user input device within a first virtual workspace boundary, wherein at least a portion of the first virtual workspace boundary is operable to move in response to a movement of the user input device; displaying a second virtual workspace boundary that represents a second workspace limit beyond which the user input device is inoperable to control the surgical robotic instrument in the teleoperation mode; and determining a location of the user input device within the surgical workspace.

Training and feedback for a controller workspace boundary

Graphical user guidance for a robotic surgical system is provided. In one embodiment, a graphical user interface for a robotic surgical system comprises a first region and a second region. The first region is used to display an endoscopic view of a surgical site inside a patient taken by an endoscopic camera of the robotic surgical system, and the second region is used to display user feedback information. The graphical user interface overlays a guidance message on top of the endoscopic view of the surgical site in the first region to provide user instructions for interacting with a user input device to engage a robotic arm of the robotic surgical system. Other embodiments are provided.

Graphical user guidance for a robotic surgical system

A surgical robotic system is disclosed to include an operating table, a plurality of robotic arms and surgical instruments, a user console, and a control tower. The plurality of robotic arms are mounted on the operating table and can be stowed folded under the table for storage. The user console has one or more user interface devices, which function as master devices to control the plurality of surgical instruments.

Surgical robotic system

A method performed by a surgical robotic system. The method determines a surgical procedure that is to be performed using a robotic arm. The method determines, for the robotic arm, a planned trajectory based on the surgical procedure, where the planned trajectory is from a current pose of the robotic arm to a predefined procedure pose that is within a threshold distance from a trocar that is coupled to a patient. The method drives the robotic arm along the planned trajectory from the current pose to the predefined procedure pose.

Robot-assisted setup for a surgical robotic system

A medical image viewer can render to a display, a three-dimensional view of patient anatomy, a multi planar reconstruction (MPR) view of the patient anatomy, and an intra-operational view. Some of the views can be synchronized to show a common focal point of the anatomy. Other embodiments are described and claimed.

Three dimensional medical imaging and interactions

A method for engaging and disengaging a surgical instrument of a surgical robotic system including receiving a sequence of user inputs from one or more user interface devices of the surgical robotic system; determining, by one or more processors communicatively coupled to the user interface devices and the surgical instrument, whether the sequence of user inputs indicates an intentional engagement or disengagement of a teleoperation mode in which the surgical instrument is controlled by user inputs received from the user interface devices; in response to determining of engagement, transition the surgical robotic system into the teleoperation mode; and in response to determining of disengagement, transition the surgical robotic system out of the teleoperation mode such that the user interface devices are prevented from controlling the surgical instrument.

Methods for actively engaging and disengaging teleoperation of a surgical robotic system

A virtual reality system providing a virtual robotic surgical environment, and methods for using the virtual reality system, are described herein. The virtual reality system may be used to expedite the R&D cycle during development of a robotic surgical system, such as by allowing simulation of potential design without the time and significant expense of physical prototypes. The virtual reality system may also be used to test a control algorithm or a control mode for a robotic surgical component.

A virtual operating room (OR) is generated that includes virtual surgical equipment based on existing OR models and existing equipment models. Sensor feedback is received that defines a physical OR having physical equipment, the physical equipment including a surgical robotic system within the physical OR. The virtual OR and the virtual surgical equipment is updated based on the sensor feedback. A layout of the virtual surgical equipment is optimized in the virtual OR. The virtual OR and the virtual surgical equipment are rendered on a display.

Virtual reality system with customizable operation room

Embodiments described herein provide various examples of monitoring adverse events in the background while displaying a higher-resolution surgical video on a lower-resolution display device. In one aspect, a process for detecting adverse events during a surgical procedure can begin by receiving a surgical video. The process then displays a first portion of the video images of the surgical video on a screen to assist a surgeon performing the surgical procedure. While displaying the first portion of the video images, the process uses a set of deep-learning models to monitor a second portion of the video images not being displayed on the screen, wherein each deep-learning model is constructed to detect a given adverse event among a set of adverse events. In response to detecting an adverse event in the second portion of the video images, the process notifies the surgeon of the detected adverse event to prompt an appropriate action.

Monitoring adverse events in the background while displaying a higher resolution surgical video on a lower resolution display

A method for a robotic surgical system includes displaying a graphical user interface on a display to a user, wherein the graphical user interface includes a plurality of reconfigurable display panels, receiving a user input at one or more user input devices, wherein the user input indicates a selection of at least one software application relating to the robotic surgical system, and rendering content from the at least one selected software application among the plurality of reconfigurable display panels.

Multi-panel graphical user interface for a robotic surgical system

Mobile virtual reality system for simulation, training or demonstration of a surgical robotic system can include a virtual reality processor. The processor can generate a virtual surgical robot and render the virtual surgical robot on a display. The virtual surgical robot can include a virtual surgical tool. A handheld user input device (UID) can sense a hand input from a hand. A foot input device can sense a foot input from a foot. The virtual reality processor can be configured to control a movement or action of the virtual surgical robot based on the hand input, and change which of the virtual surgical instruments is controlled by the one or more handheld UIDs based on the foot input. Other embodiments and aspects are disclosed and claimed.

Growing community of inventors

Pacific Grove, CA, United States of America

Eric Mark Johnson