Cilag International Gmbh

Leonardo N Rossoni

Cory G Kimball

Frederick E Shelton, IV

Matthew D Cowperthwait

Risto Kojcev

Felix J Bork

Monica L Z Rivard

Shane R Adams

Brendan J Oberkircher

Kevin Michael Fiebig

Jacob S Childs

Jason L Harris

Matthew C Miller

Christopher Q Seow

Jacqueline C Aronhalt

Matjaz Jogan

Taylor W Aronhalt

Eitan T Wiener

Ryan M Asher

Zhifan F Huang

Nicholas J Ross

Kristen G Denzinger

Chad E Eckert

John E Brady

Stephen M Leuck

Tylor C Muhlenkamp

Joshua P Morgan

Austin E Wise

Demetrius N Harris

Scott A Jenkins

Ellen E Burkart

James M Vachon

Tyler N Brehm

Ryan W McGhee

Madison K Vanosdoll

Grace E Brooks

Molly M F Petre

Lucas B Elmer

Shaun B Schaeffer

Monica Lz Rivard

Matthew J Thiel

Melissa Schweizer

Amanda R Stautberg

Megan A Broderick

Monica LZ Rivard

A method of assessing inter-device communication pairing in a surgical setting, may include transmitting, by a first intelligent medical device, wireless communication data within the surgical setting, receiving, by a second intelligent medical device, the wireless communication data from the first intelligent medical device, determining, by the second intelligent medical device, communication pairing data indicative of an inter-device communication pairing of the second intelligent medical device with the first intelligent medical device, transmitting, by the second intelligent medical device, the communication pairing data to a modular control tower, and displaying, by the modular control tower on a display device, an augmented reality display comprising one or more virtual objects indicative of the inter-device communication pairing. An interactive surgical system may include multiple intelligent medical devices and displays which can form communication pairs in this manner.

Indication of the couple pair of remote controls with remote devices functions

A system, method, and device for displaying relevant augmented reality (AR) content to a surgical staff members without over-saturating the augmented display with virtual elements. The surgical staff members (e.g., doctors, nurses, surgeons, technicians, etc.) require AR content that is delicately balanced between displaying helpful information without distracting the surgeon. A surgical hub receives a plurality of inputs related to surgical environment and displays only necessary information to allow the surgeon to provide effective care to the patient, based on a determined trigger event.

Utilizing contextual parameters of one or more surgical devices to predict a frequency interval for displaying surgical information

A surgical system is for use in a surgical procedure. The surgical system includes a surgical instrument configured to treat tissue in the surgical procedure; an imaging device; a display configured to show a livestream of a surgical field of the surgical procedure, wherein the livestream is captured by the imaging device; and a control module. The control module is configured to detect a surgical risk; assign a display priority to the surgical risk; and determine a display arrangement of the surgical risk based on the display priority, wherein the display arrangement comprises overlaying an alert feature on the livestream.

Risk based prioritization of display aspects in surgical field view

A surgical system is disclosed including an imaging device, a display, and a control system operably coupled to the imaging device and the display. The display is configured to show a livestream of a surgical field of a surgical procedure. The livestream is captured by the imaging device. The control system is configured to overlay, on the livestream, a first amount of information associated with the surgical procedure, detect an event configured to cause the first amount of information being overlaid to increase to a second amount of information being overlaid, compare the second amount of information to a distraction threshold, adjust the second amount of information to a third amount of information based on the comparison, and overlay, on the livestream, the third amount of information based on the second amount of information being adjusted. The third amount of information is less than the distraction threshold.

Systems and methods for controlling surgical data overlay

A method of distributing data among members of a surgical team may include receiving imaging data, by a modular control tower, from a plurality of imaging devices, receiving device-dependent data, by the modular control tower, from each of a plurality of intelligent surgical instruments, associating, by the modular control tower, a display device with a member of the surgical team, defining, by the modular control tower, a functional role for the member of the surgical team, and displaying, by the modular control tower, a augmented reality display by the display device. The augmented reality display on the display device may include virtual objects based on the imaging data, the device-dependent data, the functional role of the member of the surgical team, and a surgical activity by the member of the surgical team. An interactive surgical system may implement this method.

Customization of overlaid data and configuration

Systems, methods and devices for surgical procedurelization via a modular energy system are disclosed herein. In various aspects, the systems, methods and devices include an energy module, a header module communicably coupled to the energy module, and a display screen capable of rendering a graphical user interface (GUI). The GUI may be configured to display a plurality of steps that correspond with actions performed by a user while operating the modular energy system. In some aspects, the steps displayed are steps of a predetermined procedural checklist corresponding with a mental model followed by the user while performing a surgical procedure. In some aspects, the steps displayed are steps of an output verification process.

Surgical proceduralization via modular energy system

An augmented reality display system and method for use during a surgical procedure are disclosed. An imaging device captures a real image of a surgical area during the surgical procedure generates a first data feed. A sensor device generates a second data feed. An augmented reality device including an augmented reality display generates an augmented overlay based on the first and second data feeds. The augmented overlay includes a visual portion and a non-visual visual portion. A processor receives the first and second data feeds and combines the first and second data feeds to generate the augmented overlay.

Mixed reality feedback systems that cooperate to increase efficient perception of complex data feeds

Apparatuses, systems, and methods for displaying a cooperative overlays based on interacting instruments are disclosed herein. In one aspect, a method for displaying cooperative overlays includes communicatively coupling a first augmented reality display device to a surgical hub; generating, by the first augmented reality display device, a first intraoperative display of a surgical field; displaying, by the first intraoperative display, a first data overlay based on operation of a first surgical instrument; interacting the first surgical instrument with a second surgical instrument; and displaying, by the first intraoperative display, an indicator of the interaction based on the interaction between the first and second surgical instruments.

Cooperative overlays of interacting instruments which result in both overlays being effected

Energy module with alert screen with graphical user interface

Display panel or portion thereof with graphical user interface for energy module

Growing community of inventors

Rahway, NJ, United States of America

Leonardo N Rossoni