Elbit Systems Ltd.

Beyeonics Surgical Ltd.

Rani Ben-Yishai

Shahaf Zommer

Ron Schneider

Lior Barak

Ilan Efrat

Adi Charny

Dror Yahav

Eran Segev

Yaara Solomon

Gil Benesh

Abraham Zeitouny

Einav Namer Yelin

Yaniv Roimi

Avi Reuven

Ron Kornblit

Eitan Yehiel Edrei

Ron Kornbilt

A user interface for enabling and controlling functions of a surgical system, comprising: a foot-operated function switch configured to be switched to any one of multiple discrete states by the user's foot; a head tracker configured to track the user's head motions; and a processor coupled to the function switch and head tracker, and configured to: obtain an association between a plurality of sequences comprising at least one of the multiple discrete states, and a plurality of corresponding system functions of the surgical system, receive an indication of at least one of the discrete states from the function switch, identify a system function based on the indication and the association, receive a head motion from the head tracker, and apply the head motion to control the identified system function of the surgical system.

User interface for controlling a surgical system

A method for irradiating an image in an optical see-through (OST) head mounted display (HMD) for viewing through, the OST HMD by a user's eye, an object having at least one of known orientation and position and orientation (O/P&O), associated with a first reference frame, the method comprising: generating and irradiating said image for appearing to said user superimposed in an aligned manner to said object, according to predetermined information, eyeball feature position data, and said O/P&O; said predetermined information relates correction data with a plurality of different respective position data values of at least one eyeball feature position of said eye; said predetermined information further includes display corrections of said electro-optical display module with respect to said position data values of said at least one eyeball feature position, with respect to a second reference frame; and said O/P&O is between said second reference and said first reference frame.

Optical see through (OST) head mounted display (HMD) system and method for precise alignment of virtual objects with outwardly viewed objects

Systems and methods for imaging a body part during a medical procedure e.g., by imaging the body part using at least one image capture unit, where the image capture unit is configured to sense light at least in the IR spectrum; illuminating at least a portion of the body part with light in the infrared (IR) spectrum, using at least one IR light source such that IR illumination of at least one of the at least one IR light source is coaxial with an optical axis of one of the at least one image capture unit; and outputting imagery data emanating from the at least one image capture unit for displaying thereof.

Systems and methods for imaging a body part during a medical procedure

A UI for a HMD system includes a HMD configured to be worn by a surgeon. A tracker is configured to track head gestures by the surgeon. A footswitch is configured to detect foot motion inputs by the surgeon. A computer couples to the HMD, the tracker, and the footswitch. A user interface includes the HMD, tracker, and footswitch. The use interface is configured to: provide to the computer the head gesture in association with the foot motion input, and display an image relating to a surgical procedure on the HMD. The computer is configured to: apply the head gesture received in association with the foot motion input to perform a first action on the HMD system when the HMD system is in a first system mode, and perform a second action on the HMD system when the HMD system is in a second system mode.

UI for head mounted display system

Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

System and method for improved electronic assisted medical procedures

A system for registering a coordinate system associated with a model of an object with a reference-coordinate-system, the object includes at least one marker, the system includes a portable-unit, a tracking-system and a processor. The portable unit includes and display and an optical-detection-assembly for acquiring at least one representation of the marker. The tracking-system tracks the position-and-orientation of the portable-unit in the reference-coordinate-system. The processor is configured to determine position-related-information respective of the marker in the reference-coordinate-system, to register the model with the reference-coordinate-system at least based on the position-related-information respective of the marker, and on a location of the marker in a coordinate system associated with the model, and to display registration-related-information on the display, at least one of the registration-related-information and the display location of the registration-related-information is related to the position-and-orientation of the portable-unit in the reference-coordinate-system.

Model registration system and method

Head wearable display (HWD) systems and methods of display reliability verification with respect to the HWD operated by a user are provided, which comprise tracking a position and orientation (P&O) of the HWD relative to hardware element(s) at known position(s), which are selected from a surroundings of the user and are visible to the user through the HWD, calculating position(s) of the hardware element(s) with respect to the HWD, and displaying, in the HWD and according to the calculated position(s), verification symbol(s) that correspond to the hardware element(s). Display reliability verification may be carried out automatically using a camera and an image processing module, optionally with an additional illuminator, which compares the element(s)'s captured locations with the element (s)'s expected location according to the tracking, and indicates possible discrepancies. Discrepancy identification may be used to initiate a correction process or to indicate the presented symbology to be unreliable.

Head wearable display reliability verification

Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.

System for determining a position of a tool-point-of-interest of a tool, relative to an eye-tissue-of-interest, which includes and imager a tool-tracker and a processor. The imager acquires an image of a tissue-reference-marker. The tool-tracker determines information relating to the P&O of the tool in a reference-coordinate-system. The imager and the tool-tracker are in registration with the reference-coordinate-system. The processor determines the position of the tissue-reference-marker in the reference-coordinate-system, according to the acquired image of the tissue-reference-marker. The processor determines the P&O of the eye-tissue-of-interest in the reference-coordinate-system according to at least the position of the tissue-reference-marker and a relative position between the tissue-reference-marker and the eye-tissue-of-interest. The relative position is pre-determined from a stored-3D-model. The processor determines the position of a tool-point-of-interest in the reference-coordinate-system from the P&O of the tool in the reference-coordinate-system. The processor also determines a relative position between the tool-point-of-interest and the eye-tissue-of-interest.

System and method for determining the position and orientation of a tool tip relative to eye tissue of interest

Method for verifying registration of a model of an internal-body-part with the internal-body-part in a reference coordinate system. The internal-body-part is at least partially unseen directly by a user. The method includes the procedures of continuously determining a position and orientation of a head-mounted-display in the reference coordinate system, determining a display location of at least one virtual marker, and displaying the virtual marker according to the display location. The display location of the virtual marker is determined according to the expected position of a respective at least one reference point relative to the head-mounted-display. The reference point is directly visible to the user. The relative position between the reference point and the internal-body-part is substantially constant. The position of the reference point in the reference coordinate system is predetermined. When the model and the internal-body-part are effectively registered, the reference point and corresponding virtual marker appears visually in alignment.

Method and system for registration verification

System for registering a coordinate system associated with a pre-acquired model of an object with a reference coordinate system. The system includes a portable unit which includes a display, a tracking system for tracking the portable unit and a processor. The processor is coupled with the portable unit and with the tracking system. The processor determines the position and orientation of the portable unit. The processor further determines the position of at least one marker located on the object according to at least one of, a tracked pointer and respective position related information. The processor further displays registration related information on the display. At least one of the registration related information and the display location of the registration related information are related to the position and orientation of the portable unit. The position of the at least one marker, in the coordinate system associated with the pre-acquired model, is predetermined.

Growing community of inventors

Haifa, Israel

Rani Ben-Yishai