Canon U.s.a., Inc.

The General Hospital Corporation

Mie Kunio

Daisuke Yamada

Badr Elmaanaoui

Guillermo J Tearney

Markus Daniel Herrmann

Yohei Minatoya

One or more devices, systems, methods, and storage mediums using artificial intelligence application(s) using an apparatus or system that uses and/or controls one or more imaging modalities, such as, but not limited to, angiography, Optical Coherence Tomography (OCT), Multi-modality OCT, near-infrared fluorescence (NIRAF), OCT-NIRAF, etc. are provided herein. Examples of AI applications discussed herein, include, but are not limited to, using one or more of: AI coregistration, AI marker detection, deep or machine learning, computer vision or image recognition task(s), keypoint detection, feature extraction, model training, input data preparation techniques, input mapping to the model, post-processing, and/or interpretation of output data, one or more types of machine learning models (including, but not limited to, segmentation, regression, combining or repeating regression and/or segmentation), marker detection success rates, and/or co-registration success rates to improve or optimize marker detection and/or co-registration.

Artificial intelligence coregistration and marker detection, including machine learning and using results thereof

One or more devices, systems, methods and storage mediums for optical imaging medical devices, and methods and storage mediums for use with same, for viewing, controlling, updating, and emphasizing one or more imaging modalities and/or for constructing or reconstructing 2D and/or 3D structure(s) are provided herein. One or more embodiments provide at least one intuitive Graphical User Interface (GUI), method, device, apparatus, system, or storage medium to comprehend information, including, but not limited to, molecular structure of a vessel, and to provide an ability to manipulate the vessel information and/or to construct or reconstruct 2D and/or 3D structure(s) of the vessel to improve or maximize accuracy in one or more images. In addition to controlling one or more imaging modalities, the GUI may operate for one or more applications, including, but not limited to, expansion/underexpansion (e.g., for a stent) and/or apposition/malapposition (e.g., for a stent), co-registration, and imaging.

Constructing or reconstructing 3D structure(s)

One or more devices, systems, methods and storage mediums for optical imaging medical devices, such as, but not limited to, intravascular ultrasound (IVUS), Optical Coherence Tomography (OCT) and/or multi-modal OCT apparatuses and systems, and methods and storage mediums for use with same, for performing coregistration and/or selecting a co-registration algorithm are provided herein. One or more embodiments may involve using an image frame, such as, but not limited to, an angiography image frame, to display an imaging catheter path and calculate a reliability of co-registration between multiple imaging modalities. In one or more embodiments, coregistration feature(s) may be available in any image acquisition option(s), such as, but not limited to, any angiography image acquisition option(s), and coregistration may be performed even in a case where a user finishes an imaging pullback, such as, but not limited to, an intravascular imaging pullback.

Apparatuses, systems, methods and storage mediums for performance of co-registration

A method for processing an intravascular image including a plurality of image frames acquired during a pullback of an imaging catheter inserted into a vessel, the method including displaying on a graphical user interface (GUI) an image including detected results of lumen borders and at least one stent, the image including an evaluated stent expansion and an evaluated stent apposition determined from the intravascular image. The method also includes determining whether a modification to the detected results of the stent has been received by the GUI. Then, re-evaluating stent length, stent expansion and stent apposition when it is determined that the detected results of the stent has been modified via the GUI and displaying the re-evaluated stent expansion and the re-evaluated stent apposition on the GUI.

Detecting and displaying stent expansion

A method for processing an intravascular image including a plurality of image frames acquired during a pullback of an imaging catheter inserted into a vessel. The method includes obtaining positions of lumen borders detected in the intravascular image and positions of stent-struts detected in the intravascular image. Determining, at different positions in a range, a stent expansion value of the stent implanted in the vessel, based on the first information and the second information, wherein each image frame from image frames in which stent-struts are detected corresponds to a different position along the range. The method may also include displaying an image including positions of lumen borders and positions of the stent-struts detected and a first indicator indicating a level along the range, of the stent expansion value, with the image.

A method for processing angiography image data by using an imaging catheter path that is directly detected from the angiography data as a co-registration path or using detected marker locations from the angiography data to generate a co-registration path. If the acquired angiography data includes synchronized cardiac phase signals and a predetermined quantity of angiography image frames not including contrast media, then a directly detected imaging catheter path is used as the co-registration path. Otherwise the co-registration path is determined based upon detected marker locations from the angiography image data.

Method for co-registering and displaying multiple imaging modalities

Detecting a vessel region in multiple angiographic image frames and defining a direction that perpendicularly intersects a longitudinal direction of the vessel region to improve co-registration between two imaging modalities. Motion of the vessel region is then detected based on the direction that intersects the longitudinal direction of the vessel region by evaluating positions of the vessel region in the multiple angiographic image frames. The method includes defining an area based on the detected motion and the detected vessel region, detecting a marker of an imaging catheter disposed in the vessel region within the area and performing co-registration based on the detected marker.

Method for evaluating cardiac motion using an angiography image

A method for displaying an anatomical image of a coronary artery on a graphical user interface with information acquired from a plurality of intravascular image frames. The method may include detecting qualitative information from the plurality of intravascular image frames, creating one or more indicator(s) from the qualitative information detected, and determining a spatial relationship between the anatomical image and a plurality of acquisition locations of the plurality of intravascular image frames and generating its linear representation. The method also includes displaying the anatomical image of the coronary artery with the linear representation overlaid thereon on a display device and overlaying the one or more indicator(s) representing at least one type of qualitative information on the anatomical image along the linear representation.

Growing community of inventors

Boston, MA, United States of America

Mie Kunio