Tencent America LLC

Keya Medical Technology Co., Ltd.

Shenzhen Keya Medical Technology Corporation

Beijing Keya Medical Technology Co., Ltd.

Beijing Curacloud Technology Co., Ltd.

Hanbo Chen

Youbing Yin

Qi Song

Shanhui Sun

Junjie Bai

Zheng Te

Feng Gao

Hao Chen

Yuwei Li

Yujie Zhou

Embodiments of the present disclosure include a method, device and computer readable medium involving receiving image data to detect tissue lesions, passing the image data through at least one first convoluted neural network, segmenting the image data, fusing the segmented image data, and detecting tissue lesions.

Computer aided diagnosis system for detecting tissue lesion on microscopy images based on multi-resolution feature fusion

Embodiments of the disclosure provide systems and methods for generating a diagnosis report based on a medical image of a patient. The system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system further includes at least one processor. The at least one processor is configured to detect a medical condition based on the medical image and automatically generate text information describing the medical condition. The at least one processor is further configured to construct the diagnosis report, where the diagnosis report includes at least one image view showing the medical condition and a report view including the text information describing the medical condition. The system also includes a display configured to display the diagnosis report.

Interactive clinical diagnosis report system

Embodiments of the disclosure provide systems and methods for generating a report based on a medical image of a patient. An exemplary system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system may further include at least one processor. The at least one processor is configured to automatically determine keywords from a natural language description of the medical image generated by applying a learning network to the medical image. The at least one processor is further configured to generate the report describing the medical image of the patient based on the keywords. The at least one processor is also configured to provide the report for display.

System and method for generating and editing diagnosis reports based on medical images

Embodiments of the disclosure provide systems and methods for segmenting an image. An exemplary system includes a communication interface configured to receive the image acquired by an image acquisition device. The system further includes a memory configured to store a multi-level learning network comprising a plurality of convolution blocks cascaded at multiple levels. The system also includes a processor configured to apply a first convolution block and a second convolution block of the multi-level learning network to the image in series. The first convolution block is applied to the image and the second convolution block is applied to a first output of the first convolution block. The processor is further configured to concatenate the first output of the first convolution block and a second output of the second convolution block to obtain a feature map and obtain a segmented image based on the feature map.

Systems and methods for image segmentation using a scalable and compact convolutional neural network

The present disclosure is directed to a method and system for automatically detecting a physiological condition from a medical image of a patient. The method may include receiving the medical image acquired by an imaging device. The method may further include detecting, by a processor, target objects and obtaining the corresponding target object patches from the received medical image. And the method may further include determining, by the processor, a first parameter using a first learning network for each target object patch. The first parameter represents the physiological condition level of the corresponding target object, and the first learning network is trained by adding one or more auxiliary classification layers. This method can quickly, accurately, and automatically predict target object level and/or image (patient) level physiological condition from a medical image of a patient by means of a learning network, such as 3D learning network.

System and method for automatically detecting a physiological condition from a medical image of a patient

A method of displaying an augmented reality (AR) image includes controlling an AR display to display the AR image as being at least partially overlaid over a view through a microscope while the view is visible to a user of the microscope, wherein the AR image includes a cursor; receiving a user input from a user interface; setting an anchor point based on the user input; updating the AR image to include the anchor point; controlling the AR display to display the updated AR image; detecting a motion of a slide of the microscope; adjusting the AR image by moving at least one from among the cursor and the anchor point within the AR image based on the detected motion; and controlling the AR display to display the adjusted AR image.

Method and apparatus for displaying an augmented-reality image corresponding to a microscope view

A method and apparatus include performing a first image analysis at a first resolution of an input tissue image. An uncertainty map is generated based on performing the first image analysis. A set of uncertain regions of the input tissue image are identified based on the uncertainty map. A second image analysis of the set of uncertain regions is performed at a second resolution of the tissue image that is greater than the first resolution. An analysis result is generated based on the first image analysis and the second image analysis.

Hierarchical processing technique for lesion detection, classification, and segmentation on microscopy images

A method, device, system, and computer-readable medium for displaying an augmented reality (AR) image, including controlling a camera to capture an image of a view through a microscope; generating information corresponding to the image; generating the AR image including an information ring configured to display the information; and controlling an AR display to display the AR image such that the information ring is at least partially overlaid over a periphery of the view through the microscope while the view is visible to a user of the microscope.

Method and apparatus for displaying information ring and augmented reality display for microscope

A computer-implemented method for automatically detecting a target object from a 3D image is disclosed. The method may include receiving the 3D image acquired by an imaging device. The method may further include detecting, by a processor, a plurality of bounding boxes as containing the target object using a 3D learning network. The learning network may be trained to generate a plurality of feature maps of varying scales based on the 3D image. The method may also include determining, by the processor, a set of parameters identifying each detected bounding box using the 3D learning network, and locating, by the processor, the target object based on the set of parameters.

System and method for automatically detecting a target object from a 3D image

Embodiments of the disclosure provide systems and methods for generating a diagnosis report based on a medical image of a patient. The system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system further includes at least one processor. The at least one processor is configured to detect a medical condition of the patient and parameters associated with the medical condition based on the medical image. The at least one processor is further configured to construct the diagnosis report based on the medical image, wherein the diagnosis report includes at least one view of the medical image and a description of the medical condition using the parameters. The system also includes a display configured to display the diagnosis report.

Embodiments of the disclosure provide systems and methods for generating a report based on medical images of a patient. An exemplary system includes a communication interface configured to receive the medical images acquired by an image acquisition device. The system may further include at least one processor. The at least one processor is configured to receive a user selection of at least one medical image in at least one view. The at least one processor is further configured to automatically generate keywords describing the selected medical image based on a learning network including a convolutional neural network and a recursive neural network connected in series. The at least one processor is also configured to receive a keyword selection among the generated keywords and generate the report based on the keyword selection. The exemplary system additionally includes a display configured to display the selected medical image and the report.

Embodiments of the disclosure provide systems and methods for segmenting a medical image. An exemplary system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system further includes a memory configured to store a multi-level learning network including at least a first convolution block and a second convolution block. The second convolution block has at least one convolution layer. The system also includes a processor. The processor is configured to determine a first feature map by applying the first convolution block to the medical image, and determine a second feature map by applying the second convolution block to the first feature map. The processor is further configured to determine a first level feature map by concatenating the first feature map and the second feature map. The processor is also configured to obtain a first level segmented image based on the first level feature map.

The present disclosure is directed to a method and device for managing medical data. The method may include receiving medical image data of a plurality of patient cases acquired by at least one image acquisition device. The method may further include determining diagnosis results, by a processor, of the medical image data using an artificial intelligence method. The method may also include determining, by the processor, priority scores for the medical image data based on the respective diagnosis results, and sorting, by the processor, the medical image data based on the priority score. The method may yet further include presenting a queue of the medical image data on a display according to the sorted order.

Growing community of inventors

Seattle, WA, United States of America

Hanbo Chen