Sony Corporation

Sony Group Corporation

Sony Corporation of America

Bi Song

Ming-Chang Liu

Ko-Kai Albert Huang

Chen-Rui Chou

Liangyin Yu

A method for automatically estimating cellularity in a digital pathology slide image includes: extracting patches of interest from the digital pathology slide image; operating on each patch using a trained first deep convolutional neural network (DCNN) to classify that patch as either normal, having an estimated cellularity of 0%, or suspect, having a cellularity roughly estimated to be greater than 0%; operating on each suspect patch using a second DCNN, trained using a deep ordinal regression model, to determine an estimated cellularity score for that suspect patch; and combining the estimated cellularity scores of the patches of interest to provide an estimated cellularity for the digital pathology slide image at a patch-by-patch level.

Automatic estimation of tumor cellularity using a DPI AI platform

A method of tumor detection and segmentation accepts a first Whole Slide Image (WSI) having a first resolution; creates a corresponding second WSI having a second resolution lower than the first resolution; applies an adaptive thresholding technique to the second WSI to create a background removal mask background; applies the mask to the first WSI to provide a third WSI with extracted patches, characterized by a third resolution, greater than the second resolution and lower than the first resolution; uses a first machine learning system on the third WSI to create a heat map at the third resolution, indicating a subset of the patches likely to include one or more clusters of tumor cells; and uses a second machine learning system on the first WSI and the heat map to segment each patch in a corresponding output image at the first resolution, outlining one or more corresponding clusters.

Tumor detection and segmentation for DPI AI platform routes

System for performing fully automatic brain tumor and tumor-aware cortex reconstructions upon receiving multi-modal MRI data (T1, T1c, T2, T2-Flair). The system outputs imaging which delineates distinctions between tumors (including tumor edema, and tumor active core), from white matter and gray matter surfaces. In cases where existing MRI model data is insufficient then the model is trained on-the-fly for tumor segmentation and classification. A tumor-aware cortex segmentation that is adaptive to the presence of the tumor is performed using labels, from which the system reconstructs and visualizes both tumor and cortical surfaces for diagnostic and surgical guidance. The technology has been validated using a publicly-available challenge dataset.

System of joint brain tumor and cortex reconstruction

A method for automatic organ segmentation in CT images comprises in a first step, rough region segmentation; in a second step, coarse organ segmentation; and in a third step, refinement of organ segmentation. The organ may be a liver. Rough region segmentation may comprise applying standard anatomical knowledge to the CT images. Coarse segmentation may comprise identifying organ voxels using a probabilistic model. Refinement of organ segmentation may comprise refinement based on intensity, followed by refinement based on shape. Apparatuses configured to carry out the method are also disclosed.

Automatic liver segmentation in CT

An assistive apparatus for organ localization, includes storing a 3D representation and CT images of an anatomical portion of the body of a subject. A localization circuitry determines a rib region and a spine region in the CT images and calculates first and second number of voxels within a first and second region of the 3D representation, respectively. The localization circuitry determines the right side of the body in the CT images, based on a comparison result for the first and second number of voxels. The localization circuitry detects a first bottom portion of right lung based on a distribution of intensity values of pixels in a region of right lung. The localization circuitry detects a second bottom portion of the rib region and localizes the liver organ in the CT images, from a reference of the detected first bottom portion and the detected second bottom portion.

Internal organ localization in computed tomography (CT) images

Various aspects of a system and a method to provide assistance in a surgery in presence of tissue deformation are disclosed herein. In accordance with an embodiment, the system includes an electronic device that receives one or more tissue material properties of a plurality of surface structures of an anatomical portion. One or more boundary conditions associated with the anatomical portion may also be received. Surface displacement of the anatomical portion may be determined by matching a first surface of the anatomical portion before deformation with a corresponding second surface of the anatomical portion after the deformation. The volume displacement field of the anatomical portion may be computed based on the determined surface displacement, the received one or more tissue material properties, and the received one or more boundary conditions.

System and method for providing assistance in surgery in presence of tissue deformation

A fully automatic brain tumor segmentation and classification method and system improve the healthcare experience with machine intelligence. The automatic brain tumor segmentation and classification method and system utilize whole tumor segmentation and multi-class tumor segmentation to provide accurate analysis.

Automatic 3D brain tumor segmentation and classification

Various aspects of a method and a system for segmentation of vascular structure in a volumetric image dataset are disclosed herein. The method comprises initial segmentation of an input volumetric image dataset to obtain a main vessel structure and a plurality of broken segments. A weighted path is computed between the main vessel structure and a broken segment of the plurality of broken segments. The computation of the weighted path is based on at least one or more parameters associated with a first voxel of the broken segment and a second voxel of the main vessel structure. A valid, weighted path is determined between the main vessel structure and a broken segment of the plurality of broken segments, based on the computed weighted path and one or more pre-specified conditions. Based on the determined valid, weighted path, an output volumetric image dataset is generated by performance of a final segmentation on a gradient field.

Method and system for segmentation of vascular structure in a volumetric image dataset

An apparatus and method for performing automatic 3D image segmentation and reconstruction of organ structures, which is particularly well-suited for use on cortical surfaces is presented. A brain extraction process removes non-brain image elements, then classifies brain tissue as to type in preparation for a cerebrum segmentation process that determines which portions of the image information belong to specific physiological structures. Ventricle filling is performed on the image data based on information from a ventricle extraction process. A reconstruction process follows in which specific surfaces, such as white matter (WM) and grey matter (GM), are reconstructed.

System for processing magnetic resonance images using automatic segmenting

Automatic 3D segmentation and cortical surfaces reconstruction from T1 MRI

An image processing system and method of operation includes: a source image having source pixels; a homogeneity image module for forming a homogeneity image having homogeneity pixels each with a homogeneity value indicating the local homogeneity of source pixels of the source image; a watershed image module, coupled to the homogeneity image module, for forming a watershed image having watershed segments with a segment weight, the watershed image formed by segmenting the homogeneity image, and for merging one of the watershed segments with another of the watershed segments both having the segment weight less than or equal to a segment threshold; a contour map module, coupled to the watershed image module, for forming a segmentation contour map having boundaries of the watershed segments formed by merging the watershed segments; and a composite image module for forming a composite image with the segmentation contour map for display on a device.

Growing community of inventors

San Jose, CA, United States of America

Bi Song