Nant Holdingsip, LLC

Nantomics, LLC

Nanthealth, Inc.

Nantcell, Inc.

Nantmedia Holdings, LLC

Bing Song

Jeremi M Sudol

David McKinnon

Matheen M Siddiqui

Kamil A Wnuk

Mustafa Jaber

Nicholas James Witchey

John Wiacek

Liudmila A Beziaeva

Patrick Soon-Shiong

Liwen Lin

Shahrooz Rabizadeh

Christopher W Szeto

Orang Dialameh

Phillip Yang

Hao Lu

Jeffrey Michael Balbien

Gregory Chu

Stephen Charles Benz

Krsto Sbutega

Albert Wu

A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.

Feature density object classification, systems and methods

Methods, systems, and articles of manufacture to improve image recognition searching are disclosed. In some embodiments, a first document image of a known object is used to generate one or more other document images of the same object by applying one or more techniques for synthetically generating images. The synthetically generated images correspond to different variations in conditions under which a potential query image might be captured. Extracted features from an initial image of a known object and features extracted from the one or more synthetically generated images are stored, along with their locations, as part of a common model of the known object. In other embodiments, image recognition search effectiveness is improved by transforming the location of features of multiple images of a same known object into a common coordinate system. This can enhance the accuracy of certain aspects of existing image search/recognition techniques including, for example, geometric verification.

Image feature combination for image-based object recognition

Techniques are provided for determining a cell count within a whole slide pathology image. The image is segmented using a global threshold value to define a tissue area. A plurality of patches comprising the tissue area are selected. Stain intensity vectors are determined within the plurality of patches to generate a stain intensity image. The stain intensity image is iteratively segmented to generate a cell mask using a local threshold value that is and gradually reduced after each iteration. A chamfer distance transform is applied to the cell mask to generate a distance map. Cell seeds are determined on the distance map. Cell segments are determined using a watershed transformation, and a whole cell count is calculated for the plurality of patches based on the cell segments. A client device may be configured for real-time cell counting based on the whole cell count.

Real-time whole slide pathology image cell counting

Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.

Wide area augmented reality location-based services

A method of automated database element processing includes training a wide machine learning model with historical feature vector inputs to generate a wide ranked element output. The method includes training a deep machine learning model with the historical feature vector inputs to generate a deep ranked element output. The method includes generating a set of inputs specific to an individual entity, obtaining a set of current article database elements, and creating a feature vector input according to the set of inputs and the set of current article database elements. The method includes processing the feature vector input with the wide machine learning model to generate a wide ranked element list, processing the feature vector input with the deep machine learning model to generate a deep ranked element list, and merging database elements of the wide and deep ranked element lists to generate a ranked element recommendation output.

Combined wide and deep machine learning models for automated database element processing systems, methods and apparatuses

A method of determining a region of interest in an image of tissue of an individual by an apparatus including processing circuitry may include executing, by the processing circuitry, instructions that cause the apparatus to partition an image of tissue of an individual into a set of areas, identify a tissue type of each area of the image, and apply a classifier to the image to determine a region of interest, the classifier being configured to determine regions of interest based on the tissue types of the set of areas of the image.

Deep learning models for region of interest determination

Multiparty object recognition systems and methods are disclosed. A method of interactively manipulating virtual object data, wherein an object database is configured to store first party object data that corresponds to a first real-world object and is further configured to store second party object data that corresponds to a second real-world object, includes obtaining the first party object data and the second party object data for storage within the object database. Access to the object database is controlled such that the first party object data and the second party object data is accessible to the first party and the second party. Modification of the first party object data by the second party is facilitated to generate modified first party object data that is in accordance with at least one context parameter of the second party object data, and the modified first party object data is communicated to the first party.

Multiparty object recognition

Techniques are provided for determining classifications based on WSIs. A varied-size feature map is generated for each training WSI by generating a grid of patches for the training WSI, segmenting the training WSI into tissue and non-tissue areas, and converting patches comprising the tissue areas into tensors. Bounding boxes are generated based on the patches comprising tissue areas and segmented into feature map patches. A fixed-size feature map is generated based on a subset of the feature map patches. A classifier model is trained to process fixed-size feature maps corresponding to the training WSIs such that, for each fixed-size feature map, the classifier model is operable to assign a WSI-level tissue or cell morphology classification or regression based on the tensors. A classification engine is configured to use the trained classifier model to determine a WSI-level tissue or cell morphology classification or regression for a test WSI.

Weakly supervised learning with whole slide images

A method at a computing device for classifying elements within an input, the method including breaking the input into a plurality of patches; for each patch: creating a vector output; applying a characterization map to select a classification bin from a plurality of classification bins; and utilizing the selected classification bin to classify the vector output to create a classified output; and compiling the classified output from each patch.

Classification based on characterization analysis methods and systems

An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.

Object ingestion and recognition systems and methods

A computer implemented method of generating at least one shape of a region of interest in a digital image is provided. The method includes obtaining, by an image processing engine, access to a digital tissue image of a biological sample; tiling, by the image processing engine, the digital tissue image into a collection of image patches; identifying, by the image processing engine, a set of target tissue patches from the collection of image patches as a function of pixel content within the collection of image patches; assigning, by the image processing engine, each target tissue patch of the set of target tissue patches an initial class probability score indicating a probability that the target tissue patch falls within a class of interest, the initial class probability score generated by a trained classifier executed on each target tissue patch; generating, by the image processing engine, a first set of tissue region seed patches by identifying target tissue patches having initial class probability scores that satisfy a first seed region criteria, the first set of tissue region seed patches comprising a subset of the set of target tissue patches; generating, by the image processing engine, a second set of tissue region seed patches by identifying target tissue patches having initial class probability scores that satisfy a second seed region criteria, the second set of tissue region seed patches comprising a subset of the set of target tissue patches; calculating, by the image processing engine, a region of interest score for each patch in the second set of tissue region seed patches as a function of initial class probability scores of neighboring patches of the second set of tissue region seed patches and a distance to patches within the first set of issue region seed patches; and generating, by the image processing engine, one or more region of interest shapes by grouping neighboring patches based on their region of interest scores.

Growing community of inventors

La Canada, CA, United States of America

Bing Song