Shanghai United Imaging Intelligence Co., Ltd.

Adobe, Inc.

Srikrishna Karanam

Ziyan Wu

Meng Zheng

Balaji Vasan Srinivasan

Arun Innanje

Abhishek Sharma

Terrence Chen

Shanhui Sun

Zhang Chen

Niyati Himanshu Chhaya

Vishwa Vinay

Sumit Shekhar

Natwar Modani

Aparna Garimella

Yimo Guo

Tripti Shukla

Georgios Georgakis

Ren Li

Changjiang Cai

Praneetha Vaddamanu

Inderjeet Nair

Described herein are systems, methods, and instrumentalities associated with automatically annotating a 3D image dataset. The 3D automatic annotation may be accomplished based on a 2D annotation provided by an annotator and by propagating the 2D annotation through multiple images of a sequence of 2D images associated with the 3D image dataset. The automatically annotated 3D image dataset may then be used to annotate other 3D image datasets based on similarities between the first 3D image dataset and the other 3D image datasets. The automatic annotation of the first 3D image dataset and/or the other 3D image datasets may be conducted based on one or more machine-learning models trained for performing those tasks.

Systems and methods for annotating 3D data

Embodiments are disclosed for a digital design system trained to segment unstructured text into topically coherent segments. The method may include receiving unstructured text, the unstructured text including a sequence of sentences. The disclosed systems and methods further comprise generating, by a neural network, a hierarchically segmented tree structure representing the unstructured text. The tree structure comprises a plurality of tree structure nodes, where a node of the tree structure nodes represents a sentence from the sequence of sentences. The segments and sub-segments of the unstructured text can then be determined based on node data for nodes of the hierarchically segmented tree structure. Using the determined segments and sub-segments of the unstructured text, a modified representation of the unstructured text can be displayed.

Hierarchical segmentation of unstructured text using neural networks

A human model such as a 3D human mesh may be generated for a person in a medical environment based on one or more images of the person. The images may be captured using a sensing device that may be attached to an existing medical device such as a medical scanner in the medical environment. Such an arrangement may ensure that unblocked views of the person (e.g., body keypoints of the person) may be obtained and used to generate the human model. The position of the medical device in the medical environment may be determined and used to facilitate the human model construction such that the pose and body shape of the person in the medical environment may be accurately represented by the human model.

Systems and methods for human model recovery

A medical system may utilize a modular and extensible sensing device to derive a two-dimensional (2D) or three-dimensional (3D) human model for a patient in real-time based on images of the patient captured by a sensor such as a digital camera. The 2D or 3D human model may be visually presented on one or more devices of the medical system and used to facilitate a healthcare service provided to the patient. In examples, the 2D or 3D human model may be used to improve the speed, accuracy and consistency of patient positioning for a medical procedure. In examples, the 2D or 3D human model may be used to enable unified analysis of the patient's medical conditions by linking different scan images of the patient through the 2D or 3D human model. In examples, the 2D or 3D human model may be used to facilitate surgical navigation, patient monitoring, process automation, and/or the like.

Sensing device for medical facilities

Human model recovery may be realized utilizing pre-trained artificially neural networks. A first neural network may be trained to determine body keypoints of a person based on image(s) of a person. A second neural network may be trained to predict pose parameters associated with the person based on the body keypoints. A third neural network may be trained to predict shape parameters associated with the person based on depth image(s) of the person. A 3D human model may then be generated based on the pose and shape parameters respectively predicted by the second and third neural networks. The training of the second neural network may be conducted using synthetically generated body keypoints and the training of the third neural network may be conducted using normal maps. The pose and shape parameters predicted by the second and third neural networks may be further optimized through an iterative optimization process.

Human model recovery using deep learning techniques

An illustrator system determines, for each feature of a set of features, a feature representation for an electronic document displayed via a user interface, based on a plurality of elements of the electronic document. The system receives a selection from among the set of features of (1) a query feature and of (2) a target feature and determines, for each replacement template of a set of replacement templates, a compatibility score based on the feature representation for the electronic document determined for the query feature and a target feature representation of the replacement template determined for the target feature, the representations being determined in a joint representation space. The system selects one or more replacement electronic documents based on the determined compatibility scores. The system displays a preview for each replacement electronic document and displays a particular replacement electronic document responsive to receiving a selection of a preview.

Cross view template recommendation system

The pose and shape of a human body may be recovered based on joint location information associated with the human body. The joint location information may be derived based on an image of the human body or from an output of a human motion capture system. The recovery of the pose and shape of the human body may be performed by a computer-implemented artificial neural network (ANN) trained to perform the recovery task using training datasets that include paired joint location information and human model parameters. The training of the ANN may be conducted in accordance with multiple constraints designed to improve the accuracy of the recovery and by artificially manipulating the training data so that the ANN can learn to recover the pose and shape of the human body even with partially observed joint locations.

Systems and methods for human pose and shape recovery

Systems, methods and instrumentalities are described herein for automating a medical environment. The automation may be realized using one or more sensing devices and at least one processing device. The sensing devices may be configured to capture images of the medical environment and provide the images to the processing device. The processing device may determine characteristics of the medical environment based on the images and automate one or more aspects of the operations in the medical environment. These characteristics may include, e.g., people and/or objects present in the images and respective locations of the people and/or objects in the medical environment. The operations that may be automated may include, e.g., maneuvering and/or positioning a medical device based on the location of a patient, determining and/or adjusting the parameters of a medical device, managing a workflow, providing instructions and/or alerts to a patient or a physician, etc.

Growing community of inventors

Bengaluru, India

Srikrishna Karanam