Edda Technology, Inc.

Xiaonan Zang

Jianzhong Qian

Guo-Qing Wei

Li Fan

Xiaolan Zeng

Cheng-Chung Liang

Jiahong Dong

The present teaching relates to method, system, medium, and implementations for fusing a 3D virtual model with a 2D image associated with an organ of a patient. A key-pose is determined as an approximate position and orientation of a medical instrument with respect to the patient's organ. Based on the key-pose, an overlay is generated on a 2D image of the patient's organ, acquired by the medical instrument, by projecting the 3D virtual model on to the 2D image. A pair of feature points includes a 2D feature point from the 2D image and a corresponding 3D feature point from the 3D virtual model. The 3D coordinate of the 3D feature point is determined based on the 2D coordinate of the 2D feature point. The depth of the 3D coordinate is on a line of sight of the 2D feature point and is determined so that the projection of the 3D virtual model from the depth creates an overlay approximately matching the organ observed in the 2D image.

Method and system of model fusion for laparoscopic surgical guidance

The present teaching relates to method, system, medium, and implementations for estimating 3D coordinate of a 3D virtual model. Two pairs of feature points are obtained. Each of the pairs includes a respective 2D feature point on an organ observed in a 2D image, acquired during a medical procedure, and a respective corresponding 3D feature point from a 3D virtual model, constructed for the organ prior to the procedure based on a plurality of images of the organ. The depths of the first and the second 3D feature points are substantially the same. A first 3D coordinate of the first 3D feature point and a second 3D coordinate of the second 3D feature point are automatically determined based on the pairs of feature points so that a first distance between the determined first 3D coordinate and the determined second 3D coordinate equals to a second distance between a first actual 3D coordinate of the first 3D feature point and a second actual 3D coordinate of the second 3D feature point in the 3D virtual model.

Method and system of depth determination with closed form solution in model fusion for laparoscopic surgical guidance

The present teaching relates to method and system for aligning a virtual anatomic model. The method generates a virtual model of an organ of a patient, wherein the virtual model includes at least three virtual markers. A number of virtual spheres equal to a the number of virtual markers are generated, wherein the virtual spheres are disposed on the virtual model of the organ of the patient and associated with the virtual markers. A first position of the virtual spheres and the virtual markers is recorded. The virtual spheres are placed to coincide with physical markers disposed on the patient and a second position of the virtual spheres is recorded. A transformation of the virtual spheres and the virtual markers based on the first and second positions is computed and the virtual model of the organ is aligned with the patient based on the computed transformation.

Growing community of inventors

Princeton, NJ, United States of America

Xiaonan Zang