Sync-Rx Ltd.

Meta Platforms, Inc.

Technion Research & Development Foundation Ltd

Zohar Barzelay

Ran Cohen

Eldad Klaiman

David Tolkowsky

Alexander Steinberg

Sagiv Philipp

Yoav Schechner

Yoav Stein

Jacob Blank

Maxim Bluvshtein

A method for resolving body-garment collisions in avatars for immersive reality applications is provided. The method includes forming a two-dimensional projection of a dressed avatar in an immersive reality application running in a headset, identifying, from the two-dimensional projection, an area that includes a garment collision, and replacing a pixel in the area that includes the garment collision, with a pixel indicative of a garment for the dressed avatar, to form a new two-dimensional projection of the dressed avatar. A system and a non-transitory, computer-readable medium storing instructions to perform the above method, are also provided.

Solution of body-garment collisions in avatars for immersive reality applications

Apparatus and methods are described including a processor () configured to receive first and second sets of extraluminal images of a lumen, the second set being acquired while an endoluminal device is being moved through the lumen. The processor designates at least one of the first set of images as a roadmap image, and designates, within the lumen in the roadmap image, a roadmap pathway (). A plurality of features () that are visible within at least some of the second set of extraluminal images are identified, and an arrangement of three or more of the features within the image are compared to a shape of at least a portion of the roadmap pathway. Based upon the comparing, the identified features are mapped to locations along the roadmap pathway within the roadmap image. Other applications are also described.

Apparatus and methods for mapping a sequence of images to a roadmap image

Apparatus and methods are described for use with a tool that is inserted into a portion of a body of a subject that undergoes cyclic motion. The apparatus and methods include using an imaging device, acquiring a plurality of images of the tool inside the portion of the body, at respective phases of the cyclic motion. Using at least one computer processor, an extent of movement of the tool with respect to the portion of the body that is due to the cyclic motion of the portion of the body is determined. In response thereto, an output is generated that is indicative of the determined extent of the movement of the tool with respect to the portion of the body. Other applications are also described.

Identification and presentation of device-to-vessel relative motion

Apparatus and methods are described for use with an endoluminal data-acquisition device configured to be moved through a lumen, the device having a radiopaque marker coupled thereto. While the device is being moved through the lumen (a) endoluminal data points of the lumen are acquired using the device, (b) contrast agent is continuously injected into the lumen, and (c) angiographic images of the device are acquired. It is determined that endoluminal data points correspond to respective locations within the lumen, by determining locations of the radiopaque marker within the angiographic images of the lumen, by performing image processing on the angiographic images, the locations of the radiopaque marker within the angiographic images of the lumen corresponding to respective endoluminal data points. Other applications are also described.

Co-use of endoluminal data and extraluminal imaging

Apparatus and methods are described for use with an endoluminal data-acquisition device having a radiopaque portion coupled thereto, including, while the endoluminal data-acquisition device is being moved through the lumen, acquiring a plurality of endoluminal data points of the lumen using the endoluminal data-acquisition device. A combined extraluminal image of the lumen is generated that contains images of the radiopaque portion at first and second locations within the lumen, by co-registering first and second extraluminal images with each other. At least one location on the combined extraluminal image is identified as corresponding to a location within the lumen at which a given one of the endoluminal data points was acquired, by identifying the first and second locations of the radiopaque portion within the combined extraluminal image. An output is generated, in response thereto. Other applications are also described.

Apparatus and methods are described for use with an input angiogram image of a device inserted inside a portion of subject's body, the angiogram image being acquired in the presence of contrast agent. At least one processor () includes background-image-generation functionality () configured to generate a background image in which a relative value is assigned to a first pixel with respect to a second pixel, at least partially based upon relative values of surroundings of the first pixel and the surroundings of the second pixel in the input image. Cleaned-image-generation functionality () generates a cleaned image in which visibility of the radiopaque portions of the device is increased relative to the input image, by dividing the input image by the background image. Output-generation functionality () drives a display () to display an output based upon the cleaned image. Other applications are also described.

Luminal background cleaning

Apparatus and methods are described including acquiring a plurality of image frames of a portion of a subject's body. At least one of the image frames is designated as a baseline image frame, a shape of the portion in the first baseline image frame being designated as a baseline shape. A non-baseline-shape image frame is deformed, such that the shape of the portion becomes more similar to the baseline shape of the portion than when the portion in the non-baseline-shape image frame is not deformed. A composite image is formed that is of higher clarity with respect to anatomy of the portion, relative to each of the acquired image frames, by averaging at least the deformed non-baseline-shape image frame with the baseline image frame. The composite image is displayed on a display. Other applications are also described.

Forming and displaying a composite image

Apparatus and methods are provided including, while an endoluminal data-acquisition device is being moved through a lumen of a subject, acquiring a plurality of endoluminal data points of the lumen using the endoluminal data-acquisition device. At at least one location it is determined that an event occurred, the event causing the endoluminal data-acquisition device not to acquire a single endoluminal data point at the location. The endoluminal data points are displayed in a stack, in which the endoluminal data points are positioned at locations corresponding to relative locations within the lumen at which the endoluminal data points were acquired, and in which the event is accounted for. Other applications are also described.

Accounting for non-uniform longitudinal motion during movement of an endoluminal imaging probe

Apparatus for isolation of a media stream of a first modality from a complex media source having at least two media modality, and multiple objects, and events, comprises: recording devices for the different modalities; an associator for associating between events recorded in said first modality and events recorded in said second modality, and providing an association output; and an isolator that uses the association output for isolating those events in the first mode correlating with events in the second mode associated with a predetermined object, thereby to isolate a isolated media stream associated with said predetermined object. Thus it is possible to identify events such as hand or mouth movements, and associate these with sounds, and then produce a filtered track of only those sounds associated with the events. In this way a particular speaker or musical instrument can be isolated from a complex scene.

Growing community of inventors

Haifa, Israel

Zohar Barzelay