Accurate tissue proximity

Abstract

In one embodiment, a method to find tissue proximity indications includes inserting a catheter into a body part of a living subject such that electrodes of the catheter contact tissue at respective locations within the body part, receiving signals provided by the electrodes, selectively rewarding and penalizing a reinforcement learning agent over reinforcement learning exploration phases to learn at least one tissue proximity policy responsively to at least one of the received signals, applying the reinforcement learning agent in reinforcement learning exploitation phases to find respective tissue-proximity actions to be taken that maximize respective expected rewards responsively to the at least one tissue proximity policy, and providing respective derived tissue-proximity indications of proximity of a given one of the electrodes with the tissue responsively to the found respective tissue-proximity actions.