Multi-functional computer-aided gastroscopy system optimized with integrated ai solutions and method

Abstract

A multi-functional, computer-aided gastroscopy system optimized with integrated AI solutions is disclosed. The system makes use of multiple deep-learning neural models to achieve low latency and high-performance requirements for multiple tasks. The optimization is made at three levels: architectural, modular and functional level. At architectural level, the models are designed in such a way that it is able to accomplish HP infection classification and detection of some lesions for one inference in order to reduce computation costs. At modular level, as a sub-model of HP infection classification, the site recognition model is optimized with temporal information. It not only improves the performance of HP infection classification, but also plays important roles for lesion detection and procedure status determination. At functional level, the inference latency is minimized by configuration and resource aware optimization. Also at functional level, the preprocessing is speeded up by image resizing parallelization and unified preprocessing.