Image signal processing to compensate for scene changes

Abstract

One example method includes obtaining, from an endoscope and between first and second video frames of a real-time video having a frame rate, a preliminary image of a scene during a surgical procedure, the first image comprising a plurality of pixels, wherein the first and second video frames are consecutive video frames in the real-time video; determining, for each pixel of the plurality of pixels, a depth within the scene; determining first image capture parameters for the scene based on a scene illumination setting and a first set of pixels within a first range of depths in the scene; capturing, between the first and second consecutive output video frames, a first image using the first image capture parameters; determining an illumination correction for a second set of pixels at a second range of depths within the scene; capturing, between the first and second consecutive output video frames, a second image using the illumination correction; generating a composite image based on the first and second images; and outputting the composite image as the second output video frame.