Machine learning segmentation-based tone mapping in high noise and high dynamic range environments or other environments

Abstract

A method includes obtaining multiple input image frames and generating a high dynamic range (HDR) blended image based on the input image frames, where the HDR blended image has a higher dynamic range than individual ones of the input image frames. The method also includes performing a tone fusion operation on the HDR blended image based on a semantic delta-weight map to generate a fused image. Performing the tone fusion operation includes synthesizing multiple low dynamic range (LDR) images based on the HDR blended image and generating initial weight maps based on the LDR images. Performing the tone fusion operation also includes generating filtered weight maps based on the initial weight maps, the semantic delta-weight map, and a guided filter. Performing the tone fusion operation further includes generating the fused image based on the filtered weight maps and decomposed versions of the LDR images.