Method and system for heart rate extraction from rgb images

Abstract

Method and system for determining one or more heart beat features using remote photoplethysmography (rPPG). The method, comprising capturing a series of images of a user in a car by a camera in the car, wherein each image comprises one or more colour signals; for each of the images: locating a face of the user in the image; determining a boundary in the image, wherein the face is located within the boundary; detecting one or more facial features within the boundary; and based on the detected facial features, determining one or more regions in the image representing skin patches in the face; analysing the colour signals in the regions representing the skin patches; and determining one or more heart beat features based on the analysis. The method further comprising selecting one or more pulse waves and/or frequency spectra of one or more skin patches reaching a predetermined level of similarity and/or a predetermined level of noise for further analysis and discarding all other pulse waves and/or frequency spectra. The method improves speed and accuracy of determining one or more heart beat features using rPPG.