Capturing and analyzing security events and activities and generating corresponding natural language descriptions

Abstract

Detecting security events and generating corresponding natural language descriptors includes monitoring an area to capture data corresponding to moving objects in the area, classifying the moving objects, generating events based on classifying the moving objects, building an event graph by connecting related ones of the events, using the event graph to detect security events, and building natural language activity descriptors for the security events of the event graph using natural language templates to convert the security events to natural language. The natural language security descriptors may be presented using a verbal request to a voice-enabled assistant, a mandatory notification by the voice-enabled assistant, periodic reports and/or conversational style notifications in a visual format. Data may be captured using sensors, video streams from at least one camera vehicle, smart home devices, presence detection mechanisms, and/or weather data/forecasts. The sensors may include PIR, vibration, light, laser, ultrasonic, seismic, and/or radar sensors.