Google Inc.

Greg Duffy

Jason Noah Laska

Greg R Nelson

Cameron Hill

Martin Davidsson

Hiro Mitsuji

Gregory Rourk Nelson

Tung Yuen Wan

Michael D Montalbo

Lawrence W Neal

Mike Montalbo

The various embodiments described herein include methods, devices, and systems for displaying event indicators on an event timeline. In one aspect, a method includes: displaying a video monitoring user interface including: video information corresponding to a video stream of remote camera's field of view in a first region, and the event timeline in a second region; obtaining identification of a new zone of interest corresponding to a portion of the camera's field of view; sending information indicative of the new zone of interest to a server system; obtaining identification of one or more past motion events detected by the remote camera involving the new zone of interest; and updating display of the event timeline to display an event indicator having a visual characteristic corresponding to the new zone of interest for each of the one or more past motion events.

Methods and systems for updating an event timeline with event indicators

The various implementations described herein include methods, devices, and systems for detecting motion and persons. In one aspect, a method is performed at a smart home system that includes a video camera, a server system, and a client device. The video camera captures video and audio, and wirelessly communicates, via the server system, the captured data to the client device. The server system: (1) receives and stores the captured data from the video camera; (2) determines whether an event has occurred, including detected motion; (3) in accordance with a determination that the event has occurred, identifies video and audio corresponding to the event; and (4) classifies the event. The client device receives information indicative of the identified events, displays a user interface for reviewing the video and audio stored by the remote server system, and displays the at least one classification for the event.

Methods and systems for detecting persons in a smart home environment

An electronic device with a display, processor(s), and memory displays a video monitoring user interface. The interface includes a video window displaying video feed from a camera located remotely from the device. A subset of the video includes a first motion event associated with an event category and a second motion event not associated with the event category. The device detects a user request for video playback. In response to the request, the device identifies a segment of the video for playback. The segment includes a first portion associated with the first motion event and a second portion associated with the second motion event. The device causes generation of a time-lapse video clip of the segment of the video for playback, including configuring the first portion to play at a different speed from the second portion. The device displays and plays the video clip of the segment.

Method and system for generating a smart time-lapse video clip

The disclosed embodiments include a computing system with a display, processor(s), and memory. The computing system displays a video monitoring user interface. The user interface includes a first region for displaying live and/or recorded video from a video camera of a smart home environment, and a second region for displaying an event timeline. The event timeline includes event indicators corresponding to respective events detected within the smart home environment. The video monitoring user interface includes a live video affordance for displaying live video from the video camera. In response to a user selection of an event indicator, the computing system: (1) requests a video feed of the corresponding detected event; and (2) displays the requested video feed in the first region. In response to a user selection of the live video affordance, the computing system: (1) requests the live video; and (2) displays the live video in the first region.

Methods and systems for presenting video feeds

The disclosed embodiments include systems and methods for camera-side cropping of a video feed. In one aspect, a method includes: (1) displaying a first video feed with the first field of view at the first resolution; (2) detecting a first user input to enhance an identified portion of the first video feed; and (3) in response to detecting the first user input: (a) generating a camera crop command for the identified portion instructing the camera to generate a second video feed corresponding to the identified portion, the second video feed having the first resolution and a second field of view that is smaller than the first field of view; (b) sending the camera crop command to the camera; (c) in response receiving the second video feed from the camera; and (d) displaying the second video feed with the second field of view at the first resolution.

Methods and systems for camera-side cropping of a video feed

The various embodiments described herein include methods, devices, and systems for displaying event indicators on an event timeline. In one aspect, a method includes: (1) displaying a video monitoring user interface including: (a) video information corresponding to a video stream of remote camera's field of view in a first region, and (b) the event timeline in a second region; (2) obtaining identification of a new zone of interest corresponding to a portion of the camera's field of view; (3) sending information indicative of the new zone of interest to a server system; (4) obtaining identification of one or more past motion events detected by the remote camera involving the new zone of interest; and (5) updating display of the event timeline to display an event indicator having a visual characteristic corresponding to the new zone of interest for each of the one or more past motion events.

The various implementations described herein include methods, devices, and systems for displaying live and recorded video from a remote camera. In one aspect, a method includes: (1) displaying a portion of a recorded video feed from the video camera, a live video affordance, and an event history affordance; (2) in response to a selection of the live video affordance: (a) requesting and displaying a live video feed; (b) continuing to display the event history affordance; and (c) ceasing to display the live video affordance; (3) in response to receiving a user selection of the event history affordance: displaying a plurality of detected events.

Methods and systems for displaying video streams

An electronic device with a display, processor(s), and memory displays a video monitoring user interface including a video feed from a camera located remotely from the client device in a first region and an event timeline in a second region, the event timeline including event indicators for motion events previously detected by the camera. The electronic device detects a user input selecting a portion of the event timeline, where the selected portion of the event timeline includes a subset of the event indicators. In response to the user input, the electronic device causes generation of a time-lapse video clip of the selected portion of the event timeline. The electronic device displays the time-lapse video clip, where motion events corresponding to the subset of the event indicators are played at a slower speed than the remainder of the selected portion of the event timeline.

A computing system device with processor(s) and memory displays a video monitoring user interface on the display. The video monitoring user interface includes a first region for displaying a live video feed and/or a recorded video feed from the video camera and a second region for displaying an event timeline. The event timeline includes a plurality of time indicators each indicating a specific time and a current video feed indicator indicating the temporal position of the video feed displayed in the first region. The temporal position includes a past time and a current time. The current video feed indicator is movable relative to the time indicators to facilitate a change in the temporal position of the video feed displayed in the first region.

Method and system for displaying recorded and live video feeds

The disclosed embodiments include a system for processing motion events. The system obtains a video stream from a camera, the video stream corresponding to a field of view of the camera and obtains identification of a spatial zone, the spatial zone corresponding to at least a portion of the field of view of the camera. For each motion event detected in the video stream: (1) the system determines whether the motion event involves the spatial zone; and (2), in accordance with a determination that the motion event involves the spatial zone, the system suppresses a first user notification for the motion event.

Method and system for processing motion event notifications

The disclosed embodiments include an electronic device with a display, processor(s), and memory. The electronic device displays a user interface on the display, the user interface including video information corresponding to a camera, the video information including a field of view of the camera. The electronic device receives user identification of a spatial zone within the user interface, the spatial zone corresponding to at least a portion of the field of view of the camera; and forgoes user notification of subsequent motion events involving the spatial zone.

Method and device for processing motion events

The various implementations described herein include methods, devices, and systems for displaying live and recorded video from a remote camera. In one aspect, a method includes: (1) displaying a portion of a recorded video feed from the video camera, a live video affordance, and an event history affordance; (2) in response to a selection of the live video affordance: (a) requesting and displaying a live video feed; (b) continuing to display the event history affordance; and (c) ceasing to display the live video affordance; (3) in response to receiving a user selection of the event history affordance: displaying a plurality of detected events, including for each event: (i) image(s) associated with the event; and (ii) a time indicator; and (4) in response to receiving a user selection of an event, requesting and displaying a recorded event video feed associated with the selected event.

Methods and systems for displaying live video and recorded video

A computing device with processor(s) and memory has a video monitoring user interface for displaying a video feed on a display of a client system. When events are detected in the video feed, an events feed is displayed in the video monitoring user interface to present the detected events. For each detected event, the events feed includes a visual representation of the video feed that was recorded at the time of the respective event, an event characteristic indicator indicating a characteristic of the respective event, and a time indicator indicating the time at which the event occurred. Then, in response to detecting the user selection of one of the events included in the events feed, the computing device records the recorded video feed that was recorded during the selected event is recorded, and displays the requested recorded video feed on the video monitoring user interface.

Video monitoring user interface for displaying motion events feed

A computer system processes a video stream to detect a start of a first motion event candidate in the video stream, and in response to detecting the start of the first motion event candidate in the video stream, initiates event recognition processing on a first video segment associated with the start of the first motion event candidate. Initiating the event recognition processing further includes: determining a motion track of a first object identified in the first video segment; generating a representative motion vector for the first motion event candidate based on the motion track of the first object; and sending the representative motion vector for the first motion event candidate to an event categorizer, where the event categorizer assigns a respective motion event category to the first motion event candidate based on the representative motion vector of the first motion event candidate.

Method and system for motion vector-based video monitoring and event categorization

A computing system processes a video recording to identify a plurality of motion events, each corresponding to a respective video segment along a timeline of the video recording. The computing system identifies at least one object in motion within a scene depicted in the video recording and stores a respective event mask for each event. The computing system receives a definition of a zone of interest within the scene. In response to receiving the definition, the computing system determines, for each motion event, whether the respective event mask of the motion event overlaps with the zone of interest by at least a predetermined overlap factor, and identifies one or more events of interest from the plurality of motion events, wherein the respective event mask of each identified event of interest is determined to overlap with the zone of interest by at least the predetermined overlap factor.

Growing community of inventors

San Francisco, CA, United States of America

Greg Duffy