Google Inc.

Martin Davidsson

Cameron Hill

Jason Noah Laska

Greg Duffy

Gregory Rourk Nelson

James Edward Stewart

Joe Delone Venters

George Alban Heitz

Seungho Yang

Lawrence W Neal

Greg R Nelson

Christopher Charles Burns

Carsten Hinz

Nathan Scott Klee

Timothy Samuel Psiaki

Kevin James Avery

William Alex Finlayson

Hiro Mitsuji

Tung Yuen Wan

Michael D Montalbo

Mike Montalbo

George Alban Iii Heitz

A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.

Timeline-video relationship presentation for alert events

A method at a server system includes: receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames; selecting a plurality of non-contiguous frames from the video stream, the plurality of non-contiguous frames being associated with a predetermined time interval; encoding the plurality of non-contiguous frames as a compressed video segment associated with the time interval; receiving a request from an application running on a client device to review video from the remote video camera for the time interval; and in response to the request, transmitting the video segment to the client device for viewing in the application.

Timeline-video relationship processing for alert events

The various embodiments described herein include methods, devices, and systems for displaying event indicators on an event timeline. In one aspect, a method includes: displaying a video monitoring user interface including: video information corresponding to a video stream of remote camera's field of view in a first region, and the event timeline in a second region; obtaining identification of a new zone of interest corresponding to a portion of the camera's field of view; sending information indicative of the new zone of interest to a server system; obtaining identification of one or more past motion events detected by the remote camera involving the new zone of interest; and updating display of the event timeline to display an event indicator having a visual characteristic corresponding to the new zone of interest for each of the one or more past motion events.

Methods and systems for updating an event timeline with event indicators

The various implementations described herein include methods, devices, and systems for detecting motion and persons. In one aspect, a method is performed at a smart home system that includes a video camera, a server system, and a client device. The video camera captures video and audio, and wirelessly communicates, via the server system, the captured data to the client device. The server system: (1) receives and stores the captured data from the video camera; (2) determines whether an event has occurred, including detected motion; (3) in accordance with a determination that the event has occurred, identifies video and audio corresponding to the event; and (4) classifies the event. The client device receives information indicative of the identified events, displays a user interface for reviewing the video and audio stored by the remote server system, and displays the at least one classification for the event.

Methods and systems for detecting persons in a smart home environment

The disclosed embodiments include systems and methods for camera-side cropping of a video feed. In one aspect, a method includes: (1) displaying a first video feed with the first field of view at the first resolution; (2) detecting a first user input to enhance an identified portion of the first video feed; and (3) in response to detecting the first user input: (a) generating a camera crop command for the identified portion instructing the camera to generate a second video feed corresponding to the identified portion, the second video feed having the first resolution and a second field of view that is smaller than the first field of view; (b) sending the camera crop command to the camera; (c) in response receiving the second video feed from the camera; and (d) displaying the second video feed with the second field of view at the first resolution.

Methods and systems for camera-side cropping of a video feed

The various embodiments described herein include methods, devices, and systems for displaying event indicators on an event timeline. In one aspect, a method includes: (1) displaying a video monitoring user interface including: (a) video information corresponding to a video stream of remote camera's field of view in a first region, and (b) the event timeline in a second region; (2) obtaining identification of a new zone of interest corresponding to a portion of the camera's field of view; (3) sending information indicative of the new zone of interest to a server system; (4) obtaining identification of one or more past motion events detected by the remote camera involving the new zone of interest; and (5) updating display of the event timeline to display an event indicator having a visual characteristic corresponding to the new zone of interest for each of the one or more past motion events.

A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera, where at least some of the live video stream is recorded at a remote server; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.

The disclosed embodiments include a system for processing motion events. The system obtains a video stream from a camera, the video stream corresponding to a field of view of the camera and obtains identification of a spatial zone, the spatial zone corresponding to at least a portion of the field of view of the camera. For each motion event detected in the video stream: (1) the system determines whether the motion event involves the spatial zone; and (2), in accordance with a determination that the motion event involves the spatial zone, the system suppresses a first user notification for the motion event.

Method and system for processing motion event notifications

The disclosed embodiments include an electronic device with a display, processor(s), and memory. The electronic device displays a user interface on the display, the user interface including video information corresponding to a camera, the video information including a field of view of the camera. The electronic device receives user identification of a spatial zone within the user interface, the spatial zone corresponding to at least a portion of the field of view of the camera; and forgoes user notification of subsequent motion events involving the spatial zone.

Method and device for processing motion events

A computing system processes a video recording to identify a plurality of motion events, each corresponding to a respective video segment along a timeline of the video recording. The computing system identifies at least one object in motion within a scene depicted in the video recording and stores a respective event mask for each event. The computing system receives a definition of a zone of interest within the scene. In response to receiving the definition, the computing system determines, for each motion event, whether the respective event mask of the motion event overlaps with the zone of interest by at least a predetermined overlap factor, and identifies one or more events of interest from the plurality of motion events, wherein the respective event mask of each identified event of interest is determined to overlap with the zone of interest by at least the predetermined overlap factor.

Method and system for non-causal zone search in video monitoring

An electronic device with a display, processor(s), and memory displays a video monitoring user interface on the display with a plurality of user interface elements associated one or more recognized activities. The electronic device detects a user input selecting a respective user interface element from the plurality of user interface elements in the video monitoring user interface, the respective user interface element being associated with a respective event category of the one or more recognized event categories. In response to detecting the user input, the electronic device displays an editing user interface for the respective event category on the display with a plurality of animated representations in a first region of the editing user interface, where the plurality of animated representations correspond to a plurality of previously captured motion events assigned to the respective event category.

Growing community of inventors

Redwood City, CA, United States of America

Martin Davidsson