Google Inc.

Cameron Hill

Martin Davidsson

Jason Noah Laska

Greg Duffy

Gregory Rourk Nelson

Lawrence W Neal

Greg R Nelson

Hiro Mitsuji

James Edward Stewart

Joe Delone Venters

George Alban Heitz

Seungho Yang

Christopher Charles Burns

Carsten Hinz

Timothy Samuel Psiaki

Nathan Scott Klee

William Alex Finlayson

Kevin James Avery

Tung Yuen Wan

Michael D Montalbo

Sahana Mysore

Mehul Nariyawala

Yohannes Kifle

Sayed Yusef Shafi

Mike Montalbo

George Alban Iii Heitz

A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.

Timeline-video relationship presentation for alert events

A method at a server system includes: receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames; selecting a plurality of non-contiguous frames from the video stream, the plurality of non-contiguous frames being associated with a predetermined time interval; encoding the plurality of non-contiguous frames as a compressed video segment associated with the time interval; receiving a request from an application running on a client device to review video from the remote video camera for the time interval; and in response to the request, transmitting the video segment to the client device for viewing in the application.

Timeline-video relationship processing for alert events

The various embodiments described herein include methods, devices, and systems for displaying event indicators on an event timeline. In one aspect, a method includes: displaying a video monitoring user interface including: video information corresponding to a video stream of remote camera's field of view in a first region, and the event timeline in a second region; obtaining identification of a new zone of interest corresponding to a portion of the camera's field of view; sending information indicative of the new zone of interest to a server system; obtaining identification of one or more past motion events detected by the remote camera involving the new zone of interest; and updating display of the event timeline to display an event indicator having a visual characteristic corresponding to the new zone of interest for each of the one or more past motion events.

Methods and systems for updating an event timeline with event indicators

The various implementations described herein include methods, devices, and systems for detecting motion and persons. In one aspect, a method is performed at a smart home system that includes a video camera, a server system, and a client device. The video camera captures video and audio, and wirelessly communicates, via the server system, the captured data to the client device. The server system: (1) receives and stores the captured data from the video camera; (2) determines whether an event has occurred, including detected motion; (3) in accordance with a determination that the event has occurred, identifies video and audio corresponding to the event; and (4) classifies the event. The client device receives information indicative of the identified events, displays a user interface for reviewing the video and audio stored by the remote server system, and displays the at least one classification for the event.

Methods and systems for detecting persons in a smart home environment

An electronic device with a display, processor(s), and memory displays a video monitoring user interface. The interface includes a video window displaying video feed from a camera located remotely from the device. A subset of the video includes a first motion event associated with an event category and a second motion event not associated with the event category. The device detects a user request for video playback. In response to the request, the device identifies a segment of the video for playback. The segment includes a first portion associated with the first motion event and a second portion associated with the second motion event. The device causes generation of a time-lapse video clip of the segment of the video for playback, including configuring the first portion to play at a different speed from the second portion. The device displays and plays the video clip of the segment.

Method and system for generating a smart time-lapse video clip

The disclosed embodiments include systems and methods for camera-side cropping of a video feed. In one aspect, a method includes: (1) displaying a first video feed with the first field of view at the first resolution; (2) detecting a first user input to enhance an identified portion of the first video feed; and (3) in response to detecting the first user input: (a) generating a camera crop command for the identified portion instructing the camera to generate a second video feed corresponding to the identified portion, the second video feed having the first resolution and a second field of view that is smaller than the first field of view; (b) sending the camera crop command to the camera; (c) in response receiving the second video feed from the camera; and (d) displaying the second video feed with the second field of view at the first resolution.

Methods and systems for camera-side cropping of a video feed

A method at a computing system includes: obtaining video of an environment including a plurality of objects, wherein the video has a field of view; identifying one or more objects of the plurality of objects within the field of view; defining a zone of interest associated with a first object of the one or more objects, including identifying the zone of interest as one of an alerting zone or a suppression zone; subsequent to the defining, detecting one or more motion events captured in the video occurring at least partially within the zone of interest; when the zone of interest is an alerting zone, causing one or more notifications of the one or more motion events to be issued; and when the zone is a suppression zone, suppressing notifications of the one or more motion events.

Automatic detection of zones of interest in a video

The various embodiments described herein include methods, devices, and systems for displaying event indicators on an event timeline. In one aspect, a method includes: (1) displaying a video monitoring user interface including: (a) video information corresponding to a video stream of remote camera's field of view in a first region, and (b) the event timeline in a second region; (2) obtaining identification of a new zone of interest corresponding to a portion of the camera's field of view; (3) sending information indicative of the new zone of interest to a server system; (4) obtaining identification of one or more past motion events detected by the remote camera involving the new zone of interest; and (5) updating display of the event timeline to display an event indicator having a visual characteristic corresponding to the new zone of interest for each of the one or more past motion events.

A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera, where at least some of the live video stream is recorded at a remote server; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.

An electronic device with a display, processor(s), and memory displays a video monitoring user interface including a video feed from a camera located remotely from the client device in a first region and an event timeline in a second region, the event timeline including event indicators for motion events previously detected by the camera. The electronic device detects a user input selecting a portion of the event timeline, where the selected portion of the event timeline includes a subset of the event indicators. In response to the user input, the electronic device causes generation of a time-lapse video clip of the selected portion of the event timeline. The electronic device displays the time-lapse video clip, where motion events corresponding to the subset of the event indicators are played at a slower speed than the remainder of the selected portion of the event timeline.

The disclosed embodiments include a system for processing motion events. The system obtains a video stream from a camera, the video stream corresponding to a field of view of the camera and obtains identification of a spatial zone, the spatial zone corresponding to at least a portion of the field of view of the camera. For each motion event detected in the video stream: (1) the system determines whether the motion event involves the spatial zone; and (2), in accordance with a determination that the motion event involves the spatial zone, the system suppresses a first user notification for the motion event.

Growing community of inventors

San Francisco, CA, United States of America

Cameron Hill