Google Inc.

Jeffrey Ching Wang

Scott P Mullins

George Alban Heitz

John Jordan Nold

Chien-Jung Kung

Shayan Sayadi

Siddarth Raghunathan

Michael Yang Liu

Madhusudhan R Adupala

Mohamed Mohy-Eldeen Abdelgany

A display assistant device comprises a display, a camera, a speaker, microphones, a processor and memory. The memory stores programs comprising instructions that, when executed by the processor, enable a plurality of modes of the display assistant device. The modes include a monitoring mode and an assistant mode. In the monitoring mode, the device is configured to perform a remote monitoring function in which first video captured by the camera is streamed to a remote server system for monitoring uses. The monitoring uses include transmission of the first video to remote client devices authorized to access the first video. In the assistant mode, the device is configured to perform a second plurality of functions that excludes the monitoring function and includes a video communication function in which second video captured by the camera is transmitted to second devices participating in a video communication with a first user of the device.

Display assistant device having a monitoring mode and an assistant mode

Systems and techniques are provided for voice calling with a connected device that does not include a SIM card or telephone port. Outgoing audio data may be received at an embedded browser running on a connected device, may be sent using Web Real Time Communications (WebRTC) from the embedded browser to an integration layer running within the embedded browser, and may be sent from the integration layer to a border controller for a voice call carrier over a Session Initiation Protocol (SIP) connection according to Secure Real Time Transport Protocol (SRTP). Incoming audio data may be received at the integration layer from the border controller for the voice call carrier over the SIP connection according to SRTP, may be sent using WebRTC from the integration layer to the embedded browser, and may be sent from the embedded browser to an audio output of the connected device which may output audio.

Voice calling with a connected device

Systems and techniques are provided for voice calling with a connected device that does not include a SIM card or telephone port. Outgoing audio data may be received at an embedded browser running on a connected device, may be sent using Web Real Time Communications (WebRTC) from the embedded browser to an integration layer panning within the embedded browser, and may be sent from the integration layer to a border controller for a voice call carrier over a Session Initiation Protocol (SIP) connection according to Secure Real Time Transport Protocol (SRTP). Incoming audio data may be received at the integration layer from the border controller for the voice call carrier over the SIP connection according to SRTP, may be sent using WebRTC from the integration layer to the embedded browser, and may be sent from the embedded browser to an audio output of the connected device which may output audio.

Growing community of inventors

San Francisco, CA, United States of America

Jeffrey Ching Wang