Google Inc.

Gaurav Bhaya

Robert Stets

Anshul Kothari

Tarun Kumar Jain

Amit Agarwal

Surojit Chatterjee

Vibhor Nanavati

Ulas Kirazci

Ilya Firman

Adam Coimbra

Robert J Stets, Jr

Carey Radebaugh

Bradley M Abrams

Justin Lewis

Graeme John Rimmer

Lewis Jay Hemens

Ruxandra Georgiana Davies

Simon Michael Rowe

Ken Krieger

Richard Dominick Rapp

Varun Soundararajan

Nicholas Salvatore Arini

Raimundo Mirisola

Andrew Joseph Alexander Gildfind

Umesh Patil

Ravi Kumar Jain

Lisa Takehana

Bindu Priya Reddy

Sarah Sirajuddin

Jennifer L Kozenski

Arvind Sundararajan

Ning Mosberger

David Kale

Puneet Agarwal

Mark Jeffrey Foladare

Boon-Lock Yeo

Martin Brandt Freund

Gaurav Garg

Alexander Collins

Jonathan William Ray

Momchil Filev

Yunkai Zhou

Subhadip Sarkar

Bailiang Zhou

Venky Ramachandran

Lawrence Jonathan Brunsman

Ian James Leader

Timothy Wong O'Connor

Gangjiang Li

Chiu Wah Kelvin So

Vinod Ramachandran Marur

Craig Lawrence Warner

Glenn Wilson

Richard Lynn Bennett

Peng Zhang

Jian Zhou

Ramakrishnan Kandhan

Eric Wood

Paul Feng

Jonathan Brunsman

Troy L Walker

Wei-Hsin Lee

Jacob D Schonberg

Jianfeng Shen

Terry Van Belle

Vaibhav Vaish

Pramod Adiddam

Nandita Narasimha Prabhu

Yun Huang

David Philip Sisson

Xuemei Gu

Paul Schelte Albert Reitsma

Alexander Ross

Farnaz Azmoodeh

Congxing Cai

Rober Stets

A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.

Multimodal transmission of packetized data

Processing stacked data structures is provided. A system receives an input audio signal detected by a sensor of a local computing device, identifies an acoustic signature, and identifies an account corresponding to the signature. The system establishes a session and a profile stack data structure including a first profile layer having policies configured by a third-party device. The system pushes, to the profile stack data structure, a second profile layer retrieved from the account. The system parses the input audio signal to identify a request and a trigger keyword. The system generates, based on the trigger keyword and the second profile layer, a first action data structure compatible with the first profile layer. The system provides the first action data structure for execution. The system disassembles the profile stack data structure to remove the first profile layer or the second profile layer from the profile stack data structure.

Digital assistant processing of stacked data structures

The present disclosure is directed to a technique for reduction of latency in network traffic data transmissions. The system parses an online document to determine a messaging identifier used to communicate over an asynchronous network-based communication channel with a content provider device. The system assembles a first instance of the online content item with the messaging identifier. An intermediary appliance located on the asynchronous network-based communication channel in between the first computing device and the content provider device intercepts data packets including the electronic message The system determines a quality of the asynchronous network-based communication channel. The system blocks insertion of the messaging identifier in a second instance of the online content item prior to transmission of the second instance of the online content item to a second computing device to reduce latency by preventing additional messages from being sent to the messaging identifier.

Network based data traffic latency reduction

The present disclosure is directed to systems and methods of providing content. A server can generate a request for a push content item for an account identifier linked with a computing device. The server can establish a push auction for the account identifier with multiple candidate push content items. The server can determine an auction score for each candidate push content item and select a push content item therefrom based on the auction score. The server can determine a parameter for the account identifier and control delivery of the selected push content item based on a delivery control policy. The server can compare a value of the parameter with a threshold value to authorize the push content item. The server can provide the selected and authorized push content item for presentation in a push content slot via the computing device linked to the account identifier.

Systems and methods for providing content items via a push marketing auction

Routing packetized actions in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate an action data structure. The system can transmit the action data structure to a third party provider device. The system can receive an indication from the third party provider device that a communication session was established with the device.

Audio-based data structure generation

Modulating packetized audio signals in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate a first action data structure. The system can identify a content item object based on the trigger keyword, and generate an output signal comprising a first portion corresponding to the first action data structure and a second portion corresponding to the content item object. The system can apply a modulation to the first or second portion of the output signal, and transmit the modulated output signal to the device.

Modulation of packetized audio signals

The present disclosure is generally directed a data processing system for authenticating packetized audio signals in a voice activated computer network environment. The data processing system can improve the efficiency and effectiveness of auditory data packet transmission over one or more computer networks by, for example, disabling malicious transmissions prior to their transmission across the network. The present solution can also improve computational efficiency by disabling remote computer processes possibly affected by or caused by the malicious audio signal transmissions. By disabling the transmission of malicious audio signals, the system can reduce bandwidth utilization by not transmitting the data packets carrying the malicious audio signal across the networks.

Authentication of audio-based input signals

Coordinating signal processing among computing devices in a voice-driven computing environment is provided. A first and second digital assistant can detect an input audio signal, perform a signal quality check, and provide indications that the first and second digital assistants are operational to process the input audio signal. A system can select the first digital assistant for further processing. The system can receive, from the first digital assistant, data packets including a command. The system can generate, for a network connected device selected from a plurality of network connected devices, an action data structure based on the data packets, and transmit the action data structure to the selected network connected device.

Signal processing coordination among digital voice assistant computing devices

A system of reducing transmissions of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify candidate interfaces and determine if prior instances of the packetized data was transmitted to the candidate interfaces. The interface management component can prevent the transmission of the packetized data if determined to be redundant, such as having previously received the data, and instead transmit it to a separate client device of a different device type.

Detection of duplicate packetized data for selective transmission into one of a plurality of a user's devices

The present disclosure is generally directed to the generation of voice-activated data flows in interconnected network. The voice-activated data flows can include input audio signals that include a request and are detected at a client device. The client device can transmit the input audio signal to a data processing system, where the input audio signal can be parsed and passed to the data processing system of a service provider to fulfill the request in the input audio signal. The present solution is configured to conserve network resources by reducing the number of network transmissions needed to fulfill a request.

Activation of remote devices in a networked system

Systems and methods of voice activated thread management in a voice activated data packet based environment are provided. A natural language processor ('NLP') component can receive and parse data packets comprising a first input audio signal to identify a first request and a first trigger keyword. A direct action application programming interface ('API') can generate a first action data structure with a parameter defining a first action. The NLP component can receive and parse a second input audio signal to identify a second request and a second trigger keyword, and can generate a second action data structure with a parameter defining a second action. A pooling component can generate the first and second action data structures into a pooled data structure, and can transmit the pooled data structure to a service provider computing device to cause it device to perform an operation defined by the pooled data structure.

Data structure pooling of voice activated data packets

A selective sensor polling system for a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request. The system can select a template for an action data structure with a plurality of fields. The system can determine to poll a first sensor for data for the first field. The system can determine to obtain data in memory previously collected by the second sensor. The system can generate and transmit the action data structure with the data from the sensor and memory, and transmit the action data structure to a third party device.

Selective sensor polling

Growing community of inventors

Sunnyvale, CA, United States of America

Gaurav Bhaya