Google Inc.

Hewlett-packard Development Company, L.p.

Anshul Kothari

Gaurav Bhaya

Surojit Chatterjee

Amit Agarwal

Tarun Kumar Jain

Anurag Agrawal

Daniel Andersson

Seung Yi

Jian Zhou

Tao Huang

Vibhor Nanavati

Girish Baliga

Anshul Kundani

Narendra Kumar Singhal

Ahmed Mohamed Hassan Osman Akef

Terry Van Belle

Ravi Kumar Jain

Robert E Tarjan

Ram Swaminathan

Varun Soundararajan

Shivakumar Venkataraman

Chen Chen

Monica Chawathe Lenart

Yunhong Zhou

Paul Feng

Masoud Loghmani

Ajit Apte

Nandita Narasimha Prabhu

Yun Huang

Ananth Devulapalli

Ruxandra Georgiana Davies

Weipeng Paul Yan

Lisa Takehana

Robert Stets

Vivek Raghunathan

Ramakrishnan Srikant

Alex Xin Zhang

Subhadip Sarkar

Abhishek Bapna

Aranyak Mehta

Adam Isaac Juda

Nagbhushan Veerapaneni

Zhou Jian

Theodore B Van Belle

Kamalika Chaudhuri

Gaurav Ravindra Bhaya

Processing stacked data structures is provided. A system receives an input audio signal detected by a sensor of a local computing device, identifies an acoustic signature, and identifies an account corresponding to the signature. The system establishes a session and a profile stack data structure including a first profile layer having policies configured by a third-party device. The system pushes, to the profile stack data structure, a second profile layer retrieved from the account. The system parses the input audio signal to identify a request and a trigger keyword. The system generates, based on the trigger keyword and the second profile layer, a first action data structure compatible with the first profile layer. The system provides the first action data structure for execution. The system disassembles the profile stack data structure to remove the first profile layer or the second profile layer from the profile stack data structure.

Digital assistant processing of stacked data structures

Systems and methods of the present technical solution enable a multi-modal interface for voice-based devices, such as digital assistants. The solution can enable a user to interact with video and other content through a touch interface and through voice commands. In addition to inputs such as stop and play, the present solution can also automatically generate annotations for displayed video files. From the annotations, the solution can identify one or more break points that are associated with different scenes, video portions, or how-to steps in the video. The digital assistant can receive input audio signal and parse the input audio signal to identify semantic entities within the input audio signal. The digital assistant can map the identified semantic entities to the annotations to select a portion of the video that corresponds to the users request in the input audio signal.

Multi-modal interface in a voice-activated network

The present disclosure is directed to systems and methods of providing content. A server can generate a request for a push content item for an account identifier linked with a computing device. The server can establish a push auction for the account identifier with multiple candidate push content items. The server can determine an auction score for each candidate push content item and select a push content item therefrom based on the auction score. The server can determine a parameter for the account identifier and control delivery of the selected push content item based on a delivery control policy. The server can compare a value of the parameter with a threshold value to authorize the push content item. The server can provide the selected and authorized push content item for presentation in a push content slot via the computing device linked to the account identifier.

Systems and methods for providing content items via a push marketing auction

Coordinating signal processing among computing devices in a voice-driven computing environment is provided. A first and second digital assistant can detect an input audio signal, perform a signal quality check, and provide indications that the first and second digital assistants are operational to process the input audio signal. A system can select the first digital assistant for further processing. The system can receive, from the first digital assistant, data packets including a command. The system can generate, for a network connected device selected from a plurality of network connected devices, an action data structure based on the data packets, and transmit the action data structure to the selected network connected device.

Signal processing coordination among digital voice assistant computing devices

A system of reducing transmissions of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify candidate interfaces and determine if prior instances of the packetized data was transmitted to the candidate interfaces. The interface management component can prevent the transmission of the packetized data if determined to be redundant, such as having previously received the data, and instead transmit it to a separate client device of a different device type.

Detection of duplicate packetized data for selective transmission into one of a plurality of a user's devices

Managing rendering of a graphical user interface is provided. A system receives data packets comprising an input audio signal. The system determines an application identifier and query. The system provides the query to the application to cause the application to generate a second query for transmission to a third-party server, and identify responses to the query. The system intercepts the responses, and generates a keyword based on the responses. The system selects a digital component using the keyword, executes a deduplication process, and determines to add the digital component to the responses. The system constructs a display output using a graphical user interface template that integrates the plurality of responses generated by the application with the digital component, and provides the display output to the computing device for rendering.

Graphical user interface rendering management by voice-driven computing infrastructure

Systems and methods of the present disclosure relate generally to allocation of content resources in a voice activated packet-based computer network. A request for a digital component, by a client computing device, can be fulfilled by multiple content sources. Fulfillment by the different content sources can consume different amounts of computational and network resources. The selection of the best content provider can improve the efficiency and effectiveness of data packet transmission over one or more computer networks.

Content source allocation between computing devices

The present disclosure is directed to allocating communication resources via information technology infrastructure. A system can provide a communication tag and an analytics tag for integration in a web site. The system can receive a request to allocate a phone number generated based on an interaction between the communication tag and the analytics tag. The request can include a first field comprising the communication endpoint identifier, a second field comprising the site identifier for the web site, and a third field comprising a session identifier for the computing device. The system can determine a virtual phone number to assign to a combination of the values of the fields provided in the request, and create a link between the assigned virtual number and the combination. The system can provide the assigned virtual phone number to the computing device that initiated the request.

Systems and methods for allocating communication resources via information technology infrastructure

Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium for dynamic contact information assignment. A method includes: identifying a pool of telephone numbers; assigning the telephone numbers to a pool manager; allocating by the pool manager, subsets of the telephone numbers to a plurality of allocators, each allocator responsible for allocating telephone numbers to an associated group of content sponsors; determining a first allocation of a first subset, the first allocation being distributed among the content sponsors associated with a first allocator, creating first pools each associated with a respective one of the content sponsors associated with the first allocator; reclaiming one or more telephone numbers from a pool of the first pools; and assigning ones of the reclaimed telephone numbers by the first allocator into either other pools of the first pools or back to the pool manager for allocation to other allocators.

Automatic virtual phone number pool management

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for facilitating and improving push messaging provided to users. In one aspect, a method includes receiving, from a user device, a request to subscribe to a push messaging service, selecting a given phone number that is uniquely associated with the user based on the received request, transmitting, to a user device, a first message that presents visual information at the user device and includes the given phone number, receiving, by the one or more servers, a second message addressed to the given phone number, selecting an additional message that presents additional visual information at the user device based, at least in part, on the message received from the user device and one or more of a geolocation of the mobile device or a time of day, and transmitting the additional message to the user device.

Enhanced push messaging

Growing community of inventors

Sunnyvale, CA, United States of America

Anshul Kothari