Amazon Technologies, Inc.

Tony Roy Hardie

Brian Alexander Oliver

Ran Mokady

Christo Frank Devaraj

Vikram Kumar Gundeti

Sandra Lemon

Nick Ciubotariu

Manish Kumar Dalmia

Anna Chen Santos

Shambhavi Sathyanarayana Rao

Nawdesh Uppal

Mario Chenier

Rohit Prasad

Ariya Rastrow

Jerome Alexander Rolia

Zhaoqing Ma

Balraja Subbiah

Pathivada Rajsekhar Naidu

Vaidyanathan Puthucode Krishnamoorthy

Rohit Lohani

Roopali Vasant Kaujalgi

A system and method establishes a communication connection between a first device of a first user and a second device of a second user. Request data corresponding to a request to establish a communication connection with a second user is received, and a user profile associated with the second user is determined. One or more sensors of the second device receive input data corresponding to the environment of the second device, and an identity of the second user is determined based thereon. The communication connection is established and, based on the identity, the second device tracks movement of the second user in the environment.

Communication with user presence

Systems, methods, and devices for outputting indications regarding voice-based interactions are described. A first speech-controlled device detects spoken audio corresponding to recipient information. The first device captures the audio and sends audio data corresponding to the captured audio to a server. The server determines a second speech-controlled device of the recipient and sends a signal to the recipient's second speech-controlled device representing a message is forthcoming. The recipient's second speech-controlled device outputs and indication representing a message is forthcoming.

Indicator for voice-based communications

This disclosure describes, in part, context-driven device arbitration techniques to select a speech interface device from multiple speech interface devices to provide a response to a command included in a speech utterance of a user. In some examples, the context-driven arbitration techniques may include executing multiple pipeline instances to analyze audio signals and device metadata received from each of the multiple speech interface devices which detected the speech utterance. A remote speech processing service may execute the multiple pipeline instances and analyze the audio signals and/or metadata, at various stages of the pipeline instances, to determine which speech interface device is to respond to the speech utterance.

Context driven device arbitration

Methods and devices for causing a communications session between a first device and a second device to end based on lack of speech activity are described herein. In some embodiments, a communications between a first device and a second device may be initiated by the first device, where a first user account associated with the first device is authorized to initiate communications session with the second device by a second user account. After the communications session is started, audio data is received by a speech activity detection system, which determines whether the audio data represents speech or non-speech. If, after the communications session begins, non-speech is detected by the first device for more than a predefined amount of time, then the communications session is caused to end so that the first device is not capable of receiving video and/or audio associated with the second device.

Recipient device presence activity monitoring for a communications session

Systems, methods, and devices for computer-generating responses and sending responses to communications when the recipient of the communication is unavailable are disclosed. An individual may send a message (either audio or text) to a recipient. The recipient may be unavailable to contemporaneously respond to the message (e.g., the recipient may be performing an action that makes is difficult or impractical for the recipient to contemporaneously respond to the audio message). When the recipient is unavailable, a response to the message is generated and sent without receiving an instruction from the recipient to do so. The response may be sent to the message originating individual, and content of the response may thereafter be sent to the recipient to receive feedback regarding the correctness of the response. Alternatively, the response content may first be sent to the recipient to receive the feedback, and thereafter the response may be sent to the message originating individual.

Generation of automated message responses

An autonomous mobile device (AMD) may be used in an environment as a communication endpoint for voice or video communications. An incoming request for communication may initiate a process in which the AMD finds a user within the environment. Information obtained from sensors onboard the AMD or in the environment may be used to determine the whereabouts of the user. If an existing communication endpoint is not available to the user or cannot support a requested communication modality, the AMD may travel to permitted areas within the environment to find the user, while avoiding areas designated as private. Once found, communication may be established with the user. If the incoming request expires, the AMD may present information indicative of the request to the user.

System for autonomous mobile device assisted communication

Techniques for detecting spam accounts in a system are described. The system may analyze speech characteristics of communication content (e.g., telephone call content, VoIP content, audio messaging, etc.) to determine whether multiple devices or user profiles are associated with overlapping communications. The system may also analyze text transcriptions of communication content to determine whether multiple devices or user profiles are associated with overlapping communications. If so, the system may mitigate, such as throttling service, disabling accounts, and the like.

Message aggregation and comparing

Methods and devices for causing a communications session between a first device and a second device to end based on lack of speech activity are described herein. In some embodiments, non-speech may be detected for both the first device and the second device. If the non-speech associated with the first device is determined to occur at a substantially same time as the non-speech associated with the second device, then this may indicate that no individuals are talking within earshot of their respective devices. Furthermore, the non-speech detected by the first device and the non-speech detected by the second device may both be of an amount of time that is greater than a predefined temporal threshold. If so, then the communications session may be caused to end because speech activity has not been detected by either device for more than the predefined temporal threshold.

Ending communications session based on presence data

A system configured to vary a speech speed of speech represented in input audio data without changing a pitch of the speech. The system may vary the speech speed based on a number of different inputs, including non-audio data, data associated with a command, or data associated with the voice message itself. The non-audio data may correspond to information about an account, device or user, such as user preferences, calendar entries, location information, etc. The system may analyze audio data associated with the command to determine command speech speed, identity of person listening, etc. The system may analyze the input audio data to determine a message speech speed, background noise level, identity of the person speaking, etc. Using all of these inputs, the system may dynamically determine a target speech speed and may generate output audio data having the target speech speed.

Adjusting speed of human speech playback

Techniques for announcing a communications session after the communications session is established between multiple user devices are described. In an example, a computer system may instruct a first user device to establish a communications session with a second user device. The computer system may receive, from the second user device, data indicating a request of the first user device for the communications session. Based at least in part on the data, the computer system may generate content associated with the first user device. The computer system may also instruct the second user device to accept the request and present the content after the communications session is established between the first user device and the second user device.

Announcement in a communications session

Techniques for detecting spam accounts in a system are described. When a system creates a user profile, the system may ingest a blocked communications list. The system may determine how many times each blocked communications number represented in the ingested blocked communications list is included in blocked communications lists of various users of the system. If a blocked communications number represented in the ingested blocked communications list is included in at least a threshold number of other blocked communications lists, the system may mark the communications number as spam at a system level and engage in appropriate mitigation techniques (e.g., throttle the phone numbers activity, disable the phone number's ability to communicate with system devices, etc.).

Growing community of inventors

Seattle, WA, United States of America

Tony Roy Hardie