Amazon Technologies, Inc.

Collin Charles Davis

Michael Anthony Frazzini

Michael Martin George

Gerard Joseph Heinz, Ii

Ashraf Alkarmi

Michael Schleif Pesce

Jonathan Alan Leblang

Aakarsh Nair

Gary Zhong

Milo Oostergo

David A Limp

William Dugald Carr, Jr

Yu-Hsiang Cheng

Ethan Zane Evans

Hok Peng Leung

Patrick Gilmore

Francis Xavier Surjo-Subagio

David Hendrik Verfaillie

Michael Anthony Willette

Christopher Paul Dury

Richard Bantegui

Kevin Crews

Pavan Kumar Surishetty

Richard Christopher Green

Cassity Barrows Queen

Krishnamurthy Ganesan

Nathan Lee Burns

Ruoyu Fei

Jingyu Ji

Aapo Juhani Laitinen

Karthik Bellur

Jesen Kwok Ha

Surabhi Raje

Bin Wang

Siddhartha Shankara Rao

Thaddeus C Pritchett

Matthew James Van Gorder

Christian Robert Cabanero

Thomas Richard Leonard

Adam C F MacDonald

Eric Stephen Nylund

Anantha Venkateshwaran Balasubramaniam

Ajith Kuttai Venkatraman

Ii Heinz Gerard Joseph

This disclosure describes a feedback service that collects feedback for skills, or capabilities, of a virtual assistant that interacts with users, and associates the feedback with the appropriate skills. Virtual assistants interact with users via voice-enabled devices that are backed by voice-processing systems that support various skills of the virtual assistants. Due to large numbers of skills, users are unable to determine which skill is invoked during interactions with virtual assistants, and are thus unable to provide feedback for the skill. The techniques described herein include continuing a speech dialogue with a user after completion of an interaction, and requesting feedback regarding the interaction. Additionally, the techniques may include collecting contextual data for the interaction (e.g., dropped packets, latency caused by jitter, etc.). The feedback service can associate the feedback and contextual data with the particular skill used in the interaction to improve the functioning of the virtual assistant.

Centralized feedback service for performance of virtual assistant

Technologies are disclosed for interacting with a virtual assistant to coordinate, recommend and perform actions. According to some examples, a user may use their voice to interact with a virtual assistant to receive recommendations relating to determining when to perform one or more actions. For example, a user may interact with a virtual assistant to request a recommendation as to when they should leave for the office, leave the office for the day, perform a task, and the like. The recommendation system accesses selected data sources (e.g., calendars, task lists, traffic, transportation schedules, maps, . . . ) to obtain data used in generating the recommendation. In addition, to providing a recommended time, the virtual assistant may also recommend actions to perform. The virtual assistant may also provide notifications to one or more other users that includes information relating to the user leaving.

Interacting with a virtual assistant to coordinate and perform actions

Systems and methods are disclosed related to determining and providing contextual information associated with a meeting based in part by parsing text from a meeting invitation or calendar entry. A voice-capturing device may receive audio data before or during a meeting that includes an invocation phrase used to invoke a voice-based functionality. A response may be generated by the voice-capturing device or an associated service provider system based on the contextual information determined from the parsed meeting invitation and/or related sources.

Contextual parsing of meeting information

A virtual world generation engine and methods for generating virtual worlds from images collected from various sources, including crowdsourced images. A virtual world generation engine may obtain images (e.g., digital photographs, digital video frames, etc.) related to a particular real-world scene, combine the images using image processing techniques such as image stitching techniques to generate composite images representing a view of the scene, and generate models from the composite images. The models may be used in rendering video content representing virtual worlds generated from the collected images of real-world scenes; the video content may be streamed to client device(s). Obtaining the images, generating models, rendering video content from the models, and streaming the video content may be performed in response to user interactions with video content on the client device(s) to allow interactive exploration of the virtual worlds in real-time or near-real time.

Virtual world generation engine

A technology is provided for using a multi-factor authentication process to access services in a computing service environment. One or more policies can be defined for allowing access to one or more services and/or resources associated with a service provider environment according to an authenticated identity. A device, detected by a voice-capturing endpoint within a defined geographical location, may be authenticated according to a unique identification (ID). Voice data received from the voice-capturing endpoint can be authenticated. The authenticated identity can be established according to the authenticated device and the authenticated voice data. A command, received via a voice command from the voice-capturing endpoint, may be issued with the authenticated identity to access the one or more services and/or resources associated with the service provider environment according to the plurality of policies.

Multi-factor authentication to access services

Methods, systems, and computer-readable media for batch registration and configuration of devices are disclosed. A plurality of devices are detected over one or more networks. Data indicative of the plurality of devices is provided through a user interface. Through the user interface, user input is received that indicates a selected plurality of the devices. The selected plurality of the devices are registered with a service provider environment. The selected plurality of the devices are authenticated using device-specific credentials and registered for device-specific accounts with the service provider environment. A configuration profile is deployed to the selected plurality of the devices.

Batch registration and configuration of devices

A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to discover, select, explore, and manipulate objects within the modeled worlds used to generate video content. The RVE system may implement methods that allow users to view and explore in more detail the features, components, and/or accessories of selected objects that are being manipulated and explored. The RVE system may also implement methods that allow users to interact with interfaces of selected objects or interfaces of components of selected objects.

Object discovery and exploration in video content

A real-time video exploration (RVE) system that allows users to pause, step into, and explore 2D or 3D modeled worlds of scenes in a video. The system may leverage network-based computation resources to render and stream new video content from the models to clients with low latency. A user may pause a video, step into a scene, and interactively change viewing positions and angles in the model to move through or explore the scene. The user may resume playback of the recorded video when done exploring the scene. Thus, rather than just viewing a pre-rendered scene in a movie from a pre-determined perspective, a user may step into and explore the scene from different angles, and may wander around the scene at will within the scope of the model to discover parts of the scene that are not visible in the original video.

Real-time exploration of video content

A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to select and manipulate objects within a scene, and to modify an object by adding or removing accessories from the object or otherwise customizing the object according to the user's preferences or desires. The RVE system may also provide an interface or interfaces via which the user can obtain additional information for the object, customize the object, be given a price or price(s) for the object as customized, and purchase the object as specified if desired.

Object customization and accessorization in video content

Technologies are disclosed for relaying availability information using a virtual assistant. The virtual assistant can serve as a personal assistant to a user and receive and provide availability information associated with a user. The availability information may include information such as, but not limited to location information about the user, timing information, (e.g., a time the user left), message information (e.g., a message left by the user, a message left by a person looking for the user, . . . ), and the like. The availability information that is provided by the virtual assistant may be different depending on the identity of the requesting user. The virtual assistant may also record messages from requesting users that may be provided to the user upon return and/or while the user is away (e.g., via email, text message, instant message, phone call, and the like).

Relaying availability using a virtual assistant

A game spectating system that leverages game metadata to allow spectators to join or 'step into' games being broadcast. Broadcast content may include user interface elements via which spectators can order, purchase, or otherwise obtain demo or full versions of games. Game client software and game data may be obtained and downloaded to the spectator's devices via the spectating system interfaces and broadcast streams. Spectators can order, purchase, or otherwise obtain characters, avatars, and gear for participation in particular games. Using the spectating UI to obtain the game client software, game data, characters, and gear via the broadcast streams, the spectators may join live game sessions of online games, start new game sessions, and/or replay previously recorded game sessions.

Joining games from a spectating system

Techniques for selecting a meeting to join in response to a voice command from a user are described herein. A user may utter a voice command to 'join my meeting' and, in response, the techniques may access a calendar associated with the user to identify the call-in information used to join the meeting. If the calendar indicates that the user is listed as an invitee for multiple meetings at the current time, then the techniques may analyze an array of criteria to determine which meeting the user most likely would like to join.

Selecting meetings based on input requests

Systems and methods are disclosed related to determining device settings for a meeting based in part by parsing text from a meeting invitation or calendar entry, and controlling one or more remotely controllable devices during the meeting according to the determined settings. Based on contextual information determined from a parsed meeting invitation and/or related sources, controllable devices such as remote-controllable window shades, lighting equipment, camera equipment, display screens and/or other in-room equipment may be automatically assigned to determined settings before or during an in-person meeting, conference call or videoconference.

Device control based on parsed meeting information

Growing community of inventors

Seattle, WA, United States of America

Collin Charles Davis