Amazon Technologies, Inc.

David Chiapperino

Kyle Michael Roche

Christine Morten

Timothy Kellogg

Christopher Russell Chiappone

Farah Lynn Houston

J C Connors

Vasily Vasinov

Marc Randall Whitten

Paul A Larpenteur

Leo Chan

Alain Dessureaux

Johannes Seifert

Kathleen Alison Curry

Jason W Bay

Systems and methods for device integration in augmented reality environments are disclosed. For example, prior to an AR session being initiated, smart devices within a physical environment where the AR session is to be utilized may be identified and selected based on the functionality of the smart devices and the capabilities of an AR application associated with the AR session. Location information about the smart devices may also be determined and this information may be utilized to generate configuration data, which may be used by the AR application to cause device state transitions on the smart devices in response to events that occur in an AR environment of the AR session.

Device integration in augmented reality environment

This disclosure describes, in part, techniques and systems for generating and outputting immersive, multi-device content items in user environment, such as connected homes, offices, and the like. For example, the techniques and systems may output different portions of content on different devices within a user environment based on information such as respective capabilities of the devices, a current location of the user within the environment, a time of day, which user(s) are present in the environment, and/or the like.

Coordinating content-item output across multiple electronic devices

Functionality is disclosed herein for using a framework for a VR/AR application to utilize different services. In some configurations, a VR/AR application can utilize different services, such as an animation service, a multi-modal disambiguation service, a virtual platform service, a recognition service, an automatic speech recognition (ASR) service, a text-to-speech (TTS) service, a search service, as well as one or more other services. Instead of a developer of the VR/AR application having to develop programming code to implement features provided by one or more of services, the developer may utilize functionality of existing services that are available from a service provider network.

Virtual spaces as a platform

A technology is described for streaming object data for a virtual object to a simulation client and dynamically incorporating the virtual object into a simulation environment in response to detecting an interactive event in the simulation environment. An example method may include receiving an indication of an interactive event associated with a simulation environment, where the indication of the interactive event may be sent over a network by a simulation client configured to execute the simulation environment. In response to receiving the indication of the interactive event, object data for a virtual object linked to the interactive event may be identified. An audio stream for the virtual object may be obtained, and the object data and the audio stream may be streamed to the simulation client and the virtual object may be incorporated in the simulation environment.

Streaming virtual objects for incorporation in virtual environments

Disambiguation of virtual reality information using multi-modal data including speech

One or more services may generate audio data and animations of an avatar based on input text. A speech input ingestion (SII) service may identify tags of objects in a virtual environment and associate tags of those objects with words in the input text, which may be stored as metadata in speech markup data. This association may enable an animation service to generate gestures toward objects while animating an avatar, or may be used to create animations or effects of the object. The SII service may analyze input text to identify dialog including multiple speakers associated with the text. The SII service may create metadata to associate certain words with respective speakers (avatars) of those words, which may be processed by the animation service to animate multiple avatars speaking the dialog.

Using dialog and contextual data of a virtual reality environment to create metadata to drive avatar animation

Processing speech to drive animations on avatars

A technology is described for simulating communication expressions detected in speech data using virtual objects. An example method may include receiving speech data for a virtual object configured to simulate communication expressions provided by the speech data. The speech data may be analyzed for an indicator of a communication expression and communication mark data that includes an expression tag representing the communication expression may be generated. The speech data and the communication mark data may be transmitted to a simulation client to enable synchronization of an animated expression for the virtual object with the speech data using the expression tag in the communication mark data.

Simulating communication expressions using virtual objects

Growing community of inventors

Seattle, WA, United States of America

David Chiapperino