Amazon Technologies, Inc.

Christine Morten

Kyle Michael Roche

David Chiapperino

Christopher Russell Chiappone

Timothy Kellogg

Leo Chan

Kathleen Alison Curry

Functionality is disclosed herein for using a framework for a VR/AR application to utilize different services. In some configurations, a VR/AR application can utilize different services, such as an animation service, a multi-modal disambiguation service, a virtual platform service, a recognition service, an automatic speech recognition (ASR) service, a text-to-speech (TTS) service, a search service, as well as one or more other services. Instead of a developer of the VR/AR application having to develop programming code to implement features provided by one or more of services, the developer may utilize functionality of existing services that are available from a service provider network.

Virtual spaces as a platform

Disambiguation of virtual reality information using multi-modal data including speech

One or more services may generate audio data and animations of an avatar based on input text. A speech input ingestion (SII) service may identify tags of objects in a virtual environment and associate tags of those objects with words in the input text, which may be stored as metadata in speech markup data. This association may enable an animation service to generate gestures toward objects while animating an avatar, or may be used to create animations or effects of the object. The SII service may analyze input text to identify dialog including multiple speakers associated with the text. The SII service may create metadata to associate certain words with respective speakers (avatars) of those words, which may be processed by the animation service to animate multiple avatars speaking the dialog.

Using dialog and contextual data of a virtual reality environment to create metadata to drive avatar animation

Processing speech to drive animations on avatars

Growing community of inventors

Long Beach, CA, United States of America

Christine Morten