Roblox Corporation

Philippe Clavel

David B Baszucki

Frederick Umminger

Morgan Samuel McGuire

Morgan Tucker

Mahesh Kumar Nandwana

Sandeep Kanumuri

Slawomir Strumecki

Plamen Dragozov

Pavel Pavlov

Joshua Ray Taylor

Hitesh Chhabra

Paul Kerr

Palmer Noel Hogen

Alex Zhukov

Jason Lawrence Golubock

David O'neal

Implementations described herein relate to methods, systems, and computer-readable media to provide spatialized audio in virtual experiences. The spatialized audio may be used in voice communications such as, for example, voice and/or video chats. The chats may include spatialized audio that is combined at a client device, or at an online experience platform, and is targeted to a particular user. Individual audio streams may be collected from a plurality of avatars and other objects, and combined based on the target user. The audio may also include background and/or ambient sounds to provide a rich, immersive audio stream in virtual experiences.

Spatialized audio chat in a virtual metaverse

A computer-implemented method to determine whether to introduce latency into an audio stream from a particular speaker includes an audio stream from a sender device. The method further includes providing, as input to a trained machine-learning model, the audio stream and a speech analysis score, information about one or more voice emotion parameters, and one or more voice emotion scores for a first user associated with the sender device, wherein the trained machine-learning model is iteratively applied to the audio stream and wherein each iteration corresponds to a respective portion of the audio stream. The method further includes generating as output, with the trained machine-learning model, a level of toxicity in the audio stream. The method further includes transmitting the audio stream to a recipient device, wherein the transmitting is performed to introduce a time delay in the audio stream based on the level of toxicity.

Artificial latency for moderating voice communication

Various input modes and output modes may be used for a three-dimensional (3D) environment. A user may use a particular input mode (e.g., text, audio, video, etc.) for animating a 3D avatar of the user in the 3D environment. The user may use a particular output mode (e.g., text, audio, 3D animation, etc.) in the presentation of the 3D environment. The input/output modes may change based on conditions such as a location of the user.

Integrated input/output (I/O) for a three-dimensional (3D) environment

Some implementations relate to methods, systems, and computer-readable media for providing audio for virtual experiences. In some implementations, a method includes receiving, at a server, a first request to generate a plurality of sounds for a user device, wherein the user device is associated with a virtual experience hosted by the server, obtaining, by the server, sound source data for a plurality of sound sources associated with the plurality of sounds, obtaining, by the server, virtual experience state information that comprises a location of a virtual microphone in the virtual experience and at least one of a velocity of the virtual microphone in the virtual experience or an orientation of the virtual microphone in the virtual experience, generating, by the server, an audio mix of the plurality of sounds based on the sound source data and the virtual experience state information, and transmitting the audio mix to the user device.

Distributed processing of sounds in virtual environments

Growing community of inventors

Belmont, CA, United States of America

Philippe Clavel