Apple Inc.

Ntt Docomo, Inc.

Other

Sean Anthony Ramprashad

Haralabos Papadopoulos

Giuseppe Caire

Arvindh Krishnaswamy

Aram M Lindahl

Martin E Johnson

Harvey D Thornburg

Jae Woo Chang

Carlos M Avendano

Afrooz Family

Christopher M Garrido

Hooman Shirani-Mehr

Sylvain J Choisel

Daniel K Boothe

Ulas C Kozat

Vasu Iyengar

Patrick Miauton

Adam E Kriegel

Carl-Erik W Sundberg

Christine Pepin

Peter D Callaway

Hiroyuki Ishii

Anass Benjebbour

Christopher T Eubank

Jonathan D Sheaffer

Joshua D Atkins

Joseph M Williams

Karthick Santhanam

Juha O Merimaa

Robert Denton Silfvast

Qing Yang

Matthew S Connolly

Lalin S Theverapperuma

Austin W Shyu

Miquel Espi Marques

Chenwei Wang

David T Yeh

Sayandev Mukherjee

Kostyantyn Komarov

Lance Jabr

Nathan De Vries

Sriram Hariharan

Nicholas D Felton

Christopher John Sanders

Sean Boland Kelly

Gregory R Chapman

Esge Brandt Andersen

Johannes P Schmidt

Sorin V Dusan

Nikolas T Vitt

Vijay Sundaram

Neal D Evans

Symeon Delikaris Manias

Langford M Wasada

William M Bumgarner

Mitchell R Lerner

Tarun Pruthi

Ronald Nadim Isaac

Mehrez Souden

David P Saracino

Tony S Verma

James W VanDyke

Charles C Hoyt

Ming-Yang Chen

Darius A Satongar

Per Håkan Linus Persson

Jarrad A Stallone

Daniel H Lloyd

Christine Pépin

Xiaojun Tang

Danjue Li

A computer system outputs audio content via one or more audio output devices. If the audio content includes information that enables spatialization of the audio content, the system outputs the audio content in a simulated three-dimensional environment, including, if the audio content corresponds to a first category of content, causing the one or more audio output devices to simulate production of the audio content in a first virtual space, and if the audio content corresponds to a second category of content, causing the one or more audio output devices to simulate production of the audio content in a second virtual space that has different simulated acoustic properties than simulated acoustic properties of the first virtual space.

Systems, methods, and graphical user interfaces for using spatialized audio during communication sessions

Processing of ambience and speech can include extracting from audio signals, ambience and speech signals. One or more spatial parameters can be generated that define spatial characteristics of ambience sound in the one or more ambience audio signals. The primary speech signal, the one or more ambience audio signals, and the spatial parameters can be encoded into one or more encoded data streams. Other aspects are described and claimed.

Separating and rendering voice and ambience signals by offsetting impact of device movements

A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatially rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatially rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.

Spatial audio controller

A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatial rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatial rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.

A method performed by a processor of an electronic device. The method presents a computer-generated reality (CGR) setting including a first user and several other users. The method obtains, from a microphone, an audio signal that contains speech of the first user. The method obtains, from a sensor, sensor data that represents a physical characteristic of the first user. The method determines, based on the sensor data, whether to initiate a private conversation between the first user and a second user of the other users, and in accordance with a determination to initiate the private conversation, initiates the private conversation by providing the audio signal to the second user.

Private conversations in a virtual setting

A first device obtains, from the array, several audio signals and processes the audio signals to produce a speech signal and one or more ambient signals. The first device processes the ambient signals to produce a sound-object sonic descriptor that has metadata describing a sound object within an acoustic environment. The first device transmits, over a communication data link, the speech signal and the descriptor to a second electronic device that is configured to spatially reproduce the sound object using the descriptor mixed with the speech signal, to produce several mixed signals to drive several speakers.

Audio bandwidth reduction

A method performed by a processor of an audio source device. The method drives an audio output device of the audio source device to output a sound with an audio output signal. The method obtains a microphone signal from a microphone of the audio source device, the microphone signal capturing the outputted sound. The method determines whether the audio output device is a headset or a loudspeaker based on the microphone signal and configures an acoustic dosimetry process based on the determination.

System and method for determining audio output device type

Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing audio and/or video effects based at least in part on facial features and/or voice feature characteristics of the user. For example, video and/or an audio signal of the user may be recorded by a device. Voice audio features and facial feature characteristics may be extracted from the voice audio signal and the video, respectively. The facial features of the user may be used to modify features of a virtual avatar to emulate the facial feature characteristics of the user. The extracted voice audio features may modified to generate an adjusted audio signal or an audio signal may be composed from the voice audio features. The adjusted/composed audio signal may simulate the voice of the virtual avatar. A preview of the modified video/audio may be provided at the user's device.

Techniques for providing audio and video effects

A hybrid user equipment and advanced user equipment data offloading architecture is provided. In this hybrid architecture, the advanced user equipment includes a backhaul link to a telecommunication network and/or the Internet. The user equipment can send and receive data through the advanced user equipment using the backhaul link.

Enhanced local access in mobile communications

An aspect of this disclosure relates to noise and/or echo suppression for a device in which noise and echo suppression are adaptively determined as noise and echo change in an environment that surrounds the device. An aspect can use a skewed maximal ratio combining technique or a spatial filter with coefficients that are adaptively determined based on a perceptually selected target ratio that is compared to a ratio of sound energies/levels based on a pair of the coefficients. Another aspect relates to the use of information in one frequency band to perform additional noise and/or echo suppression in one or more adjacent frequency bands.

Joint spatial echo and noise suppression with adaptive suppression criteria

In some implementations, a computing device can calibrate media playback channels for presenting media content through a media system by determining the media propagation latency through the media system. For example, the computing device can send calibration content (e.g., audio data, video data, etc.) to various playback devices (e.g., playback channels) of the media system and record a timestamp indicating when the calibration content was sent. When the playback devices present the calibration content, a sensor device (e.g., remote control device, smartphone, etc.) can detect the presentation of the calibration content. The sensor device can send calibration data (e.g., media samples that may include the calibration content and/or a timestamp indicating when the media sample was detected by the sensor device) to the computing device. The computing device can determine the propagation latency (e.g., presentation delay) based on the calibration data received from the sensor device.

Calibrating media playback channels for synchronized presentation

A speech recognition system for resolving impaired utterances can have a speech recognition engine configured to receive a plurality of representations of an utterance and concurrently to determine a plurality of highest-likelihood transcription candidates corresponding to each respective representation of the utterance. The recognition system can also have a selector configured to determine a most-likely accurate transcription from among the transcription candidates. As but one example, the plurality of representations of the utterance can be acquired by a microphone array, and beamforming techniques can generate independent streams of the utterance across various look directions using output from the microphone array.

Multi-microphone speech recognition systems and related techniques

An audio system has a housing in which are integrated a number of microphones. A programmed processor accesses the microphone signals and produces a number of acoustic pick up beams based groups of microphones, an estimation of voice activity and an estimation of noise characteristics on each beam. Two or more beams including a voice beam that is used to pick up a desired voice and a noise beam that is used to provide information to estimate ambient noise are adaptively selected from among the plurality of beams, based on thresholds for voice separation and thresholds for noise-matching. Other embodiments are also described and claimed.

Coordination of beamformers for noise estimation and noise suppression

A network device in a wireless communication system includes a first communication circuit that receives a first control-plane message from a base station (BS) over a first communication link; a second communication circuit that transmits user-plane data to a user equipment (UE) over a second communication link established responsive to the first control-plane message; and a third communication circuit that receives the user-plane traffic data from a server over a third communication link. The UE communicates user-plane data with the BS and the network device simultaneously at a predetermined time. The first communication circuit receives a second control-plane message from the BS. The second communication circuit transmits a pilot signal to the UE responsive to the second control-plane message to enable the UE to measure a radio link quality of the second communication link using the pilot signal. The second communication link is maintained, at least in part, based on the radio link quality of the second communication link.

Enhanced local access in mobile communications using small node devices

Growing community of inventors

Los Altos, CA, United States of America

Sean Anthony Ramprashad