Apple Inc.

Stephen E Pinto

Christopher T Eubank

Matthew S Connolly

Yasser Rihan

Chad Himeda

Avi Bar-Zeev

Rahul Nair

Tomlinson M Holman

Bruno M Sommer

Frank Angermann

Lilli Ing-Marie Jonsson

Edwin Iskandar

Charles Magahern

Igor L Gorelik

A method performed by a first device that has an internal clock. The method transmits a signal to a second device to share a clock of the first device. The method presents an extended reality (XR) environment and plays back audio content on the first electronic device, wherein the XR environment is also presented and the audio content is played back on the second electronic device The method generates timebase information that includes a first timebase that that defines a relationship between the shared clock and internal clock and a second timebase that defines a relationship between the first timebase and a playback state of the audio content. The method transmits the timebase information to the second device that synchronizes the playback state of the audio content in the second device, with the playback state of the audio content in the first device.

Method and system for time-aligned audio playback

A method performed by a first electronic device. The method generates, at the first electronic device that is sharing a global clock with a second electronic device, a first timebase information that includes a first timebase that defines a relationship between the shared clock and an internal clock of the first electronic device, the first timebase information for synchronizing playback of a first piece of media content associated with a first application between the first and second electronic devices. The method receives, from a second application, a second timebase information that includes a second timebase that defines a relationship between the first timebase and a second piece of media content, generates a third timebase information that includes the first timebase and the second timebase, and transmits the third timebase information to the second electronic device.

Method and system for time-aligned media playback

A device can receive an audio signal and determine a measure of correlation between the audio signal and a microphone signal. The audio signal can be attenuated based on the measure of correlation. The audio signal can be used to drive one or more speakers of the device. Other aspects are described and claimed.

Audio-based presence detection

Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.

Spatial audio navigation

An audio asset library containing audio assets formatted in accordance with a file format for spatial audio includes asset metadata that enables simulated reality (SR) application developers to compose sounds for use in SR applications. The audio assets are formatted to include audio data encoding a sound capable of being composed into a SR application along with asset metadata describing not only how the sound was encoded, but also how a listener in SR environment experiences the sound. A SR developer platform is configured so that developers can compose sound for SR objects using audio assets stored in the audio library, including editing the asset metadata to include transformation parameters that support dynamic transformation of the asset metadata in the SR environment to alter how the SR listener experiences the composed sound. Other embodiments are also described and claimed.

File format for spatial audio

Channels of audio data in a spatial audio object are associated with any one or more of a direction and a location of one or more recorded sounds, which channels are to be reproduced as spatial sound. A visualized spatial sound object represents a snapshot/thumbnail of the spatial sound. To preview the spatial sound (by experiencing its snapshot or thumbnail), a user manipulates the orientation of the visualized spatial sound object, and a weighted downmix of the channels is rendered for output as a spatial preview sound, e.g., a single output audio signal is provided to a spatial audio renderer; one or more of the channels that are oriented toward the user are emphasized in the preview sound, more than channels that are oriented away from the user. Other aspects are also described and claimed.

Spatial audio downmixing

The present disclosure relates to providing a multi-user computer generated reality ('CGR') session. In some embodiments, a first electronic device displays a CGR environment, wherein the CGR environment is responsive to input from the first electronic device and a second electronic device, wherein the second device is external to the first device. While displaying the CGR environment, the device obtains a first scene graph from a process executing on the first device, wherein the first scene graph includes information for rendering a first entity, and obtains a second scene graph from a process executing on the second device, wherein the second scene graph includes information for rendering a second entity. The first electronic device updates the displayed CGR environment based on the first scene graph and the second scene graph, wherein the displayed CGR environment includes a visual representation of the first and a visual representation of the second entity.

Multi-user computer generated reality platform

Spatial audio upmixing enables mixing spatial sound on a more granular per-channel level than is possible using conventional upmixing. A spatial bed is a multi-channel audio content that represents a complete sound field description, e.g., a virtual sphere of sound, for example surrounding a simulated reality listener in a simulated reality environment. A new spatial bed is generated by combining sections of at least two of such spatial beds. Other embodiments are also described and claimed.

Growing community of inventors

Sunnyvale, CA, United States of America

Stephen E Pinto