Sony Corporation

Sony Group Corporation

Sony Interactive Entertainment Inc.

Gregory Carlsson

James Richard Milne

Frederick J Zustak

Steven Richman

Keith Resch

Tonni Sandager Larsen

Allison Joi Burgueno

Peter Rae Shintani

Bibhudendu Mohapatra

Morio Usami

Oscar Manuel Vega

Justin Kenefick

Allison Burgueno

True Xiong

Charles McCoy

David Andrew Young

Norihiro Nagai

Hyehoon Yi

Tomohiro Koyata

Marvin DeMerchant

William Clay

Masaomi Nishidate

Kiyoto Shibuya

Wiliam Clay

A computer-implemented method performed on a user device includes wirelessly connecting a user device to an auditory device. The method further includes determining a type of auditory device wirelessly connected to the user device. The method further includes determining a type of action being performed by the user device. The method further includes transmitting an instruction to the auditory device to apply a first preset based on the type of auditory device and the type of action.

Auditory device source detection and response

A computer-implemented method includes downloading a hearing application. The method further includes providing a user interface that includes an option for a user associated with the user device to take a hearing test. The method further includes responsive to receiving a rejection of the option to take the hearing test, updating the user interface to include a list of user preferences. The method further includes receiving one or more user preferences from the user. The method further includes updating the user interface to include a set of profiles based on the one or more user preferences. The method further includes receiving a selection of a profile from the set of profiles. The method further includes instructing an auditory device to implement the selected profile.

Pre-made profiles for auditory devices

A remote commander (RC) for a TV or other entertainment system component has a microphone. A device can query the RC for its serial number, access the Internet with the serial number to look up characteristics of the microphone, and then knowing the characteristics, use the RC microphone to detect sound such as speaker test chirps to calibrate an audio system in a convenient and user-friendly manner while achieving the accuracy of calibration that can only be obtained by using a calibrated microphone system.

Using entertainment system remote commander for audio system calibration

A networked speaker system automatically adjusts certain audio speaker system settings based on whether the system is inside a building or has been moved outside as may be sensed by one or capacitors on a speaker. Also, techniques are described for adjusting speaker driver direction based on walls or other barriers in a room or based on the location of a listener.

Capacitive environmental sensing for a unique portable speaker listening experience

Concentric rings of speakers in a room are activated in sequence to emit test sounds that are picked up by microphones placed in the ears of a listener in the middle of the room. The output of the microphones is used to generate plural HRTF spheres that are concentric, and that can be convolved with each other to render a multi-distance HRTF filter that can be configured to 'move' the perceived distance and bearing of audio objects 'inside' the outer sphere as desired, without being restricted to placing the audio objects at the outer edges of a single sphere. Any desired placement of an audio object between spheres is done by interpolating between respective coefficients of the closest spheres.

Techniques combining plural head-related transfer function (HRTF) spheres to place audio objects

A head related transfer function (HRTF), which can be considered as biometric data is used to authenticate a user from whom the HRTF is derived. The HRTF may be used for authentication in combination with other biometric data such as retina scan or fingerprint to render two-factor biometric authentication. The HRTF used for authentication is encrypted for security.

Head related transfer function (HRTF) as biometric authentication

An audio reproduction device and method for audio control based on room-correction (RC) and head related transfer function (HRTF) are provided. The audio reproduction device includes a speaker that reproduces a first audio signal. The audio reproduction device receives a plurality of second audio signals indicative of frequency responses captured based on the first audio signal and captured by a plurality of audio capturing devices positioned on a head wearable device of a user present within an enclosed physical space. The audio reproduction device determines RC preset for one or more RC filters associated with the speaker, based on the captured frequency responses. The audio reproduction device further determines HRTF associated with the user based on the captured frequency responses, and user-specific information of the user. The audio reproduction device further controls audio reproduction of the speaker based on the determined RC preset and the determined HRTF.

Audio control based on room correction and head related transfer function

Audio speaker angular determination is made using sensor fusion technology involving an accelerometer, gyroscope, and magnetometer (compass). All speakers in an audio system use their magnetometers to determine their orientation relative to magnetic north. A group owner (typically the center channel or sound bar) gathers the orientation information from all speakers in the system. The group owner determines the angle of orientation of all speakers relative to its own orientation. Changes in angular orientation are sensed by the gyroscopes. For example, during calibration, the user can be told to rotate a certain speaker in the system, and the gyroscope measures the change and reports to the group owner. An indication is presented as to whether the new angle is good, or more is required. The gyroscope in combination with the accelerometer senses changes of angular orientation to aim height speakers downward towards the listening position or bottom speakers upward.

Angular sensing for optimizing speaker listening experience

An audio network box is provided as a master for a networked speaker system. The audio box can be configured with different combinations of modules to provide functionality as may be desired by an end user. The modules may include a power over Ethernet module, a wireless communication module/access point (AP) module, and an analog speaker module.

Networked speaker system with audio network box

An audio reproduction device and method for room correction based on occupancy determination is provided. The audio reproduction device includes a speaker which reproduces audio, and includes a memory which stores a plurality of room-correction (RC) presets. The audio reproduction of the speaker is controlled within an enclosed physical space based on each of the plurality of RC presets. The audio reproduction device receives an occupancy signal from at least one sensor communicatively coupled with the audio reproduction device. The audio reproduction device further determines a number of people of a set of people, present in the enclosed physical space, based on the received occupancy signal. The audio reproduction device retrieves first room-correction (RC) preset from the stored plurality of RC presets based on the determined number of people. The audio reproduction device further controls the audio reproduction of the speaker based on the retrieved first RC preset.

Room correction based on occupancy determination

A personalized HRTF is generated from a generic HRTF by having a person don headphones, then select a generic HRTF model from a list. Test signals emulating sounds from a source at a specific virtual speaker location are played on the headphones, and the person indicates where he thinks the emulated sounds are coming from. Any difference between the virtual speaker location and the 'heard' location is used to adjust the parameters (amplitude, phase, and frequency response) of the generic HRTF to render a HRTF personalized to the listening person.

Generating personalized end user head-related transfer function (HRTF) from generic HRTF

A cloud-based HRTF repository system that can be accessed via a public application program interface (API) on the remote repository server to permit individual users of audio-capable client devices to upload and store personalized HRTFs and basic device data in an open format. The cloud server repository includes a computer readable non-volatile memory which further includes a program memory portion comprising an application program interface (API) module configured for receiving HRTF data from a client device, or from a brand manufacturer, and for sending HRTF data to a client device. A brand manufacturer can upload HRTF data to the cloud-based HRTF repository system either directly from their branded companion app in a client device, or optionally via their own cloud server. One technique includes using a Media Service Provider (MSP) app in the client device with a provided server access library (SAL) thereby enabling retrieval of HRTF data for bath a personalized HRTF for any brand client device, or for retrieval of generalized HRTF data by brand manufacturers having a SAL in their brand server via the remote server repository public API.

Global HRTF repository

A networked speaker system includes plural speaker assemblies around the perimeter of a space with sound axes oriented up and inward into the space. Each speaker assembly includes an audio transducer to output demanded sound and a noise cancelation transducer which is driven to cancel sound from other speaker assemblies in the space based on signals from a microphone on the speaker assembly and location and device information from the other speaker assemblies.

Noise cancelation to minimize sound exiting area

A visual component is added to a 3D audio stream to present on a display at the player side a visual representation of objects in the 3D audio, enabling the user to better understand what is happening in the 3D audio experience. The visual representation may include visual objects with the same location and movement in 3D space as audio objects being played.

Video component in 3D audio

A personalized room related transfer function (RRTF) for sound bars and speakers within a specific room is generated without the need for photographs of the listener's head or microphones in a headphone apparatus. A smart device aids the listener in creating his own RRTF by enabling the listener to select a general RRTF model based on the specific sound bar setup (e.g., sound bar; sound bar+subwoofer; sound bar+rear speakers+height; etc.) from a set of general RRTFs downloaded locally or from the cloud. A test signal is played from a specific driver of the sound bar, and the listener identifies a location at which he would like the perceived sound to originate. If the driver location signal and desired location are not the same, the app adjusts parameters and replays the test signal until the driver signal and the desired location are the same.

Growing community of inventors

Santee, CA, United States of America

Gregory Carlsson