Roku, Inc.

Apple Inc.

Robert Caston Curtis

Brian Thoft Moth Møller

Mark Ely

Andrey Eltsov

Kasper Andersen

Frank Maker

Gregory Medding

Mark Janossy

Rafal Krzysztof Malewski

Thomas Richard Henry Dewey

David H Friedman

Mike Kristoffersen

Rafal Zwierz

Stephen Brian Lynch

Sunil Ramesh

Jeffery Theodore Lee

Gregory Mack Garner

Hung A Pham

Michael Cutter

David Stern

Karina Levitian

Paul Nangeroni

Erwin B Bellers

Joseph R Fisher, Jr

Joseph R Fisher

Gunes Dervisoglu

Patrick Alan Brouillette

Jonathan M Beard

Ralph Birt

Philip Golyshko

Shachar Ron

Chintan S Parikh

Mustafa Ozgen

Alan Robert Bithell

Raf Zwierz

Rafal Malewski

System, apparatus, article of manufacture, method and/or computer program embodiments are provided for determining a presentation configuration of content. An example method can include determining information about primary content displayed on a first display and an environment of the first display, the information including a display configuration of the primary content, a characteristic of the primary content, and/or an indication whether a user is present in the environment and/or the environment includes a second display coupled to a client or a different client that is coupled to the client; based on the information, determining a different display configuration for displaying the secondary content; and based on the different display configuration, generating an instruction to display the secondary content at the second display or on an ROI at the first display, the ROI excluding the primary content or including a portion of the primary content having a saliency below a threshold.

Intelligent and adjustable configuration and presentation of media content

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for a voice command recognition system (VCR). An example embodiment operates by receiving a voice command directed to controlling a device, the voice command including a wake command and an action command. An amplitude of the wake command is determined. A gain adjustment for the voice command is calculated based on a comparison of the amplitude of the wake command to a target amplitude. An amplitude of the action command is adjusted based on the calculated gain adjustment for the voice command based on the comparison of the amplitude of the wake command to the target amplitude. A device command for controlling the device is identified based on the action command comprising the adjusted amplitude. The device command is provided to the device.

Voice command recognition system

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for modifying one or more parameters of a data streaming payload to add optimized display and/or audio settings as metadata. An example embodiment operates by training and operating a first machine learning model to predict optimized picture and sound settings. A second embodiment operates by training a learning model with crowdsourced individual user manual adjustments to the display device display during playback. Having the optimized display settings in advance allows adjustments to be made in advance of playback.

Content classifiers for automatic picture and sound modes

A method for dynamically controlling enhancement of an audio stream is provided, where the audio stream defines a sequence of audio segments over time. Each audio segment defines a waveform having a plurality of waveform attributes. For each audio segment of the sequence of audio segments, the method includes: (i) determining a set of waveform-attribute values of the audio segment's waveform attributes, (ii) computing a first distance between the determined set of waveform-attribute values and a first predefined set of waveform-attribute values representative of speech, and computing a second distance between the determined set of waveform-attribute values and a second predefined set of waveform-attribute values representative of music, (iii) using the computed first and second distances as a basis to classify the audio segment as primarily speech or rather primarily music, and (iv) controlling, based on the classifying, whether or not to enhance the audio segment for output.

Automatic classification of audio content as either primarily speech or primarily non-speech, to facilitate dynamic application of dialogue enhancement

Embodiments included herein generally relate to using non-audio data embedded in an audio signal. More particularly, embodiments relate to using non-audio data embedded into the audio signal to control an audio configuration of a plurality of speakers and/or to measure a delay of a playback device.

Using non-audio data embedded in an audio signal

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for identifying electronic devices in a room using a spread code. In some embodiments, a first electronic device receives a spread spectrum signal from a second electronic device over an audio data channel. The first electronic device determines a time of receipt of the spread spectrum signal based on despreading. The first electronic device calculates a distance between the first electronic device and the second electronic device based on the time of receipt and a time of transmission. The first electronic device determines the second electronic device is not in the room with the first electronic device based on the calculated distance.

Identifying electronic devices in a room using a spread code

Described herein are various embodiments for network-based audio playback. An embodiment operates by determining that a media device is configured to stream audio content to one or more wireless speakers over a first wireless network. A second wireless network over which the media device is configured to stream the audio content to the one or more wireless speakers is established by the media device. A signal to the one or more wireless speakers to switch from the first wireless network to the second wireless network is provided by the media device. The audio is provided to the wireless speakers for playback over the second wireless network.

Network-based audio playback

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for selecting a digital assistant from among multiple digital assistants. An embodiment operates by receiving a voice input containing a trigger word at a first voice adapter associated with a digital assistant that generates a first confidence score for the trigger word. The embodiment further receives the voice input at a second voice adapter that generates a second confidence score for the trigger word. The embodiment determines the first confidence score is higher than the second confidence score. The embodiment selects the digital assistant based on the determining.

Trigger word detection with multiple digital assistants

Embodiments included herein generally relate to managing low frequencies of an output signal. For example, a method may include: measuring a sound pressure level (SPL) of a speaker; dynamically selecting a cutoff frequency for operating a first filter configured to provide a first bass component of a bass element of an output signal and a second filter configured to provide a second bass component of the bass element; providing the cutoff frequency to the first filter to configure the first filter to generate the first bass component based on the cutoff frequency; providing the cutoff frequency to the second filter to configure the second filter to generate the second bass component based on the cutoff frequency; and generating an output signal based on at least one of the first and second bass components.

Managing low frequencies of an output signal

Apparatus, systems, and methods are disclosed for cancellation and content recognition of audio received over a High-Definition Multimedia Interface (HDMI)/Audio Return Channel (ARC) port of a display device. The media device receives audio over the HDMI/ARC port from the display device, processes the audio by identifying, decoding, re-encoding, and fingerprinting the audio with identification information, and subsequently streams the audio within the media streaming environment, including to external speakers, such as voice-enabled speakers. Based on the identification information and recognized content of the processed audio, the media device offers additional content for streaming to a user. The media device continuously monitors for spoken voice received over a voice-enabled speaker while the media device simultaneously receives, processes, and streams audio from the display device. By cancelling the part of the streaming audio received simultaneously with the spoken voice received, the media device enables the voice-enabled speaker to distinguish a voice command.

Audio cancellation and content recognition of audio received over HDMI/ARC

System, method, and various embodiments for providing a speaker audio configuration system are described herein. An embodiment operates by identifying an external speaker connected to an audio device. Second capability information for the external speaker is retrieved and user input indicating a relative position of the external speaker to the internal speaker is received. An audio configuration for the external speaker is calculated based on the second capability information and the relative position of the external speaker. The calculated audio configuration is provided to the external speaker. The external speaker is configured to receive and audibly output audio from the audio device based on the audio configuration.

Speaker audio configuration system

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for synchronizing playback of audiovisual content among multiple speakers. In some embodiments, a first smart speaker receives a spread spectrum signal from a second smart speaker over an audio data channel. The first smart speaker despreads the spread spectrum signal based on a spreading code. The first smart speaker determines a time of receipt of the spread spectrum signal based on the despreading. The first smart speaker receives a time of transmission of the spread spectrum signal. The first smart speaker then calculates a playback delay based on the time of receipt and the time of transmission. Then the first smart speaker controls the playback of the audiovisual content based on the playback delay.

Wireless audio synchronization using a spread code

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for synchronizing playback of audiovisual content with a dumb speaker. In some embodiments, a display device transmits a spread spectrum signal to a dumb speaker over a data channel using a spread spectrum code. The display device then receives the spread spectrum signal from the dumb speaker over an audio data channel. The display device despreads the spread spectrum signal based on the spreading code. The display device determines a time of receipt of the spread spectrum signal. The display device calculates an audiovisual output path delay for the dumb speaker based on the time of receipt and a time of transmission. The display device then synchronizes the playback of the audiovisual content at the dumb speaker and a smart speaker based on the audiovisual output path delay.

Growing community of inventors

Los Gatos, CA, United States of America

Robert Caston Curtis