Google Inc.

Emily Hou

Eric Hc Liu

Chaitanya Gharpure

Evan Jarman Fisher

Victoria Fang

Peng Yang

The disclosure provides technology for enhancing the ability of a computing device to detect when a user has discontinued reading a text source. An example method includes receiving audio data comprising a spoken word associated with a text source, comparing the audio data with data of the text source, determining, based on the comparing, whether a segment of the audio data corresponds to a location of the text source, and responsive to determining that the segment of the audio data does not correspond to a location of the text source, transmitting a signal indicating that a user has discontinued reading the text source, the signal causing to cease the comparing of the audio data with the data of the text source.

Algorithmic determination of a story readers discontinuation of reading

The disclosure provides technology for enhancing the ability of a computing device to detect when a user has discontinued reading a text source. An example method includes receiving audio data comprising a spoken word associated with a text source, wherein the audio data comprises a first duration and a second duration; comparing the audio data with data of the text source, wherein the first duration of the audio data corresponds with the data of the text source; calculating, by a processing device, a correspondence measure between the second duration of the audio data and the data of the text source; and responsive to determining the correspondence measure satisfies a threshold, transmitting a signal to cease comparing audio data with the data of the text source.

The disclosure provides technology for enhancing the ability of a computing device to conserve computing resources while providing special effects that are aligned with a text source being read aloud. An example method includes identifying effects data for a text source, wherein the effects data correlates a physical effect with an audible action of a user; receiving audio data comprising a plurality of audible actions, wherein at least one of the plurality of audible actions comprises a spoken word of the text source; determining, by a processing device, that a triggering condition pertaining to the effects data and the text source is satisfied; loading content for the physical effect prior to an occurrence of the audible action, and providing the physical effect to modify an environment of the user.

Detection of story reader progress for pre-caching special effects

An example method for identifying a reading location in a text source as a user reads the text source aloud includes determining phoneme data of the text source, the text source comprising a sequence of words; receiving audio data comprising a spoken word associated with the text source; comparing, by a processing device, the phoneme data of the text source and phoneme data of the audio data; and identifying a location in the sequence of words based on the comparing phoneme data.

Reading progress estimation based on phonetic fuzzy matching and confidence interval

The disclosure provides technology for enabling a computing device to provide context sensitive special effects that supplement a text source as it is read aloud. An example method includes receiving, by a processing device, audio data comprising a spoken word of a user, analyzing contextual data associated with the user, determining a match between the audio data and data of a text source; and initiating a physical effect in response to the determining the match, wherein the physical effect corresponds to the text source and is based on the contextual data.

Dynamic adjustment of story time special effects based on contextual data

The disclosure provides technology for enhancing the ability of a computing device to conserve computing resources while providing special effects that are aligned with a text source being read aloud. An example method includes identifying effects data for a text source, wherein the effects data correlates a physical effect with an audible action of a user; receiving audio data comprising a plurality of audible actions, wherein at least one of the plurality of audible actions comprises a spoken word of the text source; determining, by a processing device, a triggering condition based on the effects data and the text source; responsive to satisfying the triggering condition, loading content for the physical effect, wherein the triggering condition is satisfied prior to the occurrence of the audible action; and providing the physical effect to modify an environment of the user.

Growing community of inventors

Mountain View, CA, United States of America

Emily Hou