Google Inc.

Other

Dongeek Shin

Michael D Dixon

Shwetak N Patel

Yash Modi

Andrea Colaco

Andrew William Goldenson

Ghulam Ahmed Kirmani

Shahram Izadi

Brian Mitchell Silverstein

Adam Duckworth Mittleman

Ivan Poupyrev

Mark Rajan Malhotra

William Raeming Dong

Jacobi Colton Grillo

Mark Kraz

Jason Conrad Chamberlain

Daniel Patrick Foran

Lauren Francine Chanen

Gwendolyn Van Der Linden

Sofien Bouaziz

Brandon Charles Barbello

George Alban Heitz

Paul Joseph Silberschatz

Steven L Goldberg

Steven Benjamin Goldberg

Konstantine Nicholas John Tsotsos

David Kim

Gabriel Fisher Slotnick

William James Biederman

Todd Whitehurst

Rajeev Conrad Nongpiur

Adarsh Prakash Murthy Kowdle

Lu Gao

Wei Li

Alex Finlayson

Daniel Biran

David Fichou

Bao-Tram Phan Nguyen

Stiven Guillaume Francois Morvan

Anupam Pathak

Jingying Hu

Jian Guo

Ricardo John Campbell

Jake Garrison

Tianyu Xu

Anuva Kulkarni

Rizwan Ahmed Chaudhry

Juston Payne

Chetan Pitambar Bhole

Kevin Neal Hayes

Ashton Udall

Ding Xu

Shiblee Imtiaz Hasan

James Paul Tobin

Lidan Mu

Ajay Kannan

David Carl Janssens

Jeffrey Yu

Zhifeng Cai

Raymond Reynolds Hayes

Reena Singhal Lee

Srivatsan Varadharajan

Jian Cui

Tinglin Duan

Jennifer Irturk

Seyed Farbod Taghizadeh Motlagh

Li-Te Cheng

Desmond Chik

Xiuxiu Yuan

Adam James Banfield

Yu Wen

Vaibhav Darbari

Isaac Allen Fehr

Sean Kyungmok Bae

Ken Mixter

Andrew Christopher Felch

Jennifer Yeelam Wong

Described techniques enable the use of ambisonics encoding/decoding for spatially accurate sound reproduction that is low-latency and that conserves computational and battery resources. Different sounds sources may be encoded using different ambisonics encoding orders, with higher order encoding being used to process sound from a sound source of current attention of a user, and lower order encoding being used to process other sound sources, such as background sound sources.

Saliency-based mixed-order ambisonics encoding of multiple sound sources for immersive spatial audio

A method for separating target speech from background noise contained in an input audio signal includes receiving the input audio signal captured by a user device, wherein the input audio signal corresponds to target speech of multiple words spoken by a target user and containing background noise in the presence of the user device while the target user spoke the multiple words in the target speech. The method also includes receiving a sequence of time markers input by the target user in cadence with the target user speaking the multiple words in the target speech, and correlating the sequence of time markers with the input audio signal to generate enhanced audio features that separate the target speech from the background noise in the input audio signal. The method also includes processing, using a speech recognition model, the enhanced audio features to generate a transcription of the target speech.

Speech recognition using word or phoneme time markers based on user input

Described techniques capture a first image of a scene using a first device and cause a second device to capture a second image of the scene. A distance between the first device and the second device may be determined, and a spatial image of the scene may be generated using the first image, the second image, and the distance.

Multi-device image capture for image effects

Improved techniques of generating photographs using a camera or other image capture device includes the use of 'soft' indicators such as haptics, audio, heads-up display, and other modalities to warn the user of a potential occlusion before a user activates a shutter trigger.

Closed loop photography

According to an aspect, a method may include generating, by an interface-guided diffusion model, a UI-compatible output image in response to one or more prompts including user-generated text and input condition data. The input condition data includes user interface (UI) layout information about at least one UI element included in an interface of an application. The method includes providing the UI-compatible output image to the application.

Application customization using an interface-guided diffusion model

Disclosed implementations provide a streamlined, assisted search process for surfacing items from a database that enables guided exploratory searching. For example, a system may receive selected content from a client device and determine a first object and a second object for the selected content using a search converter. The system may generate first results by performing a first search of items in a database using the first object as a query, and generate second results by performing a second search of the items in the database using the second object as a query. The system may select a first set of the first results based on relevance of the first object to the selected content and a second set of the second results based on relevance of the second object to the selected content. The system may provide a combined search result including the first set and the second set.

Assisted searching of non-document items

Implementations set forth herein relate to facilitating control of an automated assistant or other application by rendering an ultrasonic signal that can be modulation through tactile interaction with physical portions of a computing device. The computing device can provide an acoustic signal via a speaker of the computing device, and the acoustic signal can be received by one or more microphones of the computing device. During transmission, a portion of the acoustic signal can travel through a housing of the computing device, which the user can tap or otherwise use to provide a gesture. Audio data generated using the microphone can reflect changes to the acoustic signal, and those changes can be indicative of a particular gesture received at the housing. When a particular gesture is detected, the automated assistant or other application can respond to the gesture by initiating one or more particular operations.

Assistant control via detecting tactile modulation of ultrasonic signal

Various arrangements for performing ballistocardiography using a mobile device are presented. A radar integrated circuit of a mobile device may emit frequency-modulated continuous-wave (FMCW) radar. Reflected radio waves based on the FMCW radar being reflected off objects may be received and used to create a raw radar waterfall. The raw radar waterfall may be analyzed to create a ballistocardiography waveform. Data based on the ballistocardiography waveform may be output, such as to a machine-learning application installed on the mobile device.

Heart beat measurements using a mobile device

Implementations set forth herein relate to controlling invocation of an automated assistant according to whether a capacitive touch sensor array has detected a particular input that indicates a user has positioned an assistant-enabled device near their face. The capacitive touch sensor array can be part of a touch display interface of a portable computing device that provides access to an automated assistant. When the interface is positioned near the face of the user, input data from the interface can be processed to determine whether the input data indicates the display interface is near their face or whether the user is providing some other input to the display interface. When the input data indicates the user is positioning the display interface near their face or mouth, the automated assistant can be invoked in lieu of the user providing any other invocation input.

Selectively invoking an automated assistant according to a result of shape detection at a capacitive array

An electronic document is provided for presentation via a graphical user interface (GUI). A first region of the electronic document includes content objects. A second region of the electronic document includes a drawing object. A determination is made, based on first characteristics associated with the content objects and second characteristics associated with the drawing object, that the drawing object corresponds to the content objects. A mapping is generated between the content objects and the drawing object. A modification to the content objects in the first region of the electronic document is identified. In response to the modification to the content objects, a presentation of the drawing object in the second region of the electronic document is modified in view of the generated mapping.

Modifying the presentation of drawing objects based on associated content objects in an electronic document

Described techniques enable a virtual touchpad for a wearable device by receiving, in response to a touch event, a sensor signal from a motion sensor coupled to the wearable device, the wearable device providing a user interface with a rendering space that is defined relative to the wearable device. The touch event may be associated with a contact space of a contact map defined with respect to the wearable device, based on the sensor signal, and a user interface event of the user interface that corresponds to the contact space may be rendered within the rendering space.

Contact space determination for user interface control

Implementations relate to selecting a particular device, from an ecosystem of devices, to provide responses to a device-agnostic request of the user while a scenario is occurring. The user specifies a scenario and contextual features are identified from one or more devices of the ecosystem to generate scenario features indicative of the scenario occurring. The scenario features are stored with a correlation to a device that is specified by the user to handle responses while the scenario is occurring. When a subsequent device-agnostic request is received, current contextual features are identified and compared to the scenario features. Based on the comparison, the specified assistant device is selected to respond to the device-agnostic request.

Selecting a device to respond to device-agnostic user requests

A head-mounted display device may initiate display of a user interface on a display of the head-mounted display device. A head-mounted display device may compute an angular distance between a previous head orientation and a current head orientation based on head movement data. A head-mounted display device may apply a gain value to the angular distance to move a position indicator to an updated position within a boundary of the user interface, the user interface configured to remain fixed to a location in the display regardless of head movements.

Relative head-tracking for user-interface element selection on a head-mounted display device

Methods, devices, and media for sensing a touch on a display panel including an array of pixels. A method includes controlling first pixels to operate in an illumination state; controlling second pixels to repeatedly switch between operating in the illumination state and operating in a sensing state; generating sensing signals indicative of levels of light detected by the second pixels; detecting a touch input to the display panel based on the generated sensing signals; and in response to detecting the touch input to the display panel, changing at least one of (i) a frequency at which the second pixels switch between operating in the illumination state and in the sensing state, (ii) a duty cycle for operating the second pixels in the sensing state, or (iii) which of the pixels in the array of pixels are controlled to switch between operating in the illumination state and in the sensing state.

Touch-sensitive LED display

Techniques disclosed herein are directed towards pairing a first audio data stream of a first client device with a second audio data stream of a second client device based on identifying a user has imitated playback of media at the second client device, where the imitation of the playback by the user occurs at the first client device. Many implementations include the user controlling the media playback at the second client device using one or more automated assistant queries. Various implementations include deleting the pairing between the first audio data stream and the second audio data stream in response to determining whether one or more conditions have been satisfied (e.g., whether the user stops the playback, whether the first client device is a threshold distance away from the second client device, whether a period of time has elapsed, whether the entire media has played at the second client device, whether one or more additional or alternative conditions are satisfied, and/or combinations thereof).

Pairing audio data channels based on initiating, using a first client device, playback of media on a second client device

Growing community of inventors

Cambridge, MA, United States of America

Dongeek Shin