Google Inc.

Other

Dongeek Shin

Michael D Dixon

Shwetak N Patel

Yash Modi

Andrea Colaco

Andrew William Goldenson

Ghulam Ahmed Kirmani

Shahram Izadi

Brian Mitchell Silverstein

Adam Duckworth Mittleman

Ivan Poupyrev

Mark Rajan Malhotra

William Raeming Dong

Jacobi Colton Grillo

Mark Kraz

Jason Conrad Chamberlain

Daniel Patrick Foran

Gwendolyn Van Der Linden

Lauren Francine Chanen

Sofien Bouaziz

Brandon Charles Barbello

George Alban Heitz

Paul Joseph Silberschatz

Steven L Goldberg

Steven Benjamin Goldberg

David Kim

Konstantine Nicholas John Tsotsos

William James Biederman

Todd Whitehurst

Rajeev Conrad Nongpiur

Adarsh Prakash Murthy Kowdle

Lu Gao

Wei Li

Daniel Biran

David Fichou

Bao-Tram Phan Nguyen

Alex Finlayson

Stiven Guillaume Francois Morvan

Jingying Hu

Anupam Pathak

Gabriel Fisher Slotnick

Jian Guo

Ricardo John Campbell

Anuva Kulkarni

Lidan Mu

Jake Garrison

Juston Payne

Rizwan Ahmed Chaudhry

Chetan Pitambar Bhole

Ashton Udall

Kevin Neal Hayes

Ding Xu

Shiblee Imtiaz Hasan

David Carl Janssens

James Paul Tobin

Ajay Kannan

Reena Singhal Lee

Srivatsan Varadharajan

Raymond Reynolds Hayes

Jeffrey Yu

Zhifeng Cai

Adam James Banfield

Jian Cui

Xiuxiu Yuan

Li-Te Cheng

Seyed Farbod Taghizadeh Motlagh

Tianyu Xu

Tinglin Duan

Yu Wen

Ken Mixter

Desmond Chik

Sean Kyungmok Bae

Isaac Allen Fehr

Vaibhav Darbari

Jennifer Yeelam Wong

Andrew Christopher Felch

Logan Schneider

Described techniques capture a first image of a scene using a first device and cause a second device to capture a second image of the scene. A distance between the first device and the second device may be determined, and a spatial image of the scene may be generated using the first image, the second image, and the distance.

Multi-device image capture for image effects

Improved techniques of generating photographs using a camera or other image capture device includes the use of 'soft' indicators such as haptics, audio, heads-up display, and other modalities to warn the user of a potential occlusion before a user activates a shutter trigger.

Closed loop photography

According to an aspect, a method may include generating, by an interface-guided diffusion model, a UI-compatible output image in response to one or more prompts including user-generated text and input condition data. The input condition data includes user interface (UI) layout information about at least one UI element included in an interface of an application. The method includes providing the UI-compatible output image to the application.

Application customization using an interface-guided diffusion model

Disclosed implementations provide a streamlined, assisted search process for surfacing items from a database that enables guided exploratory searching. For example, a system may receive selected content from a client device and determine a first object and a second object for the selected content using a search converter. The system may generate first results by performing a first search of items in a database using the first object as a query, and generate second results by performing a second search of the items in the database using the second object as a query. The system may select a first set of the first results based on relevance of the first object to the selected content and a second set of the second results based on relevance of the second object to the selected content. The system may provide a combined search result including the first set and the second set.

Assisted searching of non-document items

Implementations set forth herein relate to facilitating control of an automated assistant or other application by rendering an ultrasonic signal that can be modulation through tactile interaction with physical portions of a computing device. The computing device can provide an acoustic signal via a speaker of the computing device, and the acoustic signal can be received by one or more microphones of the computing device. During transmission, a portion of the acoustic signal can travel through a housing of the computing device, which the user can tap or otherwise use to provide a gesture. Audio data generated using the microphone can reflect changes to the acoustic signal, and those changes can be indicative of a particular gesture received at the housing. When a particular gesture is detected, the automated assistant or other application can respond to the gesture by initiating one or more particular operations.

Assistant control via detecting tactile modulation of ultrasonic signal

Various arrangements for performing ballistocardiography using a mobile device are presented. A radar integrated circuit of a mobile device may emit frequency-modulated continuous-wave (FMCW) radar. Reflected radio waves based on the FMCW radar being reflected off objects may be received and used to create a raw radar waterfall. The raw radar waterfall may be analyzed to create a ballistocardiography waveform. Data based on the ballistocardiography waveform may be output, such as to a machine-learning application installed on the mobile device.

Heart beat measurements using a mobile device

Implementations set forth herein relate to controlling invocation of an automated assistant according to whether a capacitive touch sensor array has detected a particular input that indicates a user has positioned an assistant-enabled device near their face. The capacitive touch sensor array can be part of a touch display interface of a portable computing device that provides access to an automated assistant. When the interface is positioned near the face of the user, input data from the interface can be processed to determine whether the input data indicates the display interface is near their face or whether the user is providing some other input to the display interface. When the input data indicates the user is positioning the display interface near their face or mouth, the automated assistant can be invoked in lieu of the user providing any other invocation input.

Selectively invoking an automated assistant according to a result of shape detection at a capacitive array

An electronic document is provided for presentation via a graphical user interface (GUI). A first region of the electronic document includes content objects. A second region of the electronic document includes a drawing object. A determination is made, based on first characteristics associated with the content objects and second characteristics associated with the drawing object, that the drawing object corresponds to the content objects. A mapping is generated between the content objects and the drawing object. A modification to the content objects in the first region of the electronic document is identified. In response to the modification to the content objects, a presentation of the drawing object in the second region of the electronic document is modified in view of the generated mapping.

Modifying the presentation of drawing objects based on associated content objects in an electronic document

Described techniques enable a virtual touchpad for a wearable device by receiving, in response to a touch event, a sensor signal from a motion sensor coupled to the wearable device, the wearable device providing a user interface with a rendering space that is defined relative to the wearable device. The touch event may be associated with a contact space of a contact map defined with respect to the wearable device, based on the sensor signal, and a user interface event of the user interface that corresponds to the contact space may be rendered within the rendering space.

Contact space determination for user interface control

Implementations relate to selecting a particular device, from an ecosystem of devices, to provide responses to a device-agnostic request of the user while a scenario is occurring. The user specifies a scenario and contextual features are identified from one or more devices of the ecosystem to generate scenario features indicative of the scenario occurring. The scenario features are stored with a correlation to a device that is specified by the user to handle responses while the scenario is occurring. When a subsequent device-agnostic request is received, current contextual features are identified and compared to the scenario features. Based on the comparison, the specified assistant device is selected to respond to the device-agnostic request.

Selecting a device to respond to device-agnostic user requests

A head-mounted display device may initiate display of a user interface on a display of the head-mounted display device. A head-mounted display device may compute an angular distance between a previous head orientation and a current head orientation based on head movement data. A head-mounted display device may apply a gain value to the angular distance to move a position indicator to an updated position within a boundary of the user interface, the user interface configured to remain fixed to a location in the display regardless of head movements.

Relative head-tracking for user-interface element selection on a head-mounted display device

Methods, devices, and media for sensing a touch on a display panel including an array of pixels. A method includes controlling first pixels to operate in an illumination state; controlling second pixels to repeatedly switch between operating in the illumination state and operating in a sensing state; generating sensing signals indicative of levels of light detected by the second pixels; detecting a touch input to the display panel based on the generated sensing signals; and in response to detecting the touch input to the display panel, changing at least one of (i) a frequency at which the second pixels switch between operating in the illumination state and in the sensing state, (ii) a duty cycle for operating the second pixels in the sensing state, or (iii) which of the pixels in the array of pixels are controlled to switch between operating in the illumination state and in the sensing state.

Touch-sensitive LED display

Techniques disclosed herein are directed towards pairing a first audio data stream of a first client device with a second audio data stream of a second client device based on identifying a user has imitated playback of media at the second client device, where the imitation of the playback by the user occurs at the first client device. Many implementations include the user controlling the media playback at the second client device using one or more automated assistant queries. Various implementations include deleting the pairing between the first audio data stream and the second audio data stream in response to determining whether one or more conditions have been satisfied (e.g., whether the user stops the playback, whether the first client device is a threshold distance away from the second client device, whether a period of time has elapsed, whether the entire media has played at the second client device, whether one or more additional or alternative conditions are satisfied, and/or combinations thereof).

Pairing audio data channels based on initiating, using a first client device, playback of media on a second client device

A method for a contextual assistant to use mouse pointing or touch cues includes receiving audio data corresponding to a query spoken by a user, receiving, in a graphical user interface displayed on a screen, a user input indication indicating a spatial input applied at a first location on the screen, and processing the audio data to determine a transcription of the query. The method also includes performing query interpretation on the transcription to determine that the query is referring to an object displayed on the screen without uniquely identifying the object, and requesting information about the object. The method further includes disambiguating, using the user input indication indicating the spatial input applied at the first location on the screen, the query to uniquely identify the object that the query is referring to, obtaining the information about the object requested by the query, and providing a response to the query.

Contextual assistant using mouse pointing or touch cues

Implementations relate to an automated assistant that can bypass invocation phrase detection when an estimation of device-to-device distance satisfies a distance threshold. The estimation of distance can be performed for a set of devices, such as a computerized watch and a cellular phone, and/or any other combination of devices. The devices can communicate ultrasonic signals between each other, and the estimated distance can be determined based on when the ultrasonic signals are sent and/or received by each respective device. When an estimated distance satisfies the distance threshold, the automated assistant can operate as if the user is holding onto their cellular phone while wearing their computerized watch. This scenario can indicate that the user may be intending to hold their device to interact with the automated assistant and, based on this indication, the automated assistant can temporarily bypass invocation phrase detection (e.g., invoke the automated assistant).

Bypassing hot word detection for an automated assistant based on device-to-device proximity

Growing community of inventors

Cambridge, MA, United States of America

Dongeek Shin