Google Inc.

X Development LLC

Verily Life Sciences LLC

Aether Inc.

Max Benjamin Braun

Indika Charles Mendis

Nirmal Jitendra Patel

Steven John Lee

Thad Eugene Starner

Ryan M Geiss

Gabriel Taubman

Hayes Solos Raffle

Harvey Ho

Bradley J Rhodes

Sergey Brin

Liang-Yu Tom Chi

Aaron Joseph Wheeler

Michael Patrick Johnson

Mat Balez

Richard Dennis The

Chris McKenzie

Casey Kwok Ching Ho

Alexander Hanbing Chen

Jerrica Jones

Peter Malkin

Xiaoyu Miao

Brian Otis

Michael J Lebeau

Joshua N Haddock

Mitchell Joseph Heinrich

Luis Ricardo Prada Gomez

Nathan M Pletcher

Babak Amirparviz

Adrian Wong

Alejandro Jose Kauffmann

Matthew Ryan Casey

Meltem Oktem

Casey Ho

Liang-Lu (Tom) Chi

A method may involve, for each of one or more messages that are selected from a plurality of messages from an account: (a) extracting one or more phrases from a respective selected message; (b) determining that a conversation includes the respective selected message and one or more other messages from the plurality of messages; (c) generating a first feature vector based on the conversation, wherein the first feature vector includes one or more first features, wherein the one or more first features include one or more words from the conversation; and (d) generating, by a computing system, one or more training-data sets, wherein each training-data set comprises one of the phrases and the first feature vector. The method may further involve: training, by the computing system, a machine-learning application with at least a portion of the one or more training-data sets that are generated for the one or more selected messages; applying the trained machine-learning application to process an incoming message to the account; and responsive to applying the trained machine-learning application, determining one or more reply messages corresponding to the incoming message, wherein the one or more reply messages include at least one of the extracted one or more phrases.

Message suggestions

Methods, systems, and apparatus, including computer-readable storage devices, for managing voice interface devices. In some implementations, messages are received from a plurality of devices, each of the messages indicating a respective voice input detected by the device that sent the message. Audio signatures are obtained for the voice inputs detected by the plurality of devices. The audio signatures for the voice inputs and times that the voice inputs were detected are evaluated. Based on the evaluation, at least some of the plurality of devices are grouped to form a group of multiple devices that detected a same user utterance. A device from the group is selected to respond to the user utterance, and the multiple devices in the group are managed so that only the selected device outputs a synthesized speech response to the user utterance.

Managing voice interface devices

Embodiments are directed to a method and apparatus for displaying information on and interacting with a mirror. An embodiment includes a method of triggering a digital assistant by recognizing a face, the method comprising using a camera to constantly process frames, detecting a face in the frames, comparing the detected face to a set of known authorized faces, determining if the face is an authorized face, and triggering a digital assistant that can access the data of the authorized face. Additional features include combining two-way mirrors with displays, computing hardware, cameras, speakers, and LED lights. In another aspect, the present disclosure is directed to a smart mirror displaying information to a user. This includes detecting the user and displaying information to the user through LED status lights, display device, and augmented reality filter overlays.

Face recognition triggered digital assistant and LED light ring for a smart mirror

An eye-mountable device including a lens including a polymeric material, the lens operable to be removably mounted over a corneal surface of an eye and to be compatible with a motion of an eyelid when the concave surface is so mounted; a sensor coupled to the lens and operable to provide output data indicative of whether an eyelid of an eye on which the lens is mounted is closed; and a display operable to display a light signal in response to the output data from the sensor that the eyelid is closed. A method including determining whether an eyelid of a wearer of an eye-mountable device is closed; and when an eyelid of a wearer is closed, sending a light signal from the eye-mountable device.

Eyes closed interface

Methods and systems involving the orienting of video data based on the orientation of a display are described herein. An example system may be configured to (1) receive first video data, the first video data corresponding to a first orientation of the image-capture device; (2) send the first video data to a second computing device; (3) receive, from the second computing device, first orientation data indicating a requested orientation of the image-capture device; (4) cause a visual depiction of the requested orientation to be displayed on a graphical display; (5) receive second video data, the second video data corresponding to a second orientation of the image-capture device, where the second orientation is closer to the requested orientation than is the first orientation; and (6) send the second video data to the second computing device.

Orientation of video based on the orientation of a display

Methods and systems for hands-free browsing in a wearable computing device are provided. A wearable computing device may provide for display a view of a first card of a plurality of cards which include respective virtual displays of content. The wearable computing device may determine a first rotation of the wearable computing device about a first axis and one or more eye gestures. Based on a combination of the first rotation and the eye gestures, the wearable computing device may provide for display the navigable menu, which may include an alternate view of the first card and at least a portion of one or more cards. Then, based on a determined second rotation of the wearable computing device about a second axis and based on a direction of the second rotation, the wearable computing device may generate a display indicative of navigation through the navigable menu.

Methods and systems for hands-free browsing in a wearable computing device

Disclosed herein are methods and corresponding systems for facilitating a live registry event between a shopper and one or more remote viewers. In the live registry event, the shopper, registers for gifts that they would like to receive while sharing their registering experience with the viewers in real-time. When the user registers for an item, a server system allows the viewers to purchase the gift for the shopper.

Experience sharing for a registry event

Embodiments may be implemented by a computing device, such as a head-mountable display or mobile phone, in order to pre-emptively warm up the device's camera, when it is probable that a user will be taking a photo. An illustrative method involves a computing device (a) receiving sensor data from one or more sensors associated with the computing device, wherein the computing device comprises an image-capture device, (b) analyzing the sensor data to detect at least one pre-image-capture signal, wherein the at least one pre-image-capture signal indicates a subsequent image-capture signal is likely to be received, and (c) in response to detecting the at least one pre-image-capture signal, causing the computing device to initiate an image-capture preparation process that prepares the image-capture device to capture an image.

Preparation of image capture device in response to pre-image-capture signal

A method implemented at least in part on a head-mountable device (HMD) may involve: for each of one or more messages that are selected from a plurality of messages from an account: (a) extracting one or more phrases from a respective selected message; (b) determining that a conversation includes the selected message and one or more other messages from the plurality of messages; (c) generating a first feature vector based on the conversation; and (d) generating one or more training-data sets that include one or more of the phrases and the first feature vector. The method also includes training a machine-learning application with at least a portion of the one or more training-data sets, and applying the trained machine-learning application to process an incoming message and to determine one or more reply messages corresponding to the incoming message. The method may display the reply message(s) on a graphic display of the HMD.

Systems and methods for determining whether a point-of-interest (POI) corresponds to a tourist location are provided. A method includes receiving a set of assessments for the POI. Each assessment in the set of assessments includes an associated user account. Each assessment in the set of assessments includes a web-based assessment or an in-person assessment of the POI by the associated user account. The method also includes, for plural assessments in the set of assessments, determining whether the associated user account is a tourist user account or a local user account. The method also includes determining a touristiness value for the POI based on a number of in-person assessments including an associated tourist user account, a number of in-person assessments including an associated local user account, a number of web-based assessments including an associated tourist user account, or a number of web-based assessments including an associated local user account.

Determining relative interest levels of tourists and locals in points of interest

Methods, apparatus, and computer-readable media are described herein related to displaying and cropping viewable objects. A viewable object can be displayed on a display of a head-mountable device (HMD) configured with a hand-movement input device. The HMD can receive both head-movement data corresponding to head movements and hand-movement data from the hand-movement input device. The viewable object can be panned on the display based on the head-movement data. The viewable object can be zoomed on the display based on the hand-movement data. The HMD can receive an indication that navigation of the viewable object is complete. The HMD can determine whether a cropping mode is activated. After determining that the cropping mode is activated, the HMD can generate a cropped image of the viewable object on the display when navigation is complete.

Methods to pan, zoom, crop, and proportionally move on a head mountable display

In one aspect, an HMD is disclosed that provides a technique for generating a composite image representing the view of a wearer of the HMD. The HMD may include a display and a front-facing camera, and may be configured to perform certain functions. For instance, the HMD may be configured to make a determination that a trigger event occurred and responsively both generate a first image that is indicative of content displayed on the display, and cause the camera to capture a second image that is indicative of a real-world field-of-view associated with the HMD. Further, the HMD may be configured to generate a composite image that combines the generated first image and the captured second image.

Composite image associated with a head-mountable device

Methods and devices for providing a user-interface are disclosed. In one embodiment, a method is disclosed comprising receiving data corresponding to a first position of a wearable computing device and responsively causing the wearable computing device to provide a user-interface comprising a view region and a menu. The method further comprises receiving movement data corresponding to an upward movement of the wearable computing device to a second position above the first position and, based on the movement data, making a first determination that the upward movement has an upward angular velocity along an upward direction. The method further includes making a second determination that the upward angular velocity exceeds a threshold upward angular velocity and, responsive to the first and second determinations, causing the wearable computing device to move the menu such that the menu becomes more visible in the view region.

Growing community of inventors

San Francisco, CA, United States of America

Max Benjamin Braun