Essential Products, Inc.

Google Inc.

Danger, Inc.

Andrew E Rubin

David John Evans, V

Xiaoyu Miao

Matthew J Hershenson

Xinrui Jiang

Jason Sean Gagne-Keats

Joseph Anthony Tate

Mara Clair Segal

Manuel Roman

Dwipal Desai

Rebecca Schultz Zavin

Johan Schalkwyk

David P Conway

Michael Kolb

Maria Carolina Parada San Martin

Robert J Greenwalt, Iii

Sumit Agarwal

Joe Freeman Britt, Jr

Dipchand Nishar

Erick Tseng

Jaikumar Ganesh

Michael K Chan

David John Evans V

Timo A Bruck

William Francis Leggett

Wei Huang

Clement Puertolas

Maria Carolin Parada San Martin

James Jong-sik Kim

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining hotword suitability. In one aspect, a method includes receiving speech data that encodes a candidate hotword spoken by a user, evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, generating a hotword suitability score for the candidate hotword based on evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, and providing a representation of the hotword suitability score for display to the user.

Determining hotword suitability

Certain aspects of the technology disclosed herein integrate a camera with an electronic display. An electronic display includes several layers, such as a cover layer, a color filter layer, a display layer including light emitting diodes or organic light emitting diodes, a thin film transistor layer, etc. The camera can include a plurality of noncontiguous pixel regions disposed beneath the display layer and be configured to capture a plurality of images corresponding to the plurality of noncontiguous pixel regions. In some embodiments, the plurality of images can form a composite image with depth.

System comprising a display and a camera that captures a plurality of images corresponding to a plurality of noncontiguous pixel regions

Certain aspects of the technology disclosed herein integrate a camera with an electronic display. An electronic display includes several layers, such as a cover layer, a color filter layer, a display layer including light emitting diodes or organic light emitting diodes, a thin film transistor layer, etc. In one embodiment, the layers include a substantially transparent region disposed above the camera. The substantially transparent region allows light from outside to reach the camera, enabling the camera to record an image. In another embodiment, the color filter layer does not include a substantially transparent region, and the camera records the light from the outside colored by the color filter layer. According to another embodiment, while none of the layers include a substantially transparent region, the layers are all substantially transparent, and the camera disposed beneath the layers records light reaching the camera from outside.

Display device comprising a touch sensor formed along a perimeter of a transparent region that extends through a display layer and exposes a light sensor

Various embodiments concern sensors and other components that can be disposed beneath a variable transparency layer of a mobile device. By modifying how much voltage is applied to the variable transparency layer, a component, such as a camera, can be readily hidden when not in use. More specifically, the variable transparency layer may be substantially opaque when the camera is not in use and at least partially transparent when the camera is in use and ready to capture an image. The opacity level of the variable transparency layer can be modified by a voltage source that is electrically coupled to the variable transparency layer. The various levels of opacity could also enable the variable transparency layer to act as an electronic aperture for the camera.

Increasing display size by placing optical sensors beneath the display of an electronic device

Presented here is technology to efficiently process camera images to generate lead part artistic images and videos using an artificial intelligence module receiving inputs from multiple sensors. Multiple sensors can include a depth sensor, a conventional camera, and a motion tracker providing inputs to the artificial intelligence module. Based on the inputs, the artificial intelligence module can segment the received image and/or video into a foreground image and a background image to produce portrait imagery by blurring the background image and/or video. The artificial intelligence module can select the most aesthetically pleasing image from a video. In addition, the artificial intelligence module can adjust lighting in an image or video to create artistic lighting effects. All the processing can be done in real time due to efficient combination of artificial intelligence modules, traditional image processing techniques, and use of specialized hardware.

Intelligent camera

The disclosed embodiments include a light detection and ranging (LIDAR) system. The LIDAR system includes a modular LIDAR device, which includes a scanner component and a structurally separate base component. The scanner component is mountable on an external surface of a vehicle, and includes a light source and detector to capture LIDAR data including a measure of a distance to an object relative to the vehicle. The scanner component also includes a communications transmitter to transmit LIDAR data indicative of the distance, and a power receiver to wirelessly power the scanner component. The base component is at least partially mountable on an interior surface of the vehicle, and includes a power transmitter to wirelessly power the scanner component, a communications receiver to wirelessly receive the LIDAR data, and a processor to enable autonomous or semi-autonomous navigation of the vehicle based on processed LIDAR data.

Modular light detection and ranging device of a vehicular navigation system

The embodiments include a handheld mobile device (HMD) operable to cause a subsystem of a vehicle to perform a vehicular operation associated with an existing capability of the subsystem. The HMD includes a processor, a port operable to communicatively couple the HMD to an existing on-board computer of a vehicle via an existing data link connector of the vehicle, and a wireless interface operable to communicatively couple the HMD to at least one of the vehicle or a remote service. The HMD further includes a memory storing a software application that, when executed by the processor, causes the HMD to communicate a command to the on-board computer via the data link connector to perform the vehicular operation associated with the existing capability of the subsystem.

Handheld mobile device for adaptive vehicular operations

Home assistant device

Caller feedback in mobile devices, in which, upon receiving a telephone call from a caller, a user selection of a control is detected, and a message associated with the selected control is determined and automatically transmitted to the caller.

Caller feedback in mobile devices

In a computing system, information regarding a plurality of events that use a computing device is obtained, and a time-dependant increase in activity for each of at least some of the events is identified. An observed interest by a user in an event is correlated with an identified increase in activity for the event. Information about the activity at a time related to the event is provided for review by the user.

Providing digital content based on expected user behavior

Some embodiments include a mobile device with a light sensor overlaid under a display (e.g., a touchscreen). The mobile device can identify a command to capture an image. The mobile device can adjust at least a target portion of an opaqueness adjustable region of the display directly over the light sensor. The opaqueness adjustable region is capable of transforming from substantially opaque to substantially transparent. The mobile device can capture the image utilizing at least the light sensor while the target portion of the opaqueness adjustable region is substantially transparent.

Mobile device with display overlaid with at least a light sensor

Mobile device

The present disclosure contemplates a variety of improved methods and systems for creating a unique user experience using an ambient operating system connected to a variety of disparate IoT devices. The described solution includes a curated scene or set of actions initiated by an assistant device. For example, the assistant device detects it is a weekday morning and initiates actions associated with the wakeup routine such as opening the blinds, making coffee and notifying the user of the current traffic report.

System and method for generating machine-curated scenes

Growing community of inventors

Los Altos, CA, United States of America

Andrew E Rubin