Google Inc.

Massachusetts Institute of Technology

Canon Kabushiki Kaisha

Ankit Mohan

Christian Plagemann

Boris Smus

Ramesh Raskar

Shinsaku Hiura

Douglas Robert Lanman

James Edward Stewart

Siu-Kei Tin

George Alban Heitz

Ryan Michael Rifkin

John Jordan Nold

Rizwan Ahmed Chaudhry

Leon Tan

Vitor Pamplona

Quinn Smithwick

Grace Rusi Woo

Eric W Tramel

Manuel Menezes De Oliveira Neto

Joshua Fromm

Deepak Kundra

A method is performed at a system that comprises one or more video cameras and a remote server system. The method includes obtaining, via a video camera of the one or more video cameras, a continuous stream of video data for a scene. The video data stream comprises color video data in accordance with a determination that the scene has illumination above an illumination threshold and comprises infrared (IR) video data in accordance with a determination that the scene does not have illumination above the illumination threshold. The method includes colorizing the IR video data based on a subset of the color video data. The method further includes presenting the colorized video data to a user in real time.

Methods and systems for colorizing infrared images

Various arrangements for visual control of a network-enabled irrigation system are presented. In some embodiments, a video stream of an outdoor location that can include a lawn may be captured. The video stream of the outdoor location may be transmitted to a cloud-based irrigation management server system. The lawn may be monitored for a period of time using the video stream. Based on monitoring the lawn for the period of time, a visual change in a state of the lawn may be identified. Based on the visual change in the state of the lawn, an adjustment of an irrigation program of the network-enabled irrigation system may be determined. An irrigation control message may be transmitted to the network-enabled irrigation system that alters an irrigation schedule for the lawn.

Irrigation management via intelligent image analysis

Implementations of the disclosed subject matter provide techniques for improved identification of a gesture based on data obtained from multiple devices. A method may include receiving an indication of an onset of a gesture, from a first device, at a gesture coordinating device. Next, first subsequent data describing the gesture may be received from a second device, at the gesture coordinating device. Based on the indication and the first subsequent data, the gesture may be identified. In response to identification of the gesture, an action may be performed based on the gesture identified. In some cases, the gesture coordinating device may be a cloud-based device.

Gesture onset detection on multiple devices

The present disclosure provides techniques for improving IMU-based gesture detection by a device using ultrasonic Doppler. A method may include detecting the onset of a gesture at a first device based on motion data obtained from an IMU of the first device. An indication of the detection of the onset of the gesture may be provided to a second device. Next, a first audio signal may be received from the second device. As a result, the gesture may be identified based on the motion data and the received first audio signal. In some cases, a first token encoded within the first audio signal may be decoded and the first token may be provided to a third coordinating device. A confirmation message may be received from the third coordinating device based on the first token provided and identifying the gesture may be further based on the confirmation message.

Using ultrasound to improve IMU-based gesture detection

Systems and methods for capturing light field information including spatial and angular information using an image pickup device that includes an image sensor and at least one spatial light modulator (SLM) take multiple captures of a scene using the at least one SLM to obtain coded projections of a light field of the scene, wherein each capture is taken using at least one pattern on the at least one SLM, and recover light field data using a reconstruction process on the obtained coded projections of the light field.

Systems and methods for compressive light sensing using multiple spatial light modulators

In exemplary implements of this invention, a lens and sensor of a camera are intentionally destabilized (i.e., shifted relative to the scene being imaged) in order to create defocus effects. That is, actuators in a camera move a lens and a sensor, relative to the scene being imaged, while the camera takes a photograph. This motion simulates a larger aperture size (shallower depth of field). Thus, by translating a lens and a sensor while taking a photo, a camera with a small aperture (such as a cell phone or small point and shoot camera) may simulate the shallow DOF that can be achieved with a professional SLR camera. This invention may be implemented in such a way that programmable defocus effects may be achieved. Also, approximately depth-invariant defocus blur size may be achieved over a range of depths, in some embodiments of this invention.

Methods and apparatus for coordinated lens and sensor motion

In exemplary implementations, this invention is a tool for subjective assessment of the visual acuity of a human eye. A microlens or pinhole array is placed over a high-resolution display. The eye is brought very near to the device. Patterns are displayed on the screen under some of the lenslets or pinholes. Using interactive software, a user causes the patterns that the eye sees to appear to be aligned. The software allows the user to move the apparent position of the patterns. This apparent motion is achieved by pre-warping the position and angle of the ray-bundles exiting the lenslet display. As the user aligns the apparent position of the patterns, the amount of pre-warping varies. The amount of pre-warping required in order for the user to see what appears to be a single, aligned pattern indicates the lens aberration of the eye.

Near eye tool for refractive assessment

In an illustrative implementation of this invention, an optical pattern that encodes binary data is printed on a transparency. For example, the pattern may comprise data matrix codes. A lenslet is placed at a distance equal to its focal length from the optical pattern, and thus collimates light from the optical pattern. The collimated light travels to a conventional camera. For example, the camera may be meters distant. The camera takes a photograph of the optical pattern at a time that the camera is not focused on the scene that it is imaging, but instead is focused at infinity. Because the light is collimated, however, a focused image is captured at the camera's focal plane. The binary data in the pattern may include information regarding the object to which the optical pattern is affixed and information from which the camera's pose may be calculated.

Growing community of inventors

San Mateo, CA, United States of America

Ankit Mohan