Google Inc.

Matterport, Inc.

Arraiy, Inc.

Daniel A Aden

Arshan Poursohi

Matthew W Amacker

Paul Vincent Byrne

Greg Joseph Klein

Steve Scott Tompkins

Paul Du Bois

Charles Robert Barker

Gary R Bradski

Ethan Rublee

Moshe Benezra

Sumit Jain

A method includes receiving, from a subscriber device, a request including virtual region characteristics and an occupancy threshold, and determining, using image data captured by a camera and the virtual region characteristics, a virtual region corresponding to a portion of a physical region within a field of view of the camera. The virtual region is smaller than the physical region. The method also includes determining, using the image data, an occupancy of the virtual region and determining that the occupancy of the virtual region satisfies the occupancy threshold. In response to determining that the occupancy of the virtual region satisfies the occupancy threshold, the method also includes generating a notification to the subscriber device.

Trigger regions

Example implementations may relate to methods and systems for detecting an event in a physical region within a physical space. Accordingly, a computing system may receive from a subscriber device an indication of a virtual region within a virtual representation of the physical space such that the virtual region corresponds to the physical region. The system may also receive from the subscriber a trigger condition associated with the virtual region, where the trigger condition corresponds to a particular physical change in the physical region. The system may also receive sensor data from sensors in the physical space and a portion of the sensor data may be associated with the physical region. Based on the sensor data, the system may detect an event in the physical region that satisfies the trigger condition and may responsively provide to the subscriber a notification that indicates that the trigger condition has been satisfied.

This disclosure is directed to a hardware system for inverse graphics capture. An inverse graphics capture system (IGCS) captures data regarding a physical space that can be used to generate a photorealistic graphical model of that physical space. In certain approaches, the system includes hardware and accompanying software used to create a photorealistic six degree of freedom (6DOF) graphical model of the physical space. In certain approaches, the system includes hardware and accompanying software used for projection mapping onto the physical space. In certain approaches, the model produced by the IGCS is built using data regarding the geometry, lighting, surfaces, and environment of the physical space. In certain approaches, the model produced by the IGCS is both photorealistic and fully modifiable.

Hardware system for inverse graphics capture

Systems are provided to emit, into an environment of interest, information in the form of modulated optical signals. These optical signals can be provided as illumination from a lighting fixture, display, or other source of environmental illumination. The optical signals can include codes or other information to facilitate location-specific operations of a device that is able to receive the optical signals. This can include receiving information about the location of a light emitter, security credentials or encryption keys, information about services that are available from building automation and/or conferencing systems, or other location-related information. A cellphone or other device receiving such optical signals could then operate to request information related to the received information, to submit commands to control a presentation or conferencing system, to communicate in a secure manner using a received cryptographic key, or to operate in some other way related to location-related information received via optical signals.

Communication to device through lighting control

Serial communication to device through lighting control

Examples relating to the detection of rigid shaped objects are described herein. An example method may involve a computing system determining a first point cloud representation of an environment at a first time using a depth sensor positioned within the environment. The computing system may also determine a second point cloud representation of the environment at a second time using the depth sensor. This way, the computing system may detect a change in position of a rigid shape between a first position in the first point cloud representation and a second position in the second point cloud representation. Based on the detected change in position of the rigid shape, the computing system may determine that the rigid shape is representative of an object in the environment and store information corresponding to the object.

Detection of rigid shaped objects

Example systems and methods are disclosed for determining the direction of an actor based on image data and sensors in an environment. The method may include receiving point cloud data for an actor at a location within the environment. The method may also include receiving image data of the location. The received image data corresponds to the point cloud data received from the same location. The method may also include identifying a part of the received image data that is representative of the face of the actor. The method may further include determining a direction of the face of the actor based on the identified part of the received image data. The method may further include determining a direction of the actor based on the direction of the face of the actor. The method may also include providing information indicating the determined direction of the actor.

System and method for using image data to determine a direction of an actor

Example systems and methods are disclosed for associating detected attributes with an actor. An example method may include receiving point cloud data for a first actor at a first location within the environment. The method may include associating sensor data from an additional sensor with the first actor based on the sensor data being representative of the first location. The method may include identifying one or more attributes of the first actor based on the sensor data. The method may include subsequently receiving a second point cloud representative of a second actor at a second location within the environment. The method may include determining, based on additional sensor data from the additional sensor, that the second actor has the one or more attributes. The method may include providing a signal indicating that the first actor is the second actor based on the second actor having the one or more attributes.

System and method to obtain and use attribute data

Systems are provided to facilitate imaging of a person or other target in an environment by providing modulated illumination to the target and to other aspects of the environment. Modulated illumination is provided to the target such that the target receives more illumination when a camera is capturing images of the target than during other periods of time. Modulated illumination is provided to background objects or other portions of the environment of the target such that the background or other non-target elements of the environment receive less illumination when the camera is capturing images than during other periods of time. In this way, imaging of a target can be improved by increasing effective illumination of the target while decreasing glare and other effects of illumination of background objects. The illumination can be modulated at a sufficiently high frequency that the illumination appears, to the human eye, to be substantially constant.

Growing community of inventors

Redwood City, CA, United States of America

Daniel A Aden