Google Inc.

Nvidia Corporation

Feng Yuan

Yuzhao Ni

Tomer Amarilio

Ronghui Zhu

Kaustubh Purandare

Nathaniel Nesiba

Bryan Allen

Anurag Jain

Jacky Cheung

Norbert Tydingco

Chunya Hua

Will Donnelly

Gregory Kielian

In various examples, a three-dimensional (3D) data processing pipeline for autonomous systems and applications is presented. Systems and methods are disclosed for 3D point cloud data processing fused with video analysis applications. Using the systems and methods described herein, processing of 3D data may be performed in different multimedia frameworks, allowing a user to use common libraries and/or to implement custom libraries on top of the existing system design. As a result, conventional 2D video processing may be combined with 3D data processing, to allow for data representing a flat 2D world to represent a rich 3D world. In this way, the fused 3D depth and/or range data with 2D camera image data allows for perception and/or vision that is more powerful, accurate, and precise.

Processing pipelines for three-dimensional data in autonomous systems and applications

In response to a user interacting with a tangible peripheral assistant control device (e.g., depressing a button of the device), causing an automated assistant to perform one or more actions. The action(s) performed can be based on input previously provided by the user in configuring the peripheral assistant control device. The action(s) performed in response to interaction with the peripheral assistant control device can vary based on one or more conditions, such as which user is currently active, where the peripheral assistant control device is currently located (which can optionally be inferred based on which of multiple assistant computing devices the button is paired with), and/or the current state of one or more smart devices and/or other devices (e.g., as determined based on a device topology). A utility of the peripheral assistant control device can be automatically extended beyond what was specifically requested by a user during configuration.

Conditionally assigning various automated assistant function(s) to interaction with a peripheral assistant control device

Growing community of inventors

Sunnyvale, CA, United States of America

Feng Yuan