Zoox, Inc.

Zejia Zheng

Sarah Tariq

Derek Xiang Ma

Subhasis Das

Jeffrey Ronald Pyke

Techniques for using an inference wrapper to execute a machine learned model using various types of machine learning engines are disclosed. A resource allocator may interoperate with the inference wrapper to request the utilization of resources, such as memory, and generate and log utilization data. The utilization data can be used to generate visual representations of resource utilization that can then be used to improve resource allocation for machine learned models.

GPU resource usage tracking in machine-learned model execution system using inference wrapper

Techniques for maintaining and synchronizing data is a processing pipeline data between multiple processing units to improve a system latency are described herein. For example, the techniques may include determining, in response to an invocation of vision processing on first vision data stored in a first memory range in a first memory associated with a central processing unit (CPU), that second vision data stored in a second memory range in a second memory associated with a graphic processing unit (GPU) is a modified copy of the first vision data. The second vision data may be obtained using a non-blocking operation from the second memory range. The first vision data stored in the first memory range may be replaced with the second vision data obtained from the second memory range. The vision processing may then be performed using the second vision data stored in the first memory.

Vision architecture

Techniques are described for detecting whether a lane of a roadway is open or closed. Detecting a lane as being closed may include detecting an object in or near the lane, which may comprise determining a size, location, and/or classification associated with the object, and dilating the size associated with the object. The lane may be indicated as being closed if a distance between a dilated object detection and another object detection, dilated object detection, or lane extent is less than a threshold distance. The techniques may additionally or alternatively comprise determining an alternative lane shape based at least in part on one or more object detections and/or determining that one or more lanes are closed and/or uploading a lane closure and/or alternative lane shape to a central database for retrieval by/dissemination to other computing devices.

Growing community of inventors

Palo Alto, CA, United States of America

Zejia Zheng