Visual perception and techniques for placing inventory into pods with a robotic workcell

Abstract

Techniques and systems for performing a perception analysis for a robotic stowing operation are described. An example technique includes obtaining, via multiple sensors, multiple first images, wherein each first image is an image of a different container of an inventory holder within a robotic workcell. A first machine learning (ML) and image processing pipeline is performed with the first images to determine displacement locations for the containers of the inventory holder. A second ML and image processing pipeline is performed with the first images to determine content signatures for the containers. A plan is generated for stowing a first item into a first container, based at least in part on the plurality of content signatures and the plurality of displacement locations. A robotic apparatus is controlled to stow the first item into the first container, based on the plan.