Three-dimensional imaging and sensing using a dynamic vision sensor and pattern projection

Abstract

The present disclosure generally relates to systems and methods for three-dimensional image sensing. More specifically, and without limitation, this disclosure relates to systems and methods for detecting three-dimensional images, and using asynchronous image sensors for detecting the same. In one implementation, at least one processor determines a plurality of patterns associated with a plurality of electromagnetic pulses emitted by a projector onto a scene; receives, from an image sensor, one or more first signals based on reflections caused by the plurality of electromagnetic pulses; detects one or more first events corresponding to one or more first pixels of the image sensor based on the received signals; based on the one or more first events, initializes one or more first events more state machines; receives, from the image sensor, one or more second signals corresponding to the reflections; detects one or more second events corresponding to one or more second pixels of the image sensor based on the received signals; determines candidates for connecting the one or more state machines more second events to the one or more first events; and determines three-dimensional points for the one or more first pixels and the one or more second pixels based on the candidates and the one or more state machines.