Aeye, Inc.

Joel David Benscoter

Luis Carlos Dussan

Allan Steinhardt

Philippe Feru

Igor Polishchuk

Alex Liang

Jordan Spencer Greene

Federico Presutti

Naveen Reddy

Il Woong Jung

Todd Gustavson

Disclosed herein are examples of ladar systems and methods where data about a plurality of ladar returns from prior ladar pulse shots gets stored in a spatial index that associates ladar return data with corresponding locations in a coordinate space to which the ladar return data pertain. This spatial index can then be accessed by a processor to retrieve ladar return data for locations in the coordinate space that are near a range point to be targeted by the ladar system with a new ladar pulse shot. This nearby prior ladar return data can then be analyzed by the ladar system to help define a parameter value for use by the ladar system with respect to the new ladar pulse shot. Examples of such adaptively controlled parameter values can include shot energy, receiver parameters, shot selection, camera settings, and others.

Adaptive control of ladar systems using spatial index of prior ladar return data

A lidar system that includes a laser source and a scannable mirror can also include a circuit that schedules a variable rate firing of a plurality of upcoming laser pulse shots by the laser source using a laser energy model as compared to a plurality of energy requirements applicable to the upcoming laser pulse shots, and wherein the laser energy model takes into consideration a retention of energy in the laser source after the upcoming laser pulse shots are fired and quantitatively predicts available energy amounts for the upcoming laser pulse shots from the laser source based on a history of prior laser pulse shots by the laser source. The laser energy model is capable of modeling the energy available for laser pulse shots in the laser source over very short time intervals (such as 10-100 nanoseconds).

Hyper temporal lidar with dynamic shot scheduling using a laser energy model

A lidar system comprises (1) an array of pixels for sensing incident light and (2) a circuit for processing a signal representative of the sensed incident light to detect a reflection of a laser pulse from a target within a field of view. The circuit can comprise a plurality of matched filters that are tuned to different reflected pulse shapes for detecting pulse reflections within the incident light, and wherein the circuit (1) applies the signal to the matched filters to determine an obliquity for the target based how the matched filters respond to the applied signal and (2) determines a correction angle based on the determined target obliquity, the correction angle for orienting the field of view to a frame of reference in response to a tilting of the lidar system. In an example embodiment, the circuit can comprise a signal processing circuit that performs the signal application and correction angle determination operations. In another example embodiment, the circuit can comprise (1) a signal processing circuit that performs the signal application operation and (2) a receiver controller circuit that performs the correction angle determination operation.

Hyper temporal lidar using multiple matched filters to orient a lidar system to a frame of reference

Ladar System with Intelligent Selection of Shot Patterns Based on Field of View Data A ladar transmitter that transmits ladar pulses toward a plurality of range points in a field of view can be controlled to target range points based on any of a plurality of defined shot patterns. Each defined shot pattern can be instantiated to identify various coordinates in the field of view that are to be targeted by a ladar pulses. A processor can process data about the field of view such as range data and/or camera data to make selections as to which of the defined shot patterns should be selected over time.

Ladar system with intelligent selection of shot patterns based on field of view data

Disclosed herein are examples of ladar systems and methods where data about a plurality of ladar returns from prior ladar pulse shots gets stored in a spatial index that associates ladar return data with corresponding locations in a coordinate space to which the ladar return data pertain. This spatial index can then be accessed by a processor to retrieve ladar return data for locations in the coordinate space that are near a range point to be targeted by the ladar system with a new ladar pulse shot. This nearby prior ladar return data can then be analyzed by the ladar system to help define a control parameter for use by the ladar receiver with respect to the new ladar pulse shot.

Adaptive ladar receiver control using spatial index of prior ladar return data

A lidar system having a lidar transmitter and lidar receiver that are in a bistatic arrangement with each other can be deployed in a climate-controlled compartment of a vehicle to reduce the exposure of the lidar system to harsher elements so it can operate in more advantageous environments with regards to factors such as temperature, moisture, etc. In an example embodiment, the bistatic lidar system can be connected to or incorporated within a rear view mirror assembly of a vehicle.

Bistatic lidar architecture for vehicle deployments

A lidar receiver that includes a photodetector circuit can be controlled so that the detection intervals used by the lidar receiver to detect returns from fired laser pulse shots are closely controlled. Such control over the detection intervals used by the lidar receiver allows for close coordination between a lidar transmitter and the lidar receiver where the lidar receiver is able to adapt to variable shot intervals of the lidar transmitter (including periods of high rate firing as well as periods of low rate firing). The lidar receiver can define the detection intervals based on a region in the field of view that a laser pulse shot is targeting (e.g., setting longer detection intervals for laser pulse shots targeting a horizon region, setting shorter detection intervals for laser pulse shots targeting a region that intersects within the ground within a relatively short distance of the lidar system).

Hyper temporal lidar with controllable detection intervals based on regions of interest

A lidar system that includes a laser source can be controlled to schedule the firing of laser pulse shots at range points in a field of view. As part of this scheduling, the system can prioritize which elevations will be targeted with shots before other elevations based on defined criteria. Examples of such criteria can include prioritizing elevations corresponding to a horizon, prioritizing elevations which contain objects of interest (e.g., nearby objects, fast moving objects, objects heading toward the lidar system, etc).

Hyper temporal lidar with elevation-prioritized shot scheduling

A lidar system comprises a lidar transmitter and a control circuit. The lidar transmitter fires laser pulse shots into a field of view and comprises a variable amplitude scan mirror for directing the laser pulse shots at targeted range points in the field of view (FOV). The control circuit (1) controls changes in a tilt amplitude of the variable amplitude scan mirror and (2) schedules the laser pulse shots according to a plurality of criteria, including criteria that take into account a settle time arising from controlled changes in the tilt amplitude. These controlled changes can include (1) a first tilt amplitude corresponding to a wide FOV coverage zone within the FOV and (2) a second tilt amplitude corresponding to a narrow FOV coverage zone within the FOV, wherein the second tilt amplitude is less than the first tilt amplitude.

Hyper temporal lidar with controllable tilt amplitude for a variable amplitude scan mirror

A lidar system that includes a laser source and transmits laser pulses produced by the laser source toward range points in a field of view via a mirror that scans through a plurality of scan angles can use (1) a laser energy model to model the available energy in the laser source over time and (2) a mirror motion model to model motion of the mirror over time. A shot list for the upcoming laser pulse shots that are modeled according to the laser energy and mirror motion models can further be controlled based on eye safety and/or camera safety models to prevent the lidar system firing too much laser energy into defined spatial areas over defined time periods and thus reduce the risk of damage to eyes and/or cameras in the field of view.

Hyper temporal lidar with dynamic laser control using safety models

A lidar receiver that includes a photodetector circuit can be controlled so that the detection intervals used by the lidar receiver to detect returns from fired laser pulse shots are closely controlled. Such control over the detection intervals used by the lidar receiver allows for close coordination between a lidar transmitter and the lidar receiver where the lidar receiver is able to adapt to variable shot intervals of the lidar transmitter (including periods of high rate firing as well as periods of low rate firing). The detection intervals can vary across different shots, and at least some of the detection intervals can be controlled to be of different durations than the shot intervals that correspond to such detection intervals.

Hyper temporal lidar with asynchronous shot intervals and detection intervals

A lidar system comprises a first lens, a second lens, and a switch. The first lens has a first field of view that receives incident light from the first field of view. The second lens has a second field of view that receives incident light from the second field of view, wherein the second field of view is encompassed by and narrower than the first field of view. The switch controls which of the first and second lenses are used for detecting returns from laser pulse shots based on where the laser pulse shots are targeted in a field of view that encompasses the first and second fields of view. The switch may comprise an optical switch or an electronic switch.

Switchable multi-lens Lidar receiver

A lidar system comprises a photodetector circuit and a signal processing circuit. The photodetector circuit comprises an array of pixels for sensing incident light. The signal processing circuit processes a signal representative of the sensed incident light to detect a reflection of a laser pulse from a target within a field of view. The signal processing circuit can comprise a plurality of matched filters that are tuned to different reflected pulse shapes for detecting pulse reflections within the incident light, and wherein the signal processing circuit applies the signal to the matched filters to determine an obliquity for the target based how the matched filters respond to the applied signal.

Hyper temporal lidar using multiple matched filters to determine target obliquity

A lidar system that includes a laser source and a scannable mirror can be controlled to adaptively schedule the firing of laser pulse shots at range points in a field of view. A first plurality of laser pulse shots that are fired during a scan of the mirror in a first scan direction can trigger the detection of a region of interest in the field of view. In response to this detection, a second plurality of laser shots targeting the region of interest can be scheduled for the next return scan of the mirror in the opposite direction.

Hyper temporal lidar with detection-based adaptive shot scheduling

A lidar system includes a lidar transmitter and a control circuit. The lidar transmitter can controllably fire a plurality of laser pulse shots into a field of view, and the control circuit can (1) detect a target based on a return from a laser pulse shot fired at a first shot angle, and (2) in response to the detected target, (i) schedule a pulse burst to be fired at the target, wherein the pulse burst comprises a second laser pulse shot to be fired at a second shot angle and a third laser pulse shot to be fired at a third shot angle, wherein the first shot angle is between the second and third shot angles, and (ii) control the lidar transmitter to fire the scheduled pulse burst.

Growing community of inventors

Pleasanton, CA, United States of America

Joel David Benscoter