Tusimple, Inc.

Ke Xu

Yi Wang

Yi Luo

Zehua Huang

Xue Mei

Bolun Zhang

Panqu Wang

Pengfei Chen

Xiaodi Hou

Mingdong Wang

Chenzhe Qian

Disclosed are devices, systems and methods for capturing an image. In one aspect an electronic camera apparatus includes an image sensor with a plurality of pixel regions. The apparatus further includes an exposure controller. The exposure controller determines, for each of the plurality of pixel regions, a corresponding exposure duration and a corresponding exposure start time. Each pixel region begins to integrate incident light starting at the corresponding exposure start time and continues to integrate light for the corresponding exposure duration. In some example embodiments, at least two of the corresponding exposure durations or at least two of the corresponding exposure start times are different in the image.

Adaptive illumination for a time-of-flight camera on a vehicle

A system is disclosed including at least one memory including computer program instructions, which when executed by at least one processor, cause the system to at least generate, based on a plurality of images from a camera, a first map including a first plurality of features; generate, based on data from a light ranging sensor, a second map including a second plurality of features; and determine, based on a comparison of the first plurality of features and the second plurality of features, a position of the first map relative to the second map. A corresponding method and non-transitory computer-readable medium are also provided.

Feature matching and correspondence refinement and 3D submap position refinement system and method for centimeter precision localization using camera-based submap and LiDAR-based global map

Techniques are described for estimating pose of a camera located on a vehicle. An exemplary method of estimating camera pose includes obtaining, from a camera located on a vehicle, an image including a lane marker on a road on which the vehicle is driven, and estimating a pose of the camera such that the pose of the camera provides a best match according to a criterion between a first position of the lane marker determined from the image and a second position of the lane marker determined from a stored map of the road.

Camera pose estimation techniques

A method of aligning optical axes of cameras for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs comprise instructions, which when executed by a computing device, cause the computing device to perform by one or more autonomous vehicle driving modules execution of processing of images using the following steps comprising: disposing a planar pattern that is viewable to a set of cameras; recovering boundary corner points of the planar pattern from a pair of images; constructing a pair of parallel lines based on 2D positions of the recovered boundary corner points; and determining an intersection point of the pair of parallel lines to be a vanishing point in a pixel coordinate.

Vanishing point computation and online alignment system and method for image guided stereo camera optical axes alignment

A method of localization for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs comprise instructions, which when executed by a computing device, cause the computing device to perform by one or more autonomous vehicle driving modules execution of processing of images from a camera and data from a LiDAR using the following steps comprising: computing, in response to features from a 3D submap and features from a global map, matching score between corresponding features of a same class between the 3D submap and the global map; selecting, for each feature in the 3D submap, a corresponding feature with the highest matching score from the global map; determining a feature correspondence to be invalid if a distance between corresponding features is larger than a threshold; and removing the invalid feature correspondence.

Feature matching and corresponding refinement and 3D submap position refinement system and method for centimeter precision localization using camera-based submap and LiDAR-based global map

A method of aligning optical axes of cameras for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs comprise instructions, which when executed by a computing device, cause the computing device to perform by one or more autonomous vehicle driving modules execution of processing of images using the following steps comprising: calibrating intrinsic parameters of a set of cameras; extracting corner points associated with a pattern; and computing a vanishing point based on information on the extracted corner points.

Corner point extraction system and method for image guided stereo camera optical axes alignment

A system for generating a ground truth dataset for motion planning is disclosed. The system includes sensors for data acquisition for motion planning of a vehicle, the sensors including a LiDAR; a calculating module configured to calculate LiDAR poses in response to data from the sensors and generate undistorted LiDAR scans; an extracting module configured to extract static points from a target undistorted LiDAR scan and generate a LiDAR static-scene point cloud; and a generating module configured to generate sparse image point correspondences for each pair of images, using the LiDAR static-scene point cloud.

Sensor calibration and time system for ground truth static scene sparse flow generation

A system and method for image localization based on semantic segmentation are disclosed. A particular embodiment includes: receiving image data from an image generating device mounted on an autonomous vehicle; performing semantic segmentation or other object detection on the received image data to identify and label objects in the image data and produce semantic label image data; identifying extraneous objects in the semantic label image data; removing the extraneous objects from the semantic label image data; comparing the semantic label image data to a baseline semantic label map; and determining a vehicle location of the autonomous vehicle based on information in a matching baseline semantic label map.

System and method for image localization based on semantic segmentation

A method of localization for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs comprise instructions, which when executed by a computing device, cause the computing device to perform by one or more autonomous vehicle driving modules execution of processing of images from a camera and data from a LiDAR using the following steps comprising: voxelizing a 3D submap and a global map into voxels; estimating distribution of 3D points within the voxels, using a probabilistic model; extracting features from the 3D submap and the global map; and classifying the extracted features into classes.

Growing community of inventors

San Diego, CA, United States of America

Ke Xu