Plusai Limited

Other

David Wanqian Liu

Hao Zheng

Timothy Patrick Daly, Jr

Anurag Ganguli

Mianwei Zhou

Joanne Yang

Yi-Ming Qui

Timothy Patrick Daly Jr

Jr Timothy Patrick Daly

Jr Daly

The present teaching relates to system, method, medium for in-situ perception in an autonomous driving vehicle. A plurality of types of sensor data acquired continuously by a plurality of types of sensors deployed on the vehicle are first received, where the plurality of types of sensor data provide information about surrounding of the vehicle. Based on at least one model, one or more items are tracked from a first of the plurality of types of sensor data acquired by one or more of a first type of the plurality of types of sensors, wherein the one or more items appear in the surrounding of the vehicle. At least some of the one or more items are then automatically labeled on-the-fly via either cross modality validation or cross temporal validation of the one or more items and are used to locally adapt, on-the-fly, the at least one model in the vehicle.

Method and system for distributed learning and adaptation in autonomous driving vehicles

The present teaching relates to method, system, medium, and implementation of a global model update center. At least one model is established at the model update center for detecting objects surrounding each of autonomous driving vehicles of a fleet. A plurality of labeled data items are received, from the fleet of autonomous driving vehicles, where each of the labeled data items is detected, based on the at least one model, from sensor data characterizing surroundings of the autonomous driving vehicles. The labeled data items are generated automatically on-the-fly by the autonomous driving vehicles. Based on the received labeled data items, at least some of the models are updated and model update information is accordingly generated. Such generated model update information is then distributed to the fleet of autonomous driving vehicles.

Method and system for closed loop perception in autonomous driving vehicles

The present teaching relates to method, system, medium, and implementation of lane planning in an autonomous vehicle. Sensor data are received that capture ground images of a road the autonomous vehicle is on. Based on the sensor data, a current lane of the road that autonomous vehicle is currently occupying is detected. Information indicating presence of a passenger in the vehicle is obtained and used to retrieve a personalized lane control model related to the passenger. Lane control for the autonomous vehicle is planned based on the detected current lane and self-aware capability parameters in accordance with the personalized lane control model. The self-aware capability parameters are used to predict operational capability of the autonomous vehicle with respect to a current location of the autonomous vehicle. The personalized lane control model is generated based on recorded human driving data.

Method and system for personalized driving lane planning in autonomous driving vehicles

The present teaching relates to method, system, medium, and implementation of lane planning in an autonomous vehicle. Sensor data are received that capture ground images of a road the autonomous vehicle is on. Based on the sensor data, a current lane of the road that autonomous vehicle is currently occupying is detected. Lane control for the autonomous vehicle is planned based on the detected current lane and self-aware capability parameters in accordance with a driving lane control model. The self-aware capability parameters are used to predict operational capability of the autonomous vehicle with respect to a current location of the autonomous vehicle. The driving lane control model is generated based on recorded human driving data to achieve human-like lane control behavior in different scenarios.

Method and system for human-like driving lane planning in autonomous driving vehicles

The present teaching relates to method, system, medium, and implementation of in-situ perception in an autonomous driving vehicle. A plurality of types of sensor data are acquired continuously via a plurality of types of sensors deployed on the vehicle, where the plurality of types of sensor data provide information about surrounding of the vehicle. One or more items surrounding the vehicle are tracked, based on some models, from a first of the plurality of types of sensor data from a first type of the plurality of types of sensors. A second of the plurality of types of sensor data are obtained from a second type of the plurality of sensors and are used to generate validation base data. Some of the one or more items are labeled, automatically, via validation base data to generate labeled at least some item, which is to be used to generate model updated information for updating the at least one model.

Method and system for on-the-fly object labeling via cross modality validation in autonomous driving vehicles

The present teaching relates to generating an alert in a vehicle. First information indicating an upcoming switch in an operating mode of the vehicle is received, which specifies a set of tasks, arranged in an order, to be completed by a driver in the vehicle to achieve the upcoming switch, and a task duration for each of the set of tasks by which the task is to be completed. A current state of the driver is obtained and used to determine a set of warnings to alert the driver to perform the set of tasks. Each warning corresponds to a task in the set of tasks and is created based on the current state of the driver. A warning schedule is generated based on the set of warnings in the order of the set of tasks and transmitted so that warnings in the warning schedule are delivered to the driver.

Method and system for augmented alerting based on driver's state in hybrid driving

The present teaching relates to method, system, and medium, for generating an augmented alert in a hybrid vehicle. First information indicating an upcoming switch in an operating mode of the vehicle is received, which specifies a set of tasks, arranged in an order, to be completed by a driver in the vehicle to achieve the upcoming switch, and a task duration for each of the set of tasks by which the task is to be completed. A current state of the driver is obtained and used to determine a set of warnings to alert the driver to perform the set of tasks. Each warning corresponds to a task in the set of tasks and is created based on the current state of the driver. A warning schedule is generated based on the set of warnings in the order of the set of tasks and transmitted so that warnings in the warning schedule are delivered to the driver.

Antenna with bowtie sectors

The present teaching relates to a method, system, medium, and implementation of processing image data in an autonomous driving vehicle. Sensor data acquired by one or more types of sensors deployed on the vehicle are continuously received. The sensor data provide different information about surrounding of the vehicle. Based on a first data set acquired by a first sensor of a first type of the one or more types of sensors at a specific time, an object is detected, where the first data set provides a first type of information about the surrounding of the vehicle. Depth information of the object is then estimated via object centric stereo at object level based on the object detected as well as a second data set acquired by a second sensor of the first type of the one or more types of sensors at the specific time. The second data set provides the first type of information about the surrounding of the vehicle with a different perspective as compared with the first data set.

Method and system for object centric stereo in autonomous driving vehicles

The present teaching relates to method, system, medium, and implementation of automatic motion planning for an autonomous driving vehicle. Information is obtained with respect to a current location of the autonomous driving vehicle operating in a current vehicle motion, wherein the information is to be used to estimate the operational capability of the autonomous driving vehicle with respect to the current location. Sensor data are obtained, via one or more sensors in one or more media types. A reaction of a passenger present in the vehicle with respect to a current vehicle motion is estimated based on the sensor data. Motion planning is performed based on the information with respect to the current location and the reaction of the passenger to the current vehicle motion.

Method and system for adaptive motion planning based on passenger reaction to vehicle motion in autonomous driving vehicles

The present teaching relates to method, system, medium, and implementation of human-like vehicle control for an autonomous vehicle. Information related to a target motion to be achieved by the autonomous vehicle is received, wherein the information includes a current vehicle state of the autonomous vehicle. A first vehicle control signal is generated with respect to the target motion and the given vehicle state in accordance with a vehicle kinematic model. A second vehicle control signal is generated in accordance with a human-like vehicle control model, with respect to the target motion, the given vehicle state, and the first vehicle control signal, wherein the second vehicle control signal modifies the first vehicle control signal to achieve human-like vehicle control behavior.

Method and system for human-like vehicle control prediction in autonomous driving vehicles

The present teaching relates to method, system, and medium, for switching a mode of a vehicle. Real-time data related to the vehicle are received, which include intrinsic/extrinsic capability parameters, based on which a set of tasks to switch from a current mode to a different mode is determined. A first duration of time required for the switch is determined based on a first risk evaluated with respect to the current mode and the real-time data. A task duration time needed by a driver to complete the task is estimated for each of the set of tasks. A second risk for the switching is estimated based on the required first duration of time and a total task duration times needed to complete the set of tasks. The switch is carried out when the second risk satisfying a criterion.

Method and system for driving mode switching based on self-aware capability parameters in hybrid driving

The present teaching relates to method, system, and medium, for operating a vehicle. Real-time data related to the vehicle are received. A current mode of operation of the vehicle and a state of the driver present in the vehicle are determined. A first risk associated with the current mode of operation of the vehicle is evaluated based on the real-time data and the state of the driver in accordance with a risk model. In response to the first risk satisfying a first criterion, a second risk associated with switching the current mode to a different mode of operation of the vehicle is determined based on the state of the driver. The vehicle is switched from the current mode to the different mode when the second risk satisfies a second criterion.

Method and system for driving mode switching based on driver's state in hybrid driving

The present teaching relates to method, system, medium, and implementation of determining depth information in autonomous driving. Stereo images are first obtained from multiple stereo pairs selected from at least two stereo pairs. The at least two stereo pairs have stereo cameras installed with the same baseline and in the same vertical plane. Left images from the multiple stereo pairs are fused to generate a fused left image and right images from the multiple stereo pairs are fused to generate a fused right image. Disparity is then estimated based on the fused left and right images and depth information can be computed based on the stereo images and the disparity.

Growing community of inventors

Los Altos, CA, United States of America

David Wanqian Liu