Pony Ai Inc.

Pony Al Inc.

Kai Chen

Xiang Yu

Jun Peng

Tiancheng Lou

Hao Song

Yubo Zhang

Nengxiu Deng

Cheng Jin

Yiming Liu

Zuoteng Chen

Zhongnan Hu

Sinan Xiao

Pingfan Meng

Tianyi Li

Zhuo Zhang

Zhenhao Pan

Jianan Wang

Yin Zhong

Timofey Uvarov

Jie Hou

Stephen Lee

Zichao Qi

Wei-Yang Chiu

Zhou Zhang

Systems, methods, and non-transitory computer-readable media are provided for implementing a tracking camera system onboard an autonomous vehicle. Coordinate data of an object can be received. The tracking camera system actuates, based on the coordinate data, to a position such that the object is in view of the tracking camera system. Vehicle operation data of the autonomous vehicle can be received. The position of the tracking camera system can be adjusted, based on the vehicle operation data, such that the object remains in view of the tracking camera system while the autonomous vehicle is in motion. A focus of the tracking camera system can be adjusted to bring the object in focus. The tracking camera system captures image data corresponding to the object.

Systems and methods for implementing a tracking camera system onboard an autonomous vehicle

A computing system is implemented as part of a vehicle architecture. The computing system includes a computing component, a first computing node that includes a power distribution system, a second computing node that includes input/output (I/O) interfaces to connect to devices, actuators, or sensors, and a third computing node. The computing component further comprises one or more processors and instructions or logic that, when executed by the one or more processors, cause the computing component to perform, transmitting commands to the second computing node, the commands associated with initial processing of data received at the second computing node, receiving initially processed data from the second computing node, and performing further processing on the initially processed data.

Autonomous or semi-autonomous vehicle electronic architecture

Described herein are systems, methods, and non-transitory computer-readable media for self-detection of a fault condition by a vehicle component, generation of a device health code that includes multiple tiers of information relating to the fault condition experienced by the vehicle component, and broadcasting of the device health code to one or more other vehicle components via one or more vehicle communication networks. A recommended vehicle response measure indicated by a reaction code in the device health code can then be taken or alternate vehicle response may be selected and initiated based on an evaluation of current vehicle operational data.

Device-level fault detection

Described herein are systems, methods, and non-transitory computer-readable media for isolating commercial components from a harsh vehicle operating environment to increase the longevity of such components and to decrease their failure rate. Also described herein are systems, methods, and non-transitory computer-readable media for monitoring the operational health status of vehicle components for failure, and upon detecting failure of a component, initiating a processing task reassignment and fault recovery process. In this manner, processing load handled by the component prior to failure can be offloaded to one or more other vehicle components while a fault recovery process is initiated for the component. When the failed component is operational again, the vehicle may revert back to the task assignment in place prior to the component failure, may continue with the current task assignment, or may transition to another different task reassignment.

Autonomous driving vehicle health monitoring

Provided herein is a headlamp assembly comprising a housing that encloses: a sensor that acquires data associated with a surrounding environment; a light source that illuminates a field of view comprising a portion of the surrounding environment; and one or more processors that analyze the acquired data and determine a direction, field of view, power, or an intensity of the illumination of the portion based on the analyzed data.

Headlamp encapsulated with camera and artificial intelligence processor to adjust illumination

A set of sensor information may include first sensor information generated based on a first sensor of a first vehicle and second sensor information generated based on a second sensor of a second vehicle. Individual sensor information may characterize positions of objects in an environment of individual sensors. Relevant sensor information for a vehicle may be determined based on the set of sensor information and a position of the vehicle. The relevant sensor information may characterize positions of objects in a maneuver environment of the vehicle. A desired navigation of the vehicle in the maneuver environment of the vehicle may be determined based on the relevant sensor information. An instruction may be provided to the vehicle based on the desired navigation of the vehicle. The instruction may characterize one or more maneuvers to be performed by the vehicle to execute the desired navigation.

Distributed sensing for vehicle navigation

Described herein are systems, methods, and non-transitory computer-readable media for self-detection of fault conditions experienced by vehicle components, generation of device health codes indicative of the fault conditions, and broadcasting of the device health codes over mixed vehicle communication networks. The device health codes can be parsed to identify fault information, and the fault information can be assessed along with current vehicle operational data to determine a recommended vehicle response measure to one or more fault conditions experienced by one or more vehicle components.

Device health code broadcasting on mixed vehicle communication networks

A sensor enclosure comprises a cover and a structure. The structure can be encased by the cover. The structure comprises a frame, a ring, and one or more anchoring posts. The frame can be configured to mount one or more sensors. The ring, disposed peripherally to the frame, can be operatively coupled to the cover. The ring can include a drainage ring plate that drains rainwater accumulated on the cover away from the sensor enclosure. The one or more anchoring posts, disposed underneath the frame and the ring, can be used to anchor the sensor enclosure to a vehicle.

Sensor enclosure drainage

An adaptive filter system and a method for controlling the adaptive filter system are described herein. The system can includes one or more filters to attenuate incoming light. The one or more filters can be moved by one or more actuators. The method can capture image data from an imaging device through the one or more filters. Information can be determined from the captured image data. The one or more filters can be moved to a position for capturing image data based on the information.

Adaptive filter system for self-driving vehicle

Described herein are systems, methods, and non-transitory computer readable media for triggering a sensor operation of a second sensor (e.g., a camera) based on a predicted time of alignment with a first sensor (e.g., a LiDAR), where operation of the second sensor is simulated to determine the predicted time of alignment. In this manner, the sensor data captured by the two sensors is ensured to be substantially synchronized with respect to the physical environment being sensed. This sensor data synchronization based on predicted alignment of the sensors solves the technical problem of lack of sensor coordination and sensor data synchronization that would otherwise result from the latency associated with communication between sensors and a centralized controller and/or between sensors themselves.

Sensor triggering based on sensor simulation

A sensor enclosure comprising a domed cover and a base. The base can be encased by the domed cover. The base comprises an inner frame, an outer frame, one or more wipers, and a powertrain. The inner frame can provide surfaces for one or more sensors. The outer frame, disposed underneath the inner frame, the outer frame includes a slewing ring. The slewing ring comprises an inner ring to which the domed cover is attached and an outer ring attached to the outer frame. The one or more wipers extends vertically from the outer frame, each wiper having a first end attached to the outer frame and a second end attached to a support ring, and each wiper making a contact with the dome cover. The powertrain, disposed within the outer frame, configured to rotate the ring and the dome cover attached to the inner ring.

Alternative wiper mechanism to remove rainwater on a sensor enclosure

Autonomous headlamp encapsulated with camera and artificial intelligence processor to adjust illumination

Systems, methods, and non-transitory computer readable media may be configured to characterize optical characteristics of optical elements. An optical element mount may be configured to carry an optical element. A calibration display may be configured to display a calibration object. The calibration object may include a known visual pattern. Multiple images of the calibration object may be obtained. The multiple images may be acquired using the optical element carried by the optical element mount. The multiple images may include different perspectives of the calibration object. Optical characteristics of the optical element may be characterized based on the known visual pattern and the different perspectives of the calibration object.

Growing community of inventors

San Jose, CA, United States of America

Kai Chen